-- Logs begin at Thu 2021-10-28 13:58:28 UTC, end at Thu 2021-10-28 14:55:53 UTC. -- Oct 28 14:23:45.778437 dv-cinder-815848-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 28 14:23:45.787256 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 28 14:23:45.789152 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 28 14:23:45 2021] *** Oct 28 14:23:45.789152 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 14:23:45.789152 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 14:23:45.789152 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: nodename: dv-cinder-815848-1-iscsi Oct 28 14:23:45.789152 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: machine: x86_64 Oct 28 14:23:45.789152 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: clock source: unix Oct 28 14:23:45.789152 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: pcre jit disabled Oct 28 14:23:45.789152 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: detected number of CPU cores: 4 Oct 28 14:23:45.789152 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: current working directory: / Oct 28 14:23:45.789152 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: detected binary path: /usr/bin/uwsgi-core Oct 28 14:23:45.789152 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: your processes number limit is 47680 Oct 28 14:23:45.789152 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: your memory page size is 4096 bytes Oct 28 14:23:45.790771 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: detected max file descriptor number: 2048 Oct 28 14:23:45.790771 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: lock engine: pthread robust mutexes Oct 28 14:23:45.790771 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: thunder lock: enabled Oct 28 14:23:45.790771 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 28 14:23:45.790771 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 28 14:23:45.833500 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: Python main interpreter initialized at 0x5638775399c0 Oct 28 14:23:45.833500 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: python threads support enabled Oct 28 14:23:45.833500 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: your server socket listen backlog is limited to 100 connections Oct 28 14:23:45.833500 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: your mercy for graceful operations on workers is 90 seconds Oct 28 14:23:45.833897 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 14:23:45.833897 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: *** Operational MODE: preforking *** Oct 28 14:23:45.834151 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: *** uWSGI is running in multiple interpreter mode *** Oct 28 14:23:45.834151 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: spawned uWSGI master process (pid: 79398) Oct 28 14:23:45.834346 dv-cinder-815848-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 28 14:23:45.835953 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: spawned uWSGI worker 1 (pid: 79413, cores: 1) Oct 28 14:23:45.835953 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: spawned uWSGI worker 2 (pid: 79414, cores: 1) Oct 28 14:23:45.835953 dv-cinder-815848-1-iscsi devstack@keystone.service[79398]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 14:23:50.904301 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 14:23:50.904301 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: from cryptography.utils import int_from_bytes Oct 28 14:23:50.905017 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 14:23:50.905017 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: from cryptography.utils import int_from_bytes Oct 28 14:23:50.907266 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 14:23:50.907266 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: from cryptography.utils import int_from_bytes Oct 28 14:23:50.907793 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 14:23:50.907793 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: from cryptography.utils import int_from_bytes Oct 28 14:23:50.953602 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 14:23:50.953807 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 14:23:50.953940 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] command line args: [] {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 14:23:50.954219 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 14:23:50.954351 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ================================================================================ {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 14:23:50.954439 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 14:23:50.954606 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 14:23:50.954739 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] admin_token = **** {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.954822 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] command line args: [] {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 14:23:50.954887 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] config_dir = [] {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.955084 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.955214 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 14:23:50.955298 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] config_source = [] {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.955367 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ================================================================================ {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 14:23:50.955432 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] debug = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.955498 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] admin_token = **** {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.955566 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.955854 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] config_dir = [] {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.955854 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.955970 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.956034 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] config_source = [] {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.956099 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.956240 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] debug = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.956316 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.956416 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.956517 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.956645 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.956727 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] list_limit = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.956826 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.956905 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] log_config_append = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.957078 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.957202 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.957284 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] log_dir = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.957353 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.957418 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] log_file = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.957553 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] list_limit = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.957637 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.957729 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] log_config_append = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.957803 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.957869 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.958010 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] log_dir = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.958094 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.958160 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] log_file = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.958277 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.958420 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.958576 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.958576 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.958771 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.958853 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.958925 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.959136 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.959272 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.959364 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.959438 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.959507 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.959581 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.959737 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.959859 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.960012 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.960190 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.960316 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.960466 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.960573 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.960678 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.960815 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.960927 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.961035 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.961180 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.961287 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.79/identity {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.961394 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.961525 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] publish_errors = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.961525 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.961744 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.961891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.961891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.962096 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.79/identity {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.962240 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.962354 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] publish_errors = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.962465 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.962607 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.962723 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] standard_threads = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.962954 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.963072 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.963155 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.963267 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.963349 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.963458 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.963458 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] use_journal = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.963597 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.963669 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] use_json = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.963744 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] standard_threads = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.963859 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] use_stderr = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.963940 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.964018 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] use_syslog = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.964089 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.964159 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.964235 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.964316 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.964388 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] use_journal = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.964553 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.964651 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] use_json = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.964651 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] use_stderr = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.964794 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.964874 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] use_syslog = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.964954 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.965026 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 14:23:50.965229 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.965362 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.965444 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.965530 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.965687 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.965822 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.965947 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.966033 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.966107 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.966270 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.966348 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.966418 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.966608 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.966775 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.966873 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.966963 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.967046 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.967118 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.967301 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.967424 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.967502 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.967588 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.967772 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.967907 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.967992 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.968067 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.968237 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.968373 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.968460 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.968579 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.968695 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.968785 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.968897 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.968983 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.969488 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.969609 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.969699 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.969774 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.969856 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.969932 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.970002 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.970078 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.970144 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.970209 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.970282 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.970352 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.970492 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.970625 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.970747 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.970831 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.970993 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.971126 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.971212 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.971285 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.971433 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.971556 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.971720 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.971798 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.971877 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.972005 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.972226 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.972315 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.972447 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.972535 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.972693 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.972774 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.972924 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.973004 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.973149 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.973232 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.973376 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.973472 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.973600 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.973682 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.973823 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.973904 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.974045 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.974133 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.974275 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.974357 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.974504 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.974593 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.974750 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.974843 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.974978 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.975057 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.975201 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.975282 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.975413 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.975495 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.975642 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.975717 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.975880 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.975949 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.976102 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.976175 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.976343 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.976449 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.976616 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.976731 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.976866 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.976971 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.977082 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.977230 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.977345 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.977480 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.977586 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.977690 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.977828 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.977950 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.978057 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.978189 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.978296 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.978412 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.978555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.978670 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.978920 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.979069 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.979187 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.979296 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.979451 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.979556 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.979693 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.979808 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.979922 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.980055 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.980169 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.980276 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.980410 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.980523 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.980629 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.980762 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.980874 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.980952 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.981062 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.981148 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.981252 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.981330 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.981401 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.981471 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.981540 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.981655 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.981732 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.981815 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.981894 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.981966 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.982036 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.982113 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.982185 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.982299 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.982417 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.982567 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.982746 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.982921 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.983008 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.983083 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.983160 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.983264 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.983350 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.983524 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.983605 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.983714 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.983790 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.983959 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.984083 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.984177 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.984252 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.984404 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.984549 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.984637 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.984711 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.984830 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.984919 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.985093 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.985231 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.985314 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.985387 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.985539 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] auth.external = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.985683 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.985771 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.985852 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.986021 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.986143 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.986224 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.986349 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.986433 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] auth.password = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.986514 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.986695 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] auth.token = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.986819 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] auth.external = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.986898 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.986991 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.987148 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.987301 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.987394 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.987566 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.987691 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.987788 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] auth.password = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.987865 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.988005 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] auth.token = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.988089 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.988242 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.988325 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.988474 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] credential.caching = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.988557 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.988715 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.988807 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.988941 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.989022 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.989181 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.989298 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.989386 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.989460 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.989635 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.989718 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.989873 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.989956 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] credential.caching = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.990110 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.990200 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.990352 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.990443 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.990607 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.990736 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.990860 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.990946 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.991114 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.991196 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.991348 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.991431 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.991575 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.991686 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.991843 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.991927 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.992080 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.992164 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.992305 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] federation.caching = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.992388 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.992543 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.992627 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.992796 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.992885 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.993022 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.993103 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.993246 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.993324 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.993485 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.993574 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.993715 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.993794 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] federation.caching = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.993966 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.994045 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.994197 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.994284 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.994478 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.994609 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.994811 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.994892 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.994965 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.995051 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.995180 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] identity.caching = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.995269 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.995419 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.995499 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.995658 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.995746 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.995890 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.995969 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.996139 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.996218 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.996400 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.996564 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.996640 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] identity.caching = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.996718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.996881 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.996960 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.997130 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.997219 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.997369 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.997448 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.997594 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.997671 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.997823 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.997910 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.998050 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.998129 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.998286 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.998364 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.998525 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.998610 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.998787 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.998868 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.999028 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.999106 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.999260 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.999353 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.999492 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.999571 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.999734 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.999812 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:50.999965 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.000052 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.000194 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.000274 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.000429 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.000508 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.000656 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.000744 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.000890 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.000970 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.001125 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.001211 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.001360 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.001448 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.001603 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.001682 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.001830 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.001909 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.002066 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.002152 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.002303 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.002383 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.002536 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.002613 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.002796 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.002890 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.003038 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.003117 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.003266 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.003343 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.003498 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.003577 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.003723 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.003801 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.003956 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.004034 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.004190 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.004270 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.004426 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.004505 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.004654 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.004731 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.004884 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.004963 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.005111 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.005188 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.005348 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.005426 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.005575 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.005653 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.005800 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.005878 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.006033 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.006110 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.006270 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.006350 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.006497 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.006574 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.006745 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.006828 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.006976 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.007057 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.007200 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.user = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.007278 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.007433 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.007511 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.007690 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.007789 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.007922 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.008025 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.008155 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.008273 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.008388 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.008519 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.008617 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.user = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.008765 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.008844 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.008997 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.009195 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.009276 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.009431 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.009515 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.009664 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.009741 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.009917 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.010061 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.010177 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.010263 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.010422 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.010501 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.010651 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.010785 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.010912 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.010991 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.011147 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.011226 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.011384 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.011464 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.011607 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.011684 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.011850 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.011928 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.012096 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.012177 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.012340 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.012419 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.012584 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.012669 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.012828 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.012909 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.013058 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.013137 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.013305 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.013384 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.013542 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.013622 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.013778 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.013857 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.014011 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.014087 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.014242 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.014320 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.014475 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.014552 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.014726 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.014808 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.014965 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.015046 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.015212 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.015290 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.015441 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.015518 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.015666 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.015745 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.015900 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.015979 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.016132 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.016209 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] resource.caching = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.016369 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.016449 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.016611 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.016688 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.016853 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.016930 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.017090 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.017171 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.017337 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.017414 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.017571 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.017650 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] resource.caching = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.017815 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.017897 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.018048 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.018127 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.018281 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.018358 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.018509 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] role.caching = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.018587 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.018775 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] role.driver = sql {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.018857 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.019005 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.019163 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.019240 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.019311 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.019470 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.019549 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.019708 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.019794 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.019940 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] role.caching = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.020017 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.020179 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.020258 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] role.driver = sql {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.020408 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.020494 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.020646 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.020724 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.020895 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.020986 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.021112 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.021201 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.021355 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.021434 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.021595 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.021674 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.021836 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.021922 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.022076 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.022160 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.022318 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.022465 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.022544 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.022712 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.022796 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.022960 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.023039 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.023204 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.023285 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.023445 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.023525 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.023686 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.023887 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.023966 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.024125 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.024212 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.024375 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.024462 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.024608 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.024685 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.024863 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.024939 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.025048 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.025127 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.025274 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.025352 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.025536 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.025617 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.025788 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.025867 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.026031 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.026110 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.026263 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.026344 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.026493 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.026571 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.026747 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.026828 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.026979 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] token.caching = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.027059 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.027213 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.027291 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.027453 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.027531 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.027703 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.027783 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.027940 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.028040 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.028171 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.028283 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.028406 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] token.caching = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.028515 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.028643 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.028755 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.028889 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.028993 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.029123 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.029232 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.029378 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.029457 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.029625 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.029705 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.029863 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.029943 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.030104 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.030182 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.030344 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.030422 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.030581 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.030659 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.030841 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.030922 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.031079 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.031156 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.031314 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.031394 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] database.connection = **** {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.031559 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.031637 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.031801 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.031878 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.032033 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.032112 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.032275 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.032353 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.032509 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.032587 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.032743 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.032823 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] database.connection = **** {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.032977 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.033055 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.033209 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.033287 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.033450 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.033530 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.033700 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.033777 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.033935 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.034013 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.034163 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.034254 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.034397 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.034474 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.034626 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.034738 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.034890 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.034988 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.035120 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.035199 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.035358 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.035436 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.035586 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.035674 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.035748 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 14:23:51.035853 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.036088 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.036333 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.036564 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.036802 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.037036 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 14:23:51.037205 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 14:23:51.066641 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.066891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.067113 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.067459 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.067698 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.067924 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.075841 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.076572 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.104190 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.104779 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.108881 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.109119 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.159199 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.159714 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.301096 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.301327 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.301398 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.301941 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.368638 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.368843 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.369069 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.369194 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.369278 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.369353 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.369539 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.369678 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.369764 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.369839 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.369998 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.370215 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.395003 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.395211 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.395311 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.395475 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.395601 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.395704 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.395784 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.395892 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.396057 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.396182 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.396263 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.396352 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.396430 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.396504 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.407720 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.407846 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.420720 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.420872 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.420943 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.421162 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.421302 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.421302 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.421438 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.421500 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.421604 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.421679 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.421741 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.421897 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.422023 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.422125 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 14:23:51.439428 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.439562 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.439654 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 14:23:51.439736 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 14:23:51.439953 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.440078 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.440148 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 14:23:51.440241 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 14:23:51.440390 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.440515 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.440663 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.440754 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.440916 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.441061 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.441134 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.441209 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.451772 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.451895 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.452049 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.452193 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.452299 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.452461 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.452585 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.452746 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.460685 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.460809 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.464010 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.464136 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.464290 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.464433 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.464550 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.464642 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.464852 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.464980 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.465098 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.465190 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.465391 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.465545 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.465620 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.465695 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.465878 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.465971 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.466172 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.466311 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.466393 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.466524 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.466645 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.466801 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.492679 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.492807 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.494247 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.494373 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.494588 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.494748 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.499959 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.500075 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.500192 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.500291 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.500498 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.500624 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.507631 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.507777 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.507885 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.507975 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.512361 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.512487 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.512623 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.512716 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.512928 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.513060 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.513178 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.513270 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.513475 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.513599 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.513751 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.513877 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.514024 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.514165 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.514346 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.514470 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.532700 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.532826 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.532952 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.533046 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.537498 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.537626 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.541169 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.541364 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.541528 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.541655 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.546467 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.546592 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.550026 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.550172 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.553953 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.554079 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.554245 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.554371 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.554538 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.554665 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.554843 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.554967 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.555132 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.555277 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.555396 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.555489 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.574260 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.574385 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.574511 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.574604 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.574843 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.574974 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.575044 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.575147 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.582999 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.583125 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.584728 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.584851 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.585002 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.585217 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.588020 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.588146 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.588323 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.588448 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.588583 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.588677 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.588887 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.589012 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.589126 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.589237 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.602362 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.602486 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.602640 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.602781 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.602912 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.603003 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.603188 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.603282 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.603485 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.603611 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.603805 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.603968 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.604061 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.604138 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.621636 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.621781 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.624866 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.626093 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.629368 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.629492 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.631135 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.631278 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.632779 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.632920 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.633038 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.633140 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.633336 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.633513 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.640573 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.640803 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.642148 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.642384 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.645492 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.645618 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.645783 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.645927 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.646039 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.646131 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.646342 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.646467 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.655314 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.655456 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.655574 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.655667 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.655877 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.656002 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.663690 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.663816 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 14:23:51.663979 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.664106 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.664258 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.664386 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.664477 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.664555 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.664786 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.664912 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.665061 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.665197 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.665314 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.665405 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.665601 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.665728 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.665815 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.665895 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.666088 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.666243 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.666416 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.666524 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.666697 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.666789 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.666988 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.667113 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.667195 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.667289 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 14:23:51.705025 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5638775399c0 pid: 79414 (default app) Oct 28 14:23:51.705147 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5638775399c0 pid: 79413 (default app) Oct 28 14:23:51.708280 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73c217-72f4-4e52-9152-00bc1e1a70a9 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:23:51.708567 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73c217-72f4-4e52-9152-00bc1e1a70a9 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:23:51.708840 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73c217-72f4-4e52-9152-00bc1e1a70a9 None None] PATH_INFO: `/v3` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:23:51.713290 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1/1] 10.222.0.79 () {50 vars in 791 bytes} [Thu Oct 28 14:23:51 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:23:59.417832 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d694ce9-4355-4e07-9700-95aa440f1fc5 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:23:59.418666 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d694ce9-4355-4e07-9700-95aa440f1fc5 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:23:59.418666 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d694ce9-4355-4e07-9700-95aa440f1fc5 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:23:59.427373 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1/2] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:23:59 2021] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:23:59.436467 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5eb3c-baa7-4989-96a1-83254e23994a None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:23:59.437220 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5eb3c-baa7-4989-96a1-83254e23994a None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:23:59.437374 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5eb3c-baa7-4989-96a1-83254e23994a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:23:59.477725 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG oslo_db.sqlalchemy.engines [None req-c9a5eb3c-baa7-4989-96a1-83254e23994a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79414) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 14:23:59.686734 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG passlib.handlers.bcrypt [None req-c9a5eb3c-baa7-4989-96a1-83254e23994a None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79414) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 28 14:23:59.687083 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG passlib.handlers.bcrypt [None req-c9a5eb3c-baa7-4989-96a1-83254e23994a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79414) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 28 14:23:59.743413 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-c9a5eb3c-baa7-4989-96a1-83254e23994a None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:23:59.745092 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-c9a5eb3c-baa7-4989-96a1-83254e23994a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:23:59.894355 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 2/3] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:23:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:00.066231 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d694ce9-4355-4e07-9700-95aa440f1fc5 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:00.105586 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG oslo_db.sqlalchemy.engines [None req-1d694ce9-4355-4e07-9700-95aa440f1fc5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79413) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 14:24:00.245729 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d694ce9-4355-4e07-9700-95aa440f1fc5 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:00.251198 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ccf2c-7e25-422a-8d90-26c51a41999b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:00.251867 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ccf2c-7e25-422a-8d90-26c51a41999b admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:00.252152 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ccf2c-7e25-422a-8d90-26c51a41999b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:00.252397 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ccf2c-7e25-422a-8d90-26c51a41999b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:00.261452 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ccf2c-7e25-422a-8d90-26c51a41999b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:00.311636 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.common.rbac_enforcer.enforcer [None req-217ccf2c-7e25-422a-8d90-26c51a41999b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 28 14:24:00.311938 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ccf2c-7e25-422a-8d90-26c51a41999b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:00.322360 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 2/4] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:00.335471 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5eb3c-baa7-4989-96a1-83254e23994a None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:00.351199 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5eb3c-baa7-4989-96a1-83254e23994a None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:00.357538 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f6a53-f065-4a74-9e76-04a7bd1a58e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:00.358663 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f6a53-f065-4a74-9e76-04a7bd1a58e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:00.358980 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f6a53-f065-4a74-9e76-04a7bd1a58e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:00.359255 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f6a53-f065-4a74-9e76-04a7bd1a58e4 admin admin] PATH_INFO: `/v3/projects/7760de20f300416cbabf0f95c42b2e83` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:00.360972 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f6a53-f065-4a74-9e76-04a7bd1a58e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=7760de20f300416cbabf0f95c42b2e83)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:00.412323 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bf9f6a53-f065-4a74-9e76-04a7bd1a58e4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 28 14:24:00.412653 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f6a53-f065-4a74-9e76-04a7bd1a58e4 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:00.417347 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 3/5] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:00 2021] GET /identity/v3/projects/7760de20f300416cbabf0f95c42b2e83 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:02.652361 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5a9b6-96a7-42ed-9fca-91e8bdc01b2b None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:02.653287 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5a9b6-96a7-42ed-9fca-91e8bdc01b2b None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:02.653287 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5a9b6-96a7-42ed-9fca-91e8bdc01b2b None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:02.660729 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 3/6] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:02 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:02.667043 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514004b-8a4d-43b5-8af5-66c6d8e0aaae None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:02.667501 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514004b-8a4d-43b5-8af5-66c6d8e0aaae None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:02.667588 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514004b-8a4d-43b5-8af5-66c6d8e0aaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:02.688272 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-c514004b-8a4d-43b5-8af5-66c6d8e0aaae None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:02.689785 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-c514004b-8a4d-43b5-8af5-66c6d8e0aaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:02.698210 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 4/7] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:02.722047 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5a9b6-96a7-42ed-9fca-91e8bdc01b2b None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:02.744780 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5a9b6-96a7-42ed-9fca-91e8bdc01b2b None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:02.751120 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe81cb6-1f87-48d5-adfe-c75b5081d180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:02.751743 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe81cb6-1f87-48d5-adfe-c75b5081d180 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:02.752045 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe81cb6-1f87-48d5-adfe-c75b5081d180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:02.752314 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe81cb6-1f87-48d5-adfe-c75b5081d180 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:02.761712 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe81cb6-1f87-48d5-adfe-c75b5081d180 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:02.763559 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe81cb6-1f87-48d5-adfe-c75b5081d180 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:02.773316 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 4/8] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:02 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:02.783070 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514004b-8a4d-43b5-8af5-66c6d8e0aaae None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:02.795839 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514004b-8a4d-43b5-8af5-66c6d8e0aaae None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:02.803321 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5ee86-aa44-4da3-9334-8e1ce1b708c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:02.804621 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5ee86-aa44-4da3-9334-8e1ce1b708c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:02.804928 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5ee86-aa44-4da3-9334-8e1ce1b708c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:02.805296 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5ee86-aa44-4da3-9334-8e1ce1b708c4 admin admin] PATH_INFO: `/v3/users/04a56319092f4998a9d4cfc7569eb00c` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:02.807584 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5ee86-aa44-4da3-9334-8e1ce1b708c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=04a56319092f4998a9d4cfc7569eb00c)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:02.810525 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5ee86-aa44-4da3-9334-8e1ce1b708c4 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:02.813110 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 5/9] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:24:02 2021] GET /identity/v3/users/04a56319092f4998a9d4cfc7569eb00c => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:05.135370 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19da32-3744-47de-b149-95fe28b110ab None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:05.135916 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19da32-3744-47de-b149-95fe28b110ab None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:05.135916 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19da32-3744-47de-b149-95fe28b110ab None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:05.137647 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 5/10] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:05.143770 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4d919-3e52-43cd-9159-0b198411aa12 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:05.144231 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4d919-3e52-43cd-9159-0b198411aa12 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:05.144493 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4d919-3e52-43cd-9159-0b198411aa12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:05.145902 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c126e-053d-45b1-9697-8110b858e412 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:05.146190 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c126e-053d-45b1-9697-8110b858e412 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:05.146464 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c126e-053d-45b1-9697-8110b858e412 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:05.148067 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 6/11] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:05.154846 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4bfe8-85fb-48ac-9f95-16c848e490bf None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:05.155071 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4bfe8-85fb-48ac-9f95-16c848e490bf None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:05.155345 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4bfe8-85fb-48ac-9f95-16c848e490bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:05.163175 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-cfd4d919-3e52-43cd-9159-0b198411aa12 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:05.164379 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-cfd4d919-3e52-43cd-9159-0b198411aa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:05.171937 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 6/12] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:24:05.196718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4d919-3e52-43cd-9159-0b198411aa12 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:05.197939 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG passlib.handlers.bcrypt [None req-31f4bfe8-85fb-48ac-9f95-16c848e490bf None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79413) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 28 14:24:05.198331 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG passlib.handlers.bcrypt [None req-31f4bfe8-85fb-48ac-9f95-16c848e490bf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79413) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 28 14:24:05.205789 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4d919-3e52-43cd-9159-0b198411aa12 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:05.210431 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b30301-9b2f-4fc6-befd-e711892c1849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:05.211539 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b30301-9b2f-4fc6-befd-e711892c1849 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:05.211824 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b30301-9b2f-4fc6-befd-e711892c1849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:05.212098 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b30301-9b2f-4fc6-befd-e711892c1849 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:05.225070 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b30301-9b2f-4fc6-befd-e711892c1849 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:05.232000 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-12b30301-9b2f-4fc6-befd-e711892c1849 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:24:05.233188 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 7/13] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:24:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:05.239391 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b30301-9b2f-4fc6-befd-e711892c1849 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:05.243837 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-31f4bfe8-85fb-48ac-9f95-16c848e490bf None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:05.247546 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-31f4bfe8-85fb-48ac-9f95-16c848e490bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:05.248757 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b30301-9b2f-4fc6-befd-e711892c1849 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:05.253406 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275145d-dc96-4ff5-94a1-e16c51840752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:05.254043 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275145d-dc96-4ff5-94a1-e16c51840752 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:05.254324 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275145d-dc96-4ff5-94a1-e16c51840752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:05.254605 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275145d-dc96-4ff5-94a1-e16c51840752 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:05.255400 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275145d-dc96-4ff5-94a1-e16c51840752 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:05.255702 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275145d-dc96-4ff5-94a1-e16c51840752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:05.257455 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING py.warnings [None req-c275145d-dc96-4ff5-94a1-e16c51840752 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:24:05.257455 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: warnings.warn(msg) Oct 28 14:24:05.257455 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: Oct 28 14:24:05.258357 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275145d-dc96-4ff5-94a1-e16c51840752 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:05.271888 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 8/14] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:05.275009 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 7/15] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:05.278234 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275145d-dc96-4ff5-94a1-e16c51840752 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:05.288121 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275145d-dc96-4ff5-94a1-e16c51840752 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:05.293280 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0687b48-f037-4411-817c-95b839885eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:05.294124 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0687b48-f037-4411-817c-95b839885eef admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:05.294400 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0687b48-f037-4411-817c-95b839885eef admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:05.294666 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0687b48-f037-4411-817c-95b839885eef admin admin] PATH_INFO: `/v3/users/04a56319092f4998a9d4cfc7569eb00c` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:05.296008 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0687b48-f037-4411-817c-95b839885eef admin admin] RBAC: Authorizing `identity:get_user(user_id=04a56319092f4998a9d4cfc7569eb00c)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:05.297836 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0687b48-f037-4411-817c-95b839885eef admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:05.297954 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4bfe8-85fb-48ac-9f95-16c848e490bf None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:05.299422 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 9/16] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:24:05 2021] GET /identity/v3/users/04a56319092f4998a9d4cfc7569eb00c => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:05.305459 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0687b48-f037-4411-817c-95b839885eef admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:05.308165 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4bfe8-85fb-48ac-9f95-16c848e490bf None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:05.312639 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4077e-a502-46a6-b201-a8a95354ec3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:05.313629 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4077e-a502-46a6-b201-a8a95354ec3a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:05.313915 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4077e-a502-46a6-b201-a8a95354ec3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:05.314183 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4077e-a502-46a6-b201-a8a95354ec3a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:05.315219 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0687b48-f037-4411-817c-95b839885eef admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:05.319434 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ac268-cc47-4c30-b06b-58ba9f635ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:05.320148 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ac268-cc47-4c30-b06b-58ba9f635ffd admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:05.320427 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ac268-cc47-4c30-b06b-58ba9f635ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:05.320701 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ac268-cc47-4c30-b06b-58ba9f635ffd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:05.321860 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ac268-cc47-4c30-b06b-58ba9f635ffd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:05.322292 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4077e-a502-46a6-b201-a8a95354ec3a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:05.323662 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ac268-cc47-4c30-b06b-58ba9f635ffd admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:05.324150 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4077e-a502-46a6-b201-a8a95354ec3a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:05.325396 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 10/17] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:05 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:05.331166 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ac268-cc47-4c30-b06b-58ba9f635ffd admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:05.333094 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 8/18] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:05 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:24:05.338903 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4077e-a502-46a6-b201-a8a95354ec3a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:05.340388 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ac268-cc47-4c30-b06b-58ba9f635ffd admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:05.344927 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae83820-b565-4c47-a56d-5ac174bb252f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:05.345542 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae83820-b565-4c47-a56d-5ac174bb252f admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:05.345820 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae83820-b565-4c47-a56d-5ac174bb252f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:05.346095 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae83820-b565-4c47-a56d-5ac174bb252f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:05.346955 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae83820-b565-4c47-a56d-5ac174bb252f admin admin] RBAC: Adding query filter params (role.id=f7b8954a0fe64dc2b6146c7174498ddb, scope.domain.id=default, user.id=04a56319092f4998a9d4cfc7569eb00c) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:05.347259 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae83820-b565-4c47-a56d-5ac174bb252f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:05.347411 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4077e-a502-46a6-b201-a8a95354ec3a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:05.348236 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING py.warnings [None req-2ae83820-b565-4c47-a56d-5ac174bb252f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:24:05.348236 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: warnings.warn(msg) Oct 28 14:24:05.348236 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: Oct 28 14:24:05.349382 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae83820-b565-4c47-a56d-5ac174bb252f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:05.351712 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c3121-109c-42a8-9e44-f746f23222b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:05.352466 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c3121-109c-42a8-9e44-f746f23222b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:05.352738 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c3121-109c-42a8-9e44-f746f23222b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:05.353003 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c3121-109c-42a8-9e44-f746f23222b0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:05.354562 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c3121-109c-42a8-9e44-f746f23222b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:05.356240 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 11/19] 10.222.0.79 () {56 vars in 1343 bytes} [Thu Oct 28 14:24:05 2021] GET /identity/v3/role_assignments?user.id=04a56319092f4998a9d4cfc7569eb00c&scope.domain.id=default&role.id=f7b8954a0fe64dc2b6146c7174498ddb => generated 233 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:05.356418 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c3121-109c-42a8-9e44-f746f23222b0 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:05.362756 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 9/20] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:05 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:07.872411 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039b864-c312-4e4b-8ba3-d8cb6236ac5f None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:07.873465 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039b864-c312-4e4b-8ba3-d8cb6236ac5f None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:07.874585 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039b864-c312-4e4b-8ba3-d8cb6236ac5f None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:07.877135 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 12/21] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:07 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:07.893143 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e45ccf-2c57-400b-a795-7c97ef6c304e None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:07.894094 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e45ccf-2c57-400b-a795-7c97ef6c304e None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:07.894583 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e45ccf-2c57-400b-a795-7c97ef6c304e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:07.921229 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-37e45ccf-2c57-400b-a795-7c97ef6c304e None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:07.921932 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-37e45ccf-2c57-400b-a795-7c97ef6c304e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:07.941166 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 10/22] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:07.986808 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039b864-c312-4e4b-8ba3-d8cb6236ac5f None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:08.004592 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039b864-c312-4e4b-8ba3-d8cb6236ac5f None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:08.014726 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b811ba-bae1-492f-9049-5b7a7370cff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:08.015798 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b811ba-bae1-492f-9049-5b7a7370cff0 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:08.016292 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b811ba-bae1-492f-9049-5b7a7370cff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:08.016769 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b811ba-bae1-492f-9049-5b7a7370cff0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:08.033919 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b811ba-bae1-492f-9049-5b7a7370cff0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:08.041063 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-81b811ba-bae1-492f-9049-5b7a7370cff0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:24:08.047044 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 13/23] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:24:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:08.049552 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e45ccf-2c57-400b-a795-7c97ef6c304e None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:08.065285 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e45ccf-2c57-400b-a795-7c97ef6c304e None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:08.080249 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbf8b4-170e-4298-9d4b-6e5c5b52822b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:08.080961 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbf8b4-170e-4298-9d4b-6e5c5b52822b admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:08.081245 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbf8b4-170e-4298-9d4b-6e5c5b52822b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:08.081519 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbf8b4-170e-4298-9d4b-6e5c5b52822b admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:08.082321 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbf8b4-170e-4298-9d4b-6e5c5b52822b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:08.082620 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbf8b4-170e-4298-9d4b-6e5c5b52822b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:08.084413 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING py.warnings [None req-f9cbf8b4-170e-4298-9d4b-6e5c5b52822b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:24:08.084413 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: warnings.warn(msg) Oct 28 14:24:08.084413 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: Oct 28 14:24:08.085329 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbf8b4-170e-4298-9d4b-6e5c5b52822b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:08.095008 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47fb04-5be9-48cd-963e-517e4d1446be None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:08.095548 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47fb04-5be9-48cd-963e-517e4d1446be None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:08.096008 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47fb04-5be9-48cd-963e-517e4d1446be None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:08.098282 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 14/24] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:08.106410 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 11/25] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:08.109499 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14695bd-0ae7-45b4-bc6b-a43cdb2f84e1 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:08.110005 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14695bd-0ae7-45b4-bc6b-a43cdb2f84e1 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:08.110469 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14695bd-0ae7-45b4-bc6b-a43cdb2f84e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:08.134948 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbf8b4-170e-4298-9d4b-6e5c5b52822b admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:08.139734 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-e14695bd-0ae7-45b4-bc6b-a43cdb2f84e1 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:08.141196 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e14695bd-0ae7-45b4-bc6b-a43cdb2f84e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:08.149570 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbf8b4-170e-4298-9d4b-6e5c5b52822b admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:08.156206 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a0fd2-8c75-49a9-9f9d-9d8aa9932af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:08.157350 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a0fd2-8c75-49a9-9f9d-9d8aa9932af5 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:08.157959 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a0fd2-8c75-49a9-9f9d-9d8aa9932af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:08.158431 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a0fd2-8c75-49a9-9f9d-9d8aa9932af5 admin admin] PATH_INFO: `/v3/users/04a56319092f4998a9d4cfc7569eb00c` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:08.163636 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a0fd2-8c75-49a9-9f9d-9d8aa9932af5 admin admin] RBAC: Authorizing `identity:get_user(user_id=04a56319092f4998a9d4cfc7569eb00c)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:08.164090 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 15/26] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:08.165669 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a0fd2-8c75-49a9-9f9d-9d8aa9932af5 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:08.167913 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 12/27] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:24:08 2021] GET /identity/v3/users/04a56319092f4998a9d4cfc7569eb00c => generated 247 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:08.173938 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14695bd-0ae7-45b4-bc6b-a43cdb2f84e1 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:08.187973 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14695bd-0ae7-45b4-bc6b-a43cdb2f84e1 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:08.198848 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa2b2d-74eb-49e4-bb2d-30fad91e6ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:08.199892 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa2b2d-74eb-49e4-bb2d-30fad91e6ada admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:08.200372 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa2b2d-74eb-49e4-bb2d-30fad91e6ada admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:08.200864 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa2b2d-74eb-49e4-bb2d-30fad91e6ada admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:08.205377 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a0fd2-8c75-49a9-9f9d-9d8aa9932af5 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:08.207416 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa2b2d-74eb-49e4-bb2d-30fad91e6ada admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:08.209153 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa2b2d-74eb-49e4-bb2d-30fad91e6ada admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:08.211108 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 16/28] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:08 2021] GET /identity/v3/domains/default => generated 199 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:08.217188 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa2b2d-74eb-49e4-bb2d-30fad91e6ada admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:08.218168 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a0fd2-8c75-49a9-9f9d-9d8aa9932af5 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:08.227094 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa2b2d-74eb-49e4-bb2d-30fad91e6ada admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:08.231623 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef71072-6019-435c-9187-1b77a2e81b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:08.232688 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef71072-6019-435c-9187-1b77a2e81b81 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:08.233186 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef71072-6019-435c-9187-1b77a2e81b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:08.233651 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef71072-6019-435c-9187-1b77a2e81b81 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:08.243332 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdab506-351b-47b4-b22d-c300f2859776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:08.244253 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdab506-351b-47b4-b22d-c300f2859776 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:08.244529 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdab506-351b-47b4-b22d-c300f2859776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:08.244794 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdab506-351b-47b4-b22d-c300f2859776 admin admin] PATH_INFO: `/v3/domains/default/users/04a56319092f4998a9d4cfc7569eb00c/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:08.254178 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdab506-351b-47b4-b22d-c300f2859776 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=04a56319092f4998a9d4cfc7569eb00c, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:08.255412 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING py.warnings [None req-2cdab506-351b-47b4-b22d-c300f2859776 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:24:08.255412 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: warnings.warn(msg) Oct 28 14:24:08.255412 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: Oct 28 14:24:08.257662 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdab506-351b-47b4-b22d-c300f2859776 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:08.273010 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef71072-6019-435c-9187-1b77a2e81b81 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:08.275365 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef71072-6019-435c-9187-1b77a2e81b81 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:08.310282 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-7ef71072-6019-435c-9187-1b77a2e81b81 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:08.312179 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 13/29] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:08.318008 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef71072-6019-435c-9187-1b77a2e81b81 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:08.340374 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef71072-6019-435c-9187-1b77a2e81b81 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:08.435980 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96726fa9-7366-461a-8314-bdafac3eb734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:08.436680 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96726fa9-7366-461a-8314-bdafac3eb734 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:08.436958 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96726fa9-7366-461a-8314-bdafac3eb734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:08.437227 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96726fa9-7366-461a-8314-bdafac3eb734 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:08.437979 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96726fa9-7366-461a-8314-bdafac3eb734 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:08.438277 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96726fa9-7366-461a-8314-bdafac3eb734 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:08.439305 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING py.warnings [None req-96726fa9-7366-461a-8314-bdafac3eb734 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:24:08.439305 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: warnings.warn(msg) Oct 28 14:24:08.439305 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: Oct 28 14:24:08.440213 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96726fa9-7366-461a-8314-bdafac3eb734 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:08.445998 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 17/30] 10.222.0.79 () {58 vars in 1382 bytes} [Thu Oct 28 14:24:08 2021] PUT /identity/v3/domains/default/users/04a56319092f4998a9d4cfc7569eb00c/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:24:08.470344 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 14/31] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:08.477370 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdab506-351b-47b4-b22d-c300f2859776 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:08.493822 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdab506-351b-47b4-b22d-c300f2859776 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:08.504530 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f1949-b32d-4999-a3d4-61fb5659a643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:08.505510 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f1949-b32d-4999-a3d4-61fb5659a643 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:08.505929 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f1949-b32d-4999-a3d4-61fb5659a643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:08.506341 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f1949-b32d-4999-a3d4-61fb5659a643 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:08.507275 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f1949-b32d-4999-a3d4-61fb5659a643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:08.508718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING py.warnings [None req-a79f1949-b32d-4999-a3d4-61fb5659a643 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:24:08.508718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: warnings.warn(msg) Oct 28 14:24:08.508718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: Oct 28 14:24:08.510302 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f1949-b32d-4999-a3d4-61fb5659a643 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:08.574032 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 18/32] 10.222.0.79 () {60 vars in 1162 bytes} [Thu Oct 28 14:24:08 2021] POST /identity/v3/projects => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:24:08.741414 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e7970-f056-4c2d-ad94-46981594e48e None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:08.741604 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e7970-f056-4c2d-ad94-46981594e48e None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:08.741885 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e7970-f056-4c2d-ad94-46981594e48e None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:08.743724 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 15/33] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:08.750548 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fafc0a-a9b3-4503-8007-8f8aeacb91d4 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:08.751226 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fafc0a-a9b3-4503-8007-8f8aeacb91d4 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:08.751735 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fafc0a-a9b3-4503-8007-8f8aeacb91d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:08.784059 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-21fafc0a-a9b3-4503-8007-8f8aeacb91d4 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:08.786060 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-21fafc0a-a9b3-4503-8007-8f8aeacb91d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:08.850225 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 19/34] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:24:08.887057 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e7970-f056-4c2d-ad94-46981594e48e None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:08.913359 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e7970-f056-4c2d-ad94-46981594e48e None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:08.924162 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0d53a-f708-4484-a1ef-8f1a864d85b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:08.925225 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0d53a-f708-4484-a1ef-8f1a864d85b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:08.925696 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0d53a-f708-4484-a1ef-8f1a864d85b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:08.926179 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0d53a-f708-4484-a1ef-8f1a864d85b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:08.927559 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0d53a-f708-4484-a1ef-8f1a864d85b8 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:08.928781 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING py.warnings [None req-22e0d53a-f708-4484-a1ef-8f1a864d85b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:24:08.928781 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: warnings.warn(msg) Oct 28 14:24:08.928781 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: Oct 28 14:24:08.930048 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0d53a-f708-4484-a1ef-8f1a864d85b8 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:09.083795 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 16/35] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:24:08 2021] POST /identity/v3/roles => generated 225 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:24:09.087253 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f32b0-7963-4368-96f5-6e6e66611420 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:09.088195 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f32b0-7963-4368-96f5-6e6e66611420 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:09.088670 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f32b0-7963-4368-96f5-6e6e66611420 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:09.090799 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 20/36] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:09.097923 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30448d-f7ec-4fcd-9704-584b3b91e2e3 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:09.098555 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30448d-f7ec-4fcd-9704-584b3b91e2e3 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:09.099052 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30448d-f7ec-4fcd-9704-584b3b91e2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:09.127331 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-aa30448d-f7ec-4fcd-9704-584b3b91e2e3 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:09.129346 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-aa30448d-f7ec-4fcd-9704-584b3b91e2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:09.141498 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 17/37] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:09.178463 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f32b0-7963-4368-96f5-6e6e66611420 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:09.198203 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f32b0-7963-4368-96f5-6e6e66611420 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:09.204394 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d57ae-3258-444b-b29e-93b6d4811902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:09.205438 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d57ae-3258-444b-b29e-93b6d4811902 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:09.205892 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d57ae-3258-444b-b29e-93b6d4811902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:09.206362 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d57ae-3258-444b-b29e-93b6d4811902 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:09.207390 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d57ae-3258-444b-b29e-93b6d4811902 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:09.208653 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING py.warnings [None req-fd9d57ae-3258-444b-b29e-93b6d4811902 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:24:09.208653 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: warnings.warn(msg) Oct 28 14:24:09.208653 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: Oct 28 14:24:09.210087 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d57ae-3258-444b-b29e-93b6d4811902 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:09.238536 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 21/38] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:24:09 2021] POST /identity/v3/roles => generated 219 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:24:09.298800 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8d6e8-541d-4140-a5ac-d2c410904e7c None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:09.299128 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8d6e8-541d-4140-a5ac-d2c410904e7c None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:09.299373 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8d6e8-541d-4140-a5ac-d2c410904e7c None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:09.302056 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 18/39] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:09.308638 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17069b-de49-49ce-a487-a0a2cb675ac0 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:09.309281 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17069b-de49-49ce-a487-a0a2cb675ac0 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:09.309748 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17069b-de49-49ce-a487-a0a2cb675ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:09.333784 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-1d17069b-de49-49ce-a487-a0a2cb675ac0 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:09.335483 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-1d17069b-de49-49ce-a487-a0a2cb675ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:09.345131 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 22/40] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:09.381435 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8d6e8-541d-4140-a5ac-d2c410904e7c None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:09.398247 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8d6e8-541d-4140-a5ac-d2c410904e7c None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:09.407379 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f93ce-c060-4722-8973-22c3ad7a0ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:09.408526 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f93ce-c060-4722-8973-22c3ad7a0ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:09.409136 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f93ce-c060-4722-8973-22c3ad7a0ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:09.409608 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f93ce-c060-4722-8973-22c3ad7a0ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:09.410780 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f93ce-c060-4722-8973-22c3ad7a0ba6 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:09.413022 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f93ce-c060-4722-8973-22c3ad7a0ba6 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:09.451233 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 19/41] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:24:09 2021] POST /identity/v3/roles => generated 223 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:24:09.804754 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af9015-b811-494f-8b7d-9b0ce9428ed1 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:09.805089 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af9015-b811-494f-8b7d-9b0ce9428ed1 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:09.805313 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af9015-b811-494f-8b7d-9b0ce9428ed1 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:09.807159 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 23/42] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:09.813221 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629df0da-db64-473f-82c2-a296dacbfef5 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:09.813583 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629df0da-db64-473f-82c2-a296dacbfef5 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:09.813928 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629df0da-db64-473f-82c2-a296dacbfef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:09.832150 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-629df0da-db64-473f-82c2-a296dacbfef5 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:09.833326 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-629df0da-db64-473f-82c2-a296dacbfef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:09.841514 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 20/43] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:24:09.865382 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af9015-b811-494f-8b7d-9b0ce9428ed1 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:09.878317 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af9015-b811-494f-8b7d-9b0ce9428ed1 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:09.882978 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef76dc6-3dde-4ff4-a64d-7bfbab0d2928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:09.883750 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef76dc6-3dde-4ff4-a64d-7bfbab0d2928 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:09.884032 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef76dc6-3dde-4ff4-a64d-7bfbab0d2928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:09.884306 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef76dc6-3dde-4ff4-a64d-7bfbab0d2928 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:09.885592 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef76dc6-3dde-4ff4-a64d-7bfbab0d2928 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:09.887348 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef76dc6-3dde-4ff4-a64d-7bfbab0d2928 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:09.889546 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 24/44] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:09 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:09.895410 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629df0da-db64-473f-82c2-a296dacbfef5 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:09.904561 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629df0da-db64-473f-82c2-a296dacbfef5 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:09.909108 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca8e9d-29b4-4d4f-bcba-95025882c735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:09.909774 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca8e9d-29b4-4d4f-bcba-95025882c735 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:09.910056 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca8e9d-29b4-4d4f-bcba-95025882c735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:09.910330 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca8e9d-29b4-4d4f-bcba-95025882c735 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:09.911098 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca8e9d-29b4-4d4f-bcba-95025882c735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:09.912107 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING py.warnings [None req-c1ca8e9d-29b4-4d4f-bcba-95025882c735 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:24:09.912107 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: warnings.warn(msg) Oct 28 14:24:09.912107 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: Oct 28 14:24:09.913331 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca8e9d-29b4-4d4f-bcba-95025882c735 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:09.941356 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 21/45] 10.222.0.79 () {60 vars in 1162 bytes} [Thu Oct 28 14:24:09 2021] POST /identity/v3/projects => generated 312 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:24:11.138057 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d565f-6b46-4ffd-83d4-6b40413de199 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:11.138603 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d565f-6b46-4ffd-83d4-6b40413de199 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:11.138603 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d565f-6b46-4ffd-83d4-6b40413de199 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:11.140396 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 25/46] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:11.146453 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245d218-b7c5-45ee-b369-3c1edd480f90 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:11.146922 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245d218-b7c5-45ee-b369-3c1edd480f90 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:11.147115 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245d218-b7c5-45ee-b369-3c1edd480f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:11.166406 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-e245d218-b7c5-45ee-b369-3c1edd480f90 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:11.167626 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-e245d218-b7c5-45ee-b369-3c1edd480f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:11.231128 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 22/47] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:11.255651 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d565f-6b46-4ffd-83d4-6b40413de199 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:11.268752 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d565f-6b46-4ffd-83d4-6b40413de199 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:11.273294 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3aa0fb-f474-4519-ad50-168d66cde954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:11.274088 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3aa0fb-f474-4519-ad50-168d66cde954 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:11.274372 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3aa0fb-f474-4519-ad50-168d66cde954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:11.274644 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3aa0fb-f474-4519-ad50-168d66cde954 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:11.285686 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3aa0fb-f474-4519-ad50-168d66cde954 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:11.292575 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-bd3aa0fb-f474-4519-ad50-168d66cde954 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:24:11.293823 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 26/48] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:24:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:11.300420 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245d218-b7c5-45ee-b369-3c1edd480f90 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:11.311506 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245d218-b7c5-45ee-b369-3c1edd480f90 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:11.317290 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac65c4-503b-4706-8c58-e6419e75b1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:11.317971 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac65c4-503b-4706-8c58-e6419e75b1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:11.318258 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac65c4-503b-4706-8c58-e6419e75b1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:11.318533 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac65c4-503b-4706-8c58-e6419e75b1f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:11.319338 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac65c4-503b-4706-8c58-e6419e75b1f3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:11.319648 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac65c4-503b-4706-8c58-e6419e75b1f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:11.321280 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac65c4-503b-4706-8c58-e6419e75b1f3 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:11.330054 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 23/49] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:11.336207 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3aa0fb-f474-4519-ad50-168d66cde954 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:11.346542 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3aa0fb-f474-4519-ad50-168d66cde954 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:11.351432 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfdccf-75b7-40f9-83a8-f22babd541ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:11.352282 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfdccf-75b7-40f9-83a8-f22babd541ed admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:11.352542 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfdccf-75b7-40f9-83a8-f22babd541ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:11.352841 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfdccf-75b7-40f9-83a8-f22babd541ed admin admin] PATH_INFO: `/v3/users/04a56319092f4998a9d4cfc7569eb00c` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:11.354166 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfdccf-75b7-40f9-83a8-f22babd541ed admin admin] RBAC: Authorizing `identity:get_user(user_id=04a56319092f4998a9d4cfc7569eb00c)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:11.356070 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfdccf-75b7-40f9-83a8-f22babd541ed admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:11.357700 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 27/50] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:24:11 2021] GET /identity/v3/users/04a56319092f4998a9d4cfc7569eb00c => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:11.363752 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac65c4-503b-4706-8c58-e6419e75b1f3 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:11.374149 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac65c4-503b-4706-8c58-e6419e75b1f3 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:11.379889 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc315ad4-b2a9-4624-804b-ffe0e37bc866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:11.380678 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc315ad4-b2a9-4624-804b-ffe0e37bc866 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:11.380964 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc315ad4-b2a9-4624-804b-ffe0e37bc866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:11.381243 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc315ad4-b2a9-4624-804b-ffe0e37bc866 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:11.382497 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc315ad4-b2a9-4624-804b-ffe0e37bc866 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:11.384250 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc315ad4-b2a9-4624-804b-ffe0e37bc866 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:11.385902 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 24/51] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:11 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:11.391975 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfdccf-75b7-40f9-83a8-f22babd541ed admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:11.401687 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfdccf-75b7-40f9-83a8-f22babd541ed admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:11.406530 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dcdb5-5acf-4241-adda-f6a80c453464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:11.407182 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dcdb5-5acf-4241-adda-f6a80c453464 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:11.407464 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dcdb5-5acf-4241-adda-f6a80c453464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:11.407741 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dcdb5-5acf-4241-adda-f6a80c453464 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:11.408576 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dcdb5-5acf-4241-adda-f6a80c453464 admin admin] RBAC: Adding query filter params (role.id=f7b8954a0fe64dc2b6146c7174498ddb, scope.domain.id=default, user.id=04a56319092f4998a9d4cfc7569eb00c) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:11.408879 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dcdb5-5acf-4241-adda-f6a80c453464 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:11.410714 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dcdb5-5acf-4241-adda-f6a80c453464 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:11.416637 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 28/52] 10.222.0.79 () {56 vars in 1343 bytes} [Thu Oct 28 14:24:11 2021] GET /identity/v3/role_assignments?user.id=04a56319092f4998a9d4cfc7569eb00c&scope.domain.id=default&role.id=f7b8954a0fe64dc2b6146c7174498ddb => generated 530 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:12.166826 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7b7c0-815f-4064-a251-dc30120da304 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:12.167349 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7b7c0-815f-4064-a251-dc30120da304 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:12.167349 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7b7c0-815f-4064-a251-dc30120da304 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:12.169134 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 25/53] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:12.176155 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af9143-3667-410e-a0b5-b8ca33357a4b None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:12.177248 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af9143-3667-410e-a0b5-b8ca33357a4b None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:12.177402 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af9143-3667-410e-a0b5-b8ca33357a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:12.199471 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-a8af9143-3667-410e-a0b5-b8ca33357a4b None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:12.200680 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-a8af9143-3667-410e-a0b5-b8ca33357a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:12.210701 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 29/54] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:12.246972 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7b7c0-815f-4064-a251-dc30120da304 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:12.264664 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7b7c0-815f-4064-a251-dc30120da304 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:12.270026 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d60f6-ed5d-4321-b13c-4335d7bdc3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:12.270855 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d60f6-ed5d-4321-b13c-4335d7bdc3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:12.271126 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d60f6-ed5d-4321-b13c-4335d7bdc3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:12.271394 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d60f6-ed5d-4321-b13c-4335d7bdc3a0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:12.272678 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d60f6-ed5d-4321-b13c-4335d7bdc3a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:12.274368 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d60f6-ed5d-4321-b13c-4335d7bdc3a0 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:12.276027 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 26/55] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:12 2021] GET /identity/v3/domains/default => generated 199 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:12.282941 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af9143-3667-410e-a0b5-b8ca33357a4b None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:12.298168 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af9143-3667-410e-a0b5-b8ca33357a4b None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:12.307613 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b86978-9c63-4d3b-a8a4-a0a5d5d73d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:12.308269 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b86978-9c63-4d3b-a8a4-a0a5d5d73d20 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:12.308547 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b86978-9c63-4d3b-a8a4-a0a5d5d73d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:12.308818 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b86978-9c63-4d3b-a8a4-a0a5d5d73d20 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:12.309541 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b86978-9c63-4d3b-a8a4-a0a5d5d73d20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:12.311509 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b86978-9c63-4d3b-a8a4-a0a5d5d73d20 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:12.338554 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 30/56] 10.222.0.79 () {60 vars in 1161 bytes} [Thu Oct 28 14:24:12 2021] POST /identity/v3/projects => generated 298 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:24:14.574796 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6b050-1f69-4f75-8d65-11abd8d8a381 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:14.575383 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6b050-1f69-4f75-8d65-11abd8d8a381 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:14.575383 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6b050-1f69-4f75-8d65-11abd8d8a381 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:14.577140 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 27/57] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:14.584074 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24344ec-5c04-449f-be1e-f4c4200e04ee None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:14.584785 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24344ec-5c04-449f-be1e-f4c4200e04ee None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:14.584971 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24344ec-5c04-449f-be1e-f4c4200e04ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:14.606580 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-e24344ec-5c04-449f-be1e-f4c4200e04ee None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:14.607832 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e24344ec-5c04-449f-be1e-f4c4200e04ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:14.678934 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 31/58] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:14.704705 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6b050-1f69-4f75-8d65-11abd8d8a381 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:14.717885 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6b050-1f69-4f75-8d65-11abd8d8a381 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:14.723364 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7f6f0-75d3-46a4-a2f6-0736ff3e8ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:14.724155 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7f6f0-75d3-46a4-a2f6-0736ff3e8ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:14.724480 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7f6f0-75d3-46a4-a2f6-0736ff3e8ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:14.724821 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7f6f0-75d3-46a4-a2f6-0736ff3e8ad5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:14.726225 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7f6f0-75d3-46a4-a2f6-0736ff3e8ad5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:14.728163 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7f6f0-75d3-46a4-a2f6-0736ff3e8ad5 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:14.729905 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 28/59] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:14 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:14.736613 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24344ec-5c04-449f-be1e-f4c4200e04ee None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:14.748876 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24344ec-5c04-449f-be1e-f4c4200e04ee None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:14.754566 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a7fd2-ae4e-4341-bdb4-a68c7fd06b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:14.755259 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a7fd2-ae4e-4341-bdb4-a68c7fd06b30 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:14.755537 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a7fd2-ae4e-4341-bdb4-a68c7fd06b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:14.755807 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a7fd2-ae4e-4341-bdb4-a68c7fd06b30 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:14.756534 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a7fd2-ae4e-4341-bdb4-a68c7fd06b30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:14.757546 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING py.warnings [None req-8e1a7fd2-ae4e-4341-bdb4-a68c7fd06b30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:24:14.757546 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: warnings.warn(msg) Oct 28 14:24:14.757546 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: Oct 28 14:24:14.758861 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a7fd2-ae4e-4341-bdb4-a68c7fd06b30 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:14.791449 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 32/60] 10.222.0.79 () {60 vars in 1153 bytes} [Thu Oct 28 14:24:14 2021] POST /identity/v3/users => generated 275 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:24:18.260284 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3be84-ad55-4668-99b7-d94838b1f185 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.261124 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3be84-ad55-4668-99b7-d94838b1f185 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.261565 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3be84-ad55-4668-99b7-d94838b1f185 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.263877 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 29/61] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:18.268805 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68f8fa-58e7-4206-a4be-4401e55a46aa None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.269658 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68f8fa-58e7-4206-a4be-4401e55a46aa None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.270125 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68f8fa-58e7-4206-a4be-4401e55a46aa None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.272404 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 33/62] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:18.276363 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f0395-e059-484b-abe1-de125d70a367 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.276951 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f0395-e059-484b-abe1-de125d70a367 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.277427 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f0395-e059-484b-abe1-de125d70a367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.291936 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a961b-1b38-43d2-9840-51a25ed5ccb2 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.292517 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a961b-1b38-43d2-9840-51a25ed5ccb2 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.293014 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a961b-1b38-43d2-9840-51a25ed5ccb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.303240 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-f65f0395-e059-484b-abe1-de125d70a367 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:18.308465 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-f65f0395-e059-484b-abe1-de125d70a367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:18.325090 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-534a961b-1b38-43d2-9840-51a25ed5ccb2 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:18.327451 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-534a961b-1b38-43d2-9840-51a25ed5ccb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:18.328967 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 30/63] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:18.337384 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 34/64] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:18.371026 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f0395-e059-484b-abe1-de125d70a367 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:18.382474 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a961b-1b38-43d2-9840-51a25ed5ccb2 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:18.383614 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f0395-e059-484b-abe1-de125d70a367 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:18.397576 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a961b-1b38-43d2-9840-51a25ed5ccb2 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:18.398627 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337adea-a401-40ce-aa43-5d83c7987a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:18.399738 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337adea-a401-40ce-aa43-5d83c7987a20 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.400310 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337adea-a401-40ce-aa43-5d83c7987a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.400786 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337adea-a401-40ce-aa43-5d83c7987a20 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.418063 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b64e6-34c7-458d-83c2-d23b1c9aaad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:18.419275 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b64e6-34c7-458d-83c2-d23b1c9aaad2 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.419779 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337adea-a401-40ce-aa43-5d83c7987a20 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:18.420053 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b64e6-34c7-458d-83c2-d23b1c9aaad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.420539 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b64e6-34c7-458d-83c2-d23b1c9aaad2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.432017 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b64e6-34c7-458d-83c2-d23b1c9aaad2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:18.434976 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-e337adea-a401-40ce-aa43-5d83c7987a20 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 14:24:18.436611 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 31/65] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:18 2021] GET /identity/v3/roles/member => generated 84 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:18.439802 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-033b64e6-34c7-458d-83c2-d23b1c9aaad2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:24:18.441687 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 35/66] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:24:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:18.448045 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337adea-a401-40ce-aa43-5d83c7987a20 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:18.448233 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b64e6-34c7-458d-83c2-d23b1c9aaad2 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:18.460986 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337adea-a401-40ce-aa43-5d83c7987a20 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:18.461868 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b64e6-34c7-458d-83c2-d23b1c9aaad2 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:18.470315 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df1d7c-eae9-4d6f-bd85-4f30f808ba17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:18.471388 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef2e11-d17d-4ccd-9df1-7d03c60e4da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:18.472339 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df1d7c-eae9-4d6f-bd85-4f30f808ba17 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.473247 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef2e11-d17d-4ccd-9df1-7d03c60e4da8 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.473748 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df1d7c-eae9-4d6f-bd85-4f30f808ba17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.474264 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df1d7c-eae9-4d6f-bd85-4f30f808ba17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.475639 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df1d7c-eae9-4d6f-bd85-4f30f808ba17 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:18.475916 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef2e11-d17d-4ccd-9df1-7d03c60e4da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.476392 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef2e11-d17d-4ccd-9df1-7d03c60e4da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.477406 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef2e11-d17d-4ccd-9df1-7d03c60e4da8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:18.477980 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df1d7c-eae9-4d6f-bd85-4f30f808ba17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:18.480161 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df1d7c-eae9-4d6f-bd85-4f30f808ba17 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:18.480811 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef2e11-d17d-4ccd-9df1-7d03c60e4da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:18.482715 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef2e11-d17d-4ccd-9df1-7d03c60e4da8 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:18.499742 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 36/67] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Oct 28 14:24:18 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:18.504772 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 32/68] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:18.508085 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df1d7c-eae9-4d6f-bd85-4f30f808ba17 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:18.510838 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef2e11-d17d-4ccd-9df1-7d03c60e4da8 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:18.518256 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df1d7c-eae9-4d6f-bd85-4f30f808ba17 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:18.523295 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef2e11-d17d-4ccd-9df1-7d03c60e4da8 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:18.530017 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef76b5-4a6e-44f1-bad6-c6f3e02255b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:18.531657 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef76b5-4a6e-44f1-bad6-c6f3e02255b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.532440 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23154ce-8997-4dc3-aa39-a456cd3ce3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:18.533535 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23154ce-8997-4dc3-aa39-a456cd3ce3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.534003 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef76b5-4a6e-44f1-bad6-c6f3e02255b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.534479 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23154ce-8997-4dc3-aa39-a456cd3ce3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.534973 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef76b5-4a6e-44f1-bad6-c6f3e02255b2 admin admin] PATH_INFO: `/v3/users/1ae941093e1c476bb4677c74721b18ab` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.535431 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23154ce-8997-4dc3-aa39-a456cd3ce3e2 admin admin] PATH_INFO: `/v3/users/04a56319092f4998a9d4cfc7569eb00c` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.537526 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23154ce-8997-4dc3-aa39-a456cd3ce3e2 admin admin] RBAC: Authorizing `identity:get_user(user_id=04a56319092f4998a9d4cfc7569eb00c)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:18.539401 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23154ce-8997-4dc3-aa39-a456cd3ce3e2 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:18.541272 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 33/69] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:24:18 2021] GET /identity/v3/users/04a56319092f4998a9d4cfc7569eb00c => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:18.542326 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716e921-9180-4403-8e6b-2b4da8097fa3 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.542608 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716e921-9180-4403-8e6b-2b4da8097fa3 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.543044 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716e921-9180-4403-8e6b-2b4da8097fa3 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.544683 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 34/70] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:18.546823 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716e921-9180-4403-8e6b-2b4da8097fa3 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:18.558624 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef76b5-4a6e-44f1-bad6-c6f3e02255b2 admin admin] RBAC: Authorizing `identity:get_user(user_id=1ae941093e1c476bb4677c74721b18ab)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:18.561132 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef76b5-4a6e-44f1-bad6-c6f3e02255b2 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:18.563351 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 37/71] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:24:18 2021] GET /identity/v3/users/1ae941093e1c476bb4677c74721b18ab => generated 275 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:18.569748 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f50b5-d228-4b53-9c13-208f96b88883 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.569874 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f50b5-d228-4b53-9c13-208f96b88883 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.570133 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f50b5-d228-4b53-9c13-208f96b88883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.571375 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716e921-9180-4403-8e6b-2b4da8097fa3 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:18.576275 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73a4ad-d015-44d5-b8ea-0f804e12fafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:18.577149 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73a4ad-d015-44d5-b8ea-0f804e12fafc admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.577634 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73a4ad-d015-44d5-b8ea-0f804e12fafc admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.578096 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73a4ad-d015-44d5-b8ea-0f804e12fafc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.586716 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73a4ad-d015-44d5-b8ea-0f804e12fafc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:18.588745 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73a4ad-d015-44d5-b8ea-0f804e12fafc admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:18.588848 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-098f50b5-d228-4b53-9c13-208f96b88883 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:18.590033 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-098f50b5-d228-4b53-9c13-208f96b88883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:18.599051 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 35/73] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:18 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:18.600232 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73a4ad-d015-44d5-b8ea-0f804e12fafc admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:18.602787 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 38/73] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:18.604884 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f50b5-d228-4b53-9c13-208f96b88883 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:18.610224 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73a4ad-d015-44d5-b8ea-0f804e12fafc admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:18.615664 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f50b5-d228-4b53-9c13-208f96b88883 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:18.623640 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ece1f1-63c8-49a1-a62b-eda4218c45b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:18.624524 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ece1f1-63c8-49a1-a62b-eda4218c45b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.624995 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ece1f1-63c8-49a1-a62b-eda4218c45b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.625493 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ece1f1-63c8-49a1-a62b-eda4218c45b4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.626160 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc21d3-54a4-48c0-832a-d3b723cd66a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:18.627070 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc21d3-54a4-48c0-832a-d3b723cd66a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.627353 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc21d3-54a4-48c0-832a-d3b723cd66a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.627634 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc21d3-54a4-48c0-832a-d3b723cd66a7 admin admin] PATH_INFO: `/v3/projects/c0fc8be7ace747daba1f61a78ad61736` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.628847 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc21d3-54a4-48c0-832a-d3b723cd66a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0fc8be7ace747daba1f61a78ad61736)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:18.630972 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc21d3-54a4-48c0-832a-d3b723cd66a7 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:18.632666 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 39/74] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:18 2021] GET /identity/v3/projects/c0fc8be7ace747daba1f61a78ad61736 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:18.634925 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36e7dc-90e0-4d18-b8b5-03e9490cc47b None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.635337 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36e7dc-90e0-4d18-b8b5-03e9490cc47b None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.635748 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36e7dc-90e0-4d18-b8b5-03e9490cc47b None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.636646 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ece1f1-63c8-49a1-a62b-eda4218c45b4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:18.637781 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 40/75] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:18.638554 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36e7dc-90e0-4d18-b8b5-03e9490cc47b None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:18.639334 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ece1f1-63c8-49a1-a62b-eda4218c45b4 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:18.649861 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 36/76] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:18 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:18.650923 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ece1f1-63c8-49a1-a62b-eda4218c45b4 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:18.651579 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36e7dc-90e0-4d18-b8b5-03e9490cc47b None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:18.659451 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa112ac1-6063-4778-a5ad-52f9769e759b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:18.660283 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa112ac1-6063-4778-a5ad-52f9769e759b admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.660567 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa112ac1-6063-4778-a5ad-52f9769e759b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.660842 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa112ac1-6063-4778-a5ad-52f9769e759b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.665434 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ece1f1-63c8-49a1-a62b-eda4218c45b4 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:18.670264 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155f03d-185f-4a23-ad9a-fa21f9a2716d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:18.670964 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155f03d-185f-4a23-ad9a-fa21f9a2716d admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.671247 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155f03d-185f-4a23-ad9a-fa21f9a2716d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.671524 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155f03d-185f-4a23-ad9a-fa21f9a2716d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.672442 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155f03d-185f-4a23-ad9a-fa21f9a2716d admin admin] RBAC: Adding query filter params (role.id=f7b8954a0fe64dc2b6146c7174498ddb, scope.project.id=c0fc8be7ace747daba1f61a78ad61736, user.id=04a56319092f4998a9d4cfc7569eb00c) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:18.672730 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155f03d-185f-4a23-ad9a-fa21f9a2716d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:18.673298 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa112ac1-6063-4778-a5ad-52f9769e759b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:18.673744 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING py.warnings [None req-3155f03d-185f-4a23-ad9a-fa21f9a2716d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:24:18.673744 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: warnings.warn(msg) Oct 28 14:24:18.673744 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: Oct 28 14:24:18.674949 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155f03d-185f-4a23-ad9a-fa21f9a2716d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:18.681066 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-fa112ac1-6063-4778-a5ad-52f9769e759b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 14:24:18.682382 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 41/77] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Oct 28 14:24:18 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:18.683878 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 37/78] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:24:18 2021] GET /identity/v3/role_assignments?user.id=04a56319092f4998a9d4cfc7569eb00c&scope.project.id=c0fc8be7ace747daba1f61a78ad61736&role.id=f7b8954a0fe64dc2b6146c7174498ddb => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:18.684921 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155f03d-185f-4a23-ad9a-fa21f9a2716d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:18.686949 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799036c-ec83-47e7-88c3-03d77bf23fb0 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.687478 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799036c-ec83-47e7-88c3-03d77bf23fb0 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.687873 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799036c-ec83-47e7-88c3-03d77bf23fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.701920 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155f03d-185f-4a23-ad9a-fa21f9a2716d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:18.706914 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73330c19-69cd-4007-bbe7-6210d0e9a797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:18.708507 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73330c19-69cd-4007-bbe7-6210d0e9a797 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.708789 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73330c19-69cd-4007-bbe7-6210d0e9a797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.709067 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73330c19-69cd-4007-bbe7-6210d0e9a797 admin admin] PATH_INFO: `/v3/projects/c0fc8be7ace747daba1f61a78ad61736` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.710753 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73330c19-69cd-4007-bbe7-6210d0e9a797 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0fc8be7ace747daba1f61a78ad61736)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:18.713076 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73330c19-69cd-4007-bbe7-6210d0e9a797 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:18.714091 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-2799036c-ec83-47e7-88c3-03d77bf23fb0 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:18.715736 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-2799036c-ec83-47e7-88c3-03d77bf23fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:18.720136 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 38/79] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:18 2021] GET /identity/v3/projects/c0fc8be7ace747daba1f61a78ad61736 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:18.721358 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73330c19-69cd-4007-bbe7-6210d0e9a797 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:18.727569 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 42/80] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:18.728384 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799036c-ec83-47e7-88c3-03d77bf23fb0 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:18.733079 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73330c19-69cd-4007-bbe7-6210d0e9a797 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:18.737974 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484f057-40e2-4190-b84c-632a5398875c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:18.738114 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799036c-ec83-47e7-88c3-03d77bf23fb0 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:18.739026 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484f057-40e2-4190-b84c-632a5398875c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.739499 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484f057-40e2-4190-b84c-632a5398875c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.740051 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484f057-40e2-4190-b84c-632a5398875c admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.741172 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484f057-40e2-4190-b84c-632a5398875c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:18.741668 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484f057-40e2-4190-b84c-632a5398875c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:18.742702 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc368214-574b-4ba4-a72d-ff432ceec13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:18.743371 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc368214-574b-4ba4-a72d-ff432ceec13a admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.743652 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc368214-574b-4ba4-a72d-ff432ceec13a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.743957 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc368214-574b-4ba4-a72d-ff432ceec13a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.744496 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484f057-40e2-4190-b84c-632a5398875c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:18.744871 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc368214-574b-4ba4-a72d-ff432ceec13a admin admin] RBAC: Adding query filter params (role.id=60f2c4ef9f6646108916900c5bce5845, scope.project.id=c0fc8be7ace747daba1f61a78ad61736, user.id=1ae941093e1c476bb4677c74721b18ab) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:18.745181 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc368214-574b-4ba4-a72d-ff432ceec13a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:18.747161 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc368214-574b-4ba4-a72d-ff432ceec13a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:18.754728 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 39/82] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:18 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:18.758814 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 43/82] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:24:18 2021] GET /identity/v3/role_assignments?user.id=1ae941093e1c476bb4677c74721b18ab&scope.project.id=c0fc8be7ace747daba1f61a78ad61736&role.id=60f2c4ef9f6646108916900c5bce5845 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:18.767907 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484f057-40e2-4190-b84c-632a5398875c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:18.769266 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc368214-574b-4ba4-a72d-ff432ceec13a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:18.788515 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484f057-40e2-4190-b84c-632a5398875c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:18.792470 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc368214-574b-4ba4-a72d-ff432ceec13a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:18.800467 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf702a96-b9d0-459b-bf55-56711edd8a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:18.802399 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da5d95-95dd-4a10-b1cd-79fca2658066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:18.803727 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf702a96-b9d0-459b-bf55-56711edd8a4e admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.804867 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da5d95-95dd-4a10-b1cd-79fca2658066 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.805393 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf702a96-b9d0-459b-bf55-56711edd8a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.805861 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf702a96-b9d0-459b-bf55-56711edd8a4e admin admin] PATH_INFO: `/v3/users/1ae941093e1c476bb4677c74721b18ab` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.807163 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da5d95-95dd-4a10-b1cd-79fca2658066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.807651 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da5d95-95dd-4a10-b1cd-79fca2658066 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.808809 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf702a96-b9d0-459b-bf55-56711edd8a4e admin admin] RBAC: Authorizing `identity:get_user(user_id=1ae941093e1c476bb4677c74721b18ab)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:18.813530 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf702a96-b9d0-459b-bf55-56711edd8a4e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:18.816492 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 40/83] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:24:18 2021] GET /identity/v3/users/1ae941093e1c476bb4677c74721b18ab => generated 275 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:18.821136 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff425d-6786-40b7-8850-555fa79ac1ca None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.821445 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff425d-6786-40b7-8850-555fa79ac1ca None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.821703 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff425d-6786-40b7-8850-555fa79ac1ca None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.824015 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 41/84] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 14:24:18.828758 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff425d-6786-40b7-8850-555fa79ac1ca None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:18.835789 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da5d95-95dd-4a10-b1cd-79fca2658066 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:18.843465 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-f1da5d95-95dd-4a10-b1cd-79fca2658066 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 14:24:18.844524 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff425d-6786-40b7-8850-555fa79ac1ca None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:18.845376 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 44/85] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:18 2021] GET /identity/v3/roles/member => generated 84 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:18.846973 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df80151-3f6d-48e0-8cfc-29ef33655e97 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.847498 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df80151-3f6d-48e0-8cfc-29ef33655e97 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.847997 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df80151-3f6d-48e0-8cfc-29ef33655e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.856634 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c71bf-9685-4b78-a4ab-7ec00323c0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:18.856634 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c71bf-9685-4b78-a4ab-7ec00323c0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.856634 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c71bf-9685-4b78-a4ab-7ec00323c0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.856634 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c71bf-9685-4b78-a4ab-7ec00323c0c0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.861251 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c71bf-9685-4b78-a4ab-7ec00323c0c0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:18.863142 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c71bf-9685-4b78-a4ab-7ec00323c0c0 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:18.871356 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-7df80151-3f6d-48e0-8cfc-29ef33655e97 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:18.872866 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-7df80151-3f6d-48e0-8cfc-29ef33655e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:18.874286 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 42/86] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:18 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:18.880975 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c71bf-9685-4b78-a4ab-7ec00323c0c0 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:18.886490 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c71bf-9685-4b78-a4ab-7ec00323c0c0 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:18.886783 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 45/87] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:18.891670 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df80151-3f6d-48e0-8cfc-29ef33655e97 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:18.900262 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f702427-0aef-4a94-b557-7f0c5a51f62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:18.900971 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f702427-0aef-4a94-b557-7f0c5a51f62a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.901300 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f702427-0aef-4a94-b557-7f0c5a51f62a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.902559 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f702427-0aef-4a94-b557-7f0c5a51f62a admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.904840 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f702427-0aef-4a94-b557-7f0c5a51f62a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:18.905074 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f702427-0aef-4a94-b557-7f0c5a51f62a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:18.910717 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f702427-0aef-4a94-b557-7f0c5a51f62a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:18.912681 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df80151-3f6d-48e0-8cfc-29ef33655e97 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:18.926341 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 43/88] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Oct 28 14:24:18 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:18.928223 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7ed57-86c8-43b8-8f77-f3c5d901842d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:18.929134 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7ed57-86c8-43b8-8f77-f3c5d901842d admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.929417 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7ed57-86c8-43b8-8f77-f3c5d901842d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.929690 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7ed57-86c8-43b8-8f77-f3c5d901842d admin admin] PATH_INFO: `/v3/projects/c0fc8be7ace747daba1f61a78ad61736` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.930948 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f702427-0aef-4a94-b557-7f0c5a51f62a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:18.932061 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7ed57-86c8-43b8-8f77-f3c5d901842d admin admin] RBAC: Authorizing `identity:get_project(project_id=c0fc8be7ace747daba1f61a78ad61736)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:18.934553 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7ed57-86c8-43b8-8f77-f3c5d901842d admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:18.937267 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 46/89] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:18 2021] GET /identity/v3/projects/c0fc8be7ace747daba1f61a78ad61736 => generated 298 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:18.938555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7ed57-86c8-43b8-8f77-f3c5d901842d admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:18.942133 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f702427-0aef-4a94-b557-7f0c5a51f62a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:18.948137 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290cba9-f7b9-4efd-9976-686598795309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:18.949030 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290cba9-f7b9-4efd-9976-686598795309 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.949314 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290cba9-f7b9-4efd-9976-686598795309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.949639 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290cba9-f7b9-4efd-9976-686598795309 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.950986 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290cba9-f7b9-4efd-9976-686598795309 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:18.951615 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7ed57-86c8-43b8-8f77-f3c5d901842d admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:18.953251 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290cba9-f7b9-4efd-9976-686598795309 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:18.955300 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 44/90] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:18.956018 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290cba9-f7b9-4efd-9976-686598795309 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:18.961832 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5237394-c727-4a53-938c-d70c35ab191c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:18.962847 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5237394-c727-4a53-938c-d70c35ab191c admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.963134 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5237394-c727-4a53-938c-d70c35ab191c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.963409 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5237394-c727-4a53-938c-d70c35ab191c admin admin] PATH_INFO: `/v3/users/1ae941093e1c476bb4677c74721b18ab` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.964801 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5237394-c727-4a53-938c-d70c35ab191c admin admin] RBAC: Authorizing `identity:get_user(user_id=1ae941093e1c476bb4677c74721b18ab)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:18.967824 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5237394-c727-4a53-938c-d70c35ab191c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:18.969570 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 47/91] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:24:18 2021] GET /identity/v3/users/1ae941093e1c476bb4677c74721b18ab => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:18.969913 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290cba9-f7b9-4efd-9976-686598795309 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:18.970322 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5237394-c727-4a53-938c-d70c35ab191c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:18.974749 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ef699-1270-4455-a4fe-7bf58ef41e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:18.975357 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ef699-1270-4455-a4fe-7bf58ef41e96 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.975691 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ef699-1270-4455-a4fe-7bf58ef41e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.976053 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ef699-1270-4455-a4fe-7bf58ef41e96 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.976912 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ef699-1270-4455-a4fe-7bf58ef41e96 admin admin] RBAC: Adding query filter params (role.id=08b906e1585f45668d988e46a5d2659a, scope.project.id=c0fc8be7ace747daba1f61a78ad61736, user.id=1ae941093e1c476bb4677c74721b18ab) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:18.977222 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ef699-1270-4455-a4fe-7bf58ef41e96 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:18.980822 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ef699-1270-4455-a4fe-7bf58ef41e96 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:18.980958 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5237394-c727-4a53-938c-d70c35ab191c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:18.984854 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c9bc8-039b-4d02-952a-622177e714c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:18.985538 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c9bc8-039b-4d02-952a-622177e714c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:18.985824 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c9bc8-039b-4d02-952a-622177e714c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:18.986244 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 45/92] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:24:18 2021] GET /identity/v3/role_assignments?user.id=1ae941093e1c476bb4677c74721b18ab&scope.project.id=c0fc8be7ace747daba1f61a78ad61736&role.id=08b906e1585f45668d988e46a5d2659a => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:18.986350 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c9bc8-039b-4d02-952a-622177e714c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:18.987048 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ef699-1270-4455-a4fe-7bf58ef41e96 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:18.988968 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c9bc8-039b-4d02-952a-622177e714c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:18.991012 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c9bc8-039b-4d02-952a-622177e714c1 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:18.998380 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ef699-1270-4455-a4fe-7bf58ef41e96 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:19.003154 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24b609-d545-490b-8bd1-d17b35ba7545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:19.003881 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24b609-d545-490b-8bd1-d17b35ba7545 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:19.004128 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24b609-d545-490b-8bd1-d17b35ba7545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:19.004405 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24b609-d545-490b-8bd1-d17b35ba7545 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:19.013634 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24b609-d545-490b-8bd1-d17b35ba7545 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:19.015531 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24b609-d545-490b-8bd1-d17b35ba7545 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:19.024451 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 48/93] 10.222.0.79 () {60 vars in 1162 bytes} [Thu Oct 28 14:24:18 2021] POST /identity/v3/projects => generated 302 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:24:19.026270 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 46/94] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:18 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:19.033804 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c9bc8-039b-4d02-952a-622177e714c1 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:19.123994 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c9bc8-039b-4d02-952a-622177e714c1 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:19.134962 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d993a6c-1bbf-437d-9299-4b0296922b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:19.136127 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d993a6c-1bbf-437d-9299-4b0296922b69 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:19.136593 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d993a6c-1bbf-437d-9299-4b0296922b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:19.137013 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d993a6c-1bbf-437d-9299-4b0296922b69 admin admin] PATH_INFO: `/v3/projects/5e1386d4324444cb827c395a1115a38e` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:19.142034 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d993a6c-1bbf-437d-9299-4b0296922b69 admin admin] RBAC: Authorizing `identity:get_project(project_id=5e1386d4324444cb827c395a1115a38e)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:19.144571 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d993a6c-1bbf-437d-9299-4b0296922b69 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:19.147099 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 49/95] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:19 2021] GET /identity/v3/projects/5e1386d4324444cb827c395a1115a38e => generated 312 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:19.153971 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24b609-d545-490b-8bd1-d17b35ba7545 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:19.168826 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24b609-d545-490b-8bd1-d17b35ba7545 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:19.182898 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7b43c-dc36-4fb0-9e34-dfd8763bb5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:19.183690 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7b43c-dc36-4fb0-9e34-dfd8763bb5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:19.184037 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7b43c-dc36-4fb0-9e34-dfd8763bb5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:19.184315 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7b43c-dc36-4fb0-9e34-dfd8763bb5e2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:19.185245 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7b43c-dc36-4fb0-9e34-dfd8763bb5e2 admin admin] RBAC: Adding query filter params (role.id=60f2c4ef9f6646108916900c5bce5845, scope.project.id=5e1386d4324444cb827c395a1115a38e, user.id=1ae941093e1c476bb4677c74721b18ab) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:19.185556 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7b43c-dc36-4fb0-9e34-dfd8763bb5e2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:19.187567 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7b43c-dc36-4fb0-9e34-dfd8763bb5e2 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:19.194299 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 47/96] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:24:19 2021] GET /identity/v3/role_assignments?user.id=1ae941093e1c476bb4677c74721b18ab&scope.project.id=5e1386d4324444cb827c395a1115a38e&role.id=60f2c4ef9f6646108916900c5bce5845 => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:21.539293 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257161f0-c582-4239-89c3-fb3b86ed6757 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:21.540381 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257161f0-c582-4239-89c3-fb3b86ed6757 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:21.540935 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257161f0-c582-4239-89c3-fb3b86ed6757 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:21.543218 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 50/97] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:21 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:21.549589 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a824d3-e9e6-4669-96a3-8cbfe92ee502 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:21.550451 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a824d3-e9e6-4669-96a3-8cbfe92ee502 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:21.550976 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a824d3-e9e6-4669-96a3-8cbfe92ee502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:21.564259 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464686a-86dd-4aca-9ecd-4a3b53c6da66 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:21.564895 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464686a-86dd-4aca-9ecd-4a3b53c6da66 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:21.565377 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464686a-86dd-4aca-9ecd-4a3b53c6da66 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:21.567393 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 51/98] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:21 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 14:24:21.573715 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64d411-96a8-463c-9a60-7f727580a307 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:21.574262 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64d411-96a8-463c-9a60-7f727580a307 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:21.574787 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64d411-96a8-463c-9a60-7f727580a307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:21.575733 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-a2a824d3-e9e6-4669-96a3-8cbfe92ee502 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:21.576957 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a2a824d3-e9e6-4669-96a3-8cbfe92ee502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:21.585652 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 48/99] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:21.607715 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-4b64d411-96a8-463c-9a60-7f727580a307 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:21.608911 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-4b64d411-96a8-463c-9a60-7f727580a307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:21.610860 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a824d3-e9e6-4669-96a3-8cbfe92ee502 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:21.616690 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 52/100] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:24:21.621025 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a824d3-e9e6-4669-96a3-8cbfe92ee502 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:21.630243 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66096558-c06c-4aeb-8f9d-8c33b563f12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:21.631087 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66096558-c06c-4aeb-8f9d-8c33b563f12d admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:21.631374 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66096558-c06c-4aeb-8f9d-8c33b563f12d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:21.631653 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66096558-c06c-4aeb-8f9d-8c33b563f12d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:21.640625 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64d411-96a8-463c-9a60-7f727580a307 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:21.649525 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66096558-c06c-4aeb-8f9d-8c33b563f12d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:21.649936 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64d411-96a8-463c-9a60-7f727580a307 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:21.654745 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bce42-3d43-4817-92c9-4defcbb5ebf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:21.655557 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bce42-3d43-4817-92c9-4defcbb5ebf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:21.655834 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bce42-3d43-4817-92c9-4defcbb5ebf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:21.656106 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bce42-3d43-4817-92c9-4defcbb5ebf7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:21.661493 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-66096558-c06c-4aeb-8f9d-8c33b563f12d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 14:24:21.662777 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 49/101] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:21 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:21.674706 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66096558-c06c-4aeb-8f9d-8c33b563f12d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:21.687401 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63bce42-3d43-4817-92c9-4defcbb5ebf7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:21.694143 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-b63bce42-3d43-4817-92c9-4defcbb5ebf7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:24:21.695412 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 53/102] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:24:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:21.697651 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66096558-c06c-4aeb-8f9d-8c33b563f12d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:21.707991 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bce42-3d43-4817-92c9-4defcbb5ebf7 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:21.709977 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71c250-7519-405d-9b68-a8aa7c88268e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:21.710744 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71c250-7519-405d-9b68-a8aa7c88268e admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:21.711012 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71c250-7519-405d-9b68-a8aa7c88268e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:21.711289 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71c250-7519-405d-9b68-a8aa7c88268e admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:21.712073 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71c250-7519-405d-9b68-a8aa7c88268e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:21.712378 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71c250-7519-405d-9b68-a8aa7c88268e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:21.714102 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71c250-7519-405d-9b68-a8aa7c88268e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:21.724621 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 50/103] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Oct 28 14:24:21 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:21.731689 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71c250-7519-405d-9b68-a8aa7c88268e admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:21.733105 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bce42-3d43-4817-92c9-4defcbb5ebf7 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:21.742789 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71c250-7519-405d-9b68-a8aa7c88268e admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:21.747219 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab066576-577d-47e3-b9e9-248bef22a4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:21.748692 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab066576-577d-47e3-b9e9-248bef22a4ae admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:21.749588 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab066576-577d-47e3-b9e9-248bef22a4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:21.750338 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab066576-577d-47e3-b9e9-248bef22a4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:21.751856 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab066576-577d-47e3-b9e9-248bef22a4ae admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:21.752648 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39594107-253e-4dba-94a4-190da91653a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:21.753728 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39594107-253e-4dba-94a4-190da91653a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:21.754259 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab066576-577d-47e3-b9e9-248bef22a4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:21.756163 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab066576-577d-47e3-b9e9-248bef22a4ae admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:21.756738 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39594107-253e-4dba-94a4-190da91653a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:21.757162 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39594107-253e-4dba-94a4-190da91653a4 admin admin] PATH_INFO: `/v3/users/1ae941093e1c476bb4677c74721b18ab` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:21.760547 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39594107-253e-4dba-94a4-190da91653a4 admin admin] RBAC: Authorizing `identity:get_user(user_id=1ae941093e1c476bb4677c74721b18ab)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:21.763073 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39594107-253e-4dba-94a4-190da91653a4 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:21.765827 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 51/104] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:24:21 2021] GET /identity/v3/users/1ae941093e1c476bb4677c74721b18ab => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:21.772880 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 54/105] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:21.774250 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39594107-253e-4dba-94a4-190da91653a4 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:21.784165 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39594107-253e-4dba-94a4-190da91653a4 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:21.789780 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab066576-577d-47e3-b9e9-248bef22a4ae admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:21.795050 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb4c02-7169-43c8-a13b-9480988a49b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:21.797117 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb4c02-7169-43c8-a13b-9480988a49b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:21.798546 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb4c02-7169-43c8-a13b-9480988a49b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:21.799154 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb4c02-7169-43c8-a13b-9480988a49b6 admin admin] PATH_INFO: `/v3/projects/c0fc8be7ace747daba1f61a78ad61736` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:21.801185 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab066576-577d-47e3-b9e9-248bef22a4ae admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:21.803849 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb4c02-7169-43c8-a13b-9480988a49b6 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0fc8be7ace747daba1f61a78ad61736)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:21.806474 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb4c02-7169-43c8-a13b-9480988a49b6 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:21.810420 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 52/106] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:21 2021] GET /identity/v3/projects/c0fc8be7ace747daba1f61a78ad61736 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:21.812016 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec58ea1-35c3-4759-9894-ba061e3da728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:21.813069 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec58ea1-35c3-4759-9894-ba061e3da728 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:21.813495 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec58ea1-35c3-4759-9894-ba061e3da728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:21.813909 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec58ea1-35c3-4759-9894-ba061e3da728 admin admin] PATH_INFO: `/v3/users/04a56319092f4998a9d4cfc7569eb00c` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:21.815297 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec58ea1-35c3-4759-9894-ba061e3da728 admin admin] RBAC: Authorizing `identity:get_user(user_id=04a56319092f4998a9d4cfc7569eb00c)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:21.816238 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb4c02-7169-43c8-a13b-9480988a49b6 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:21.818543 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec58ea1-35c3-4759-9894-ba061e3da728 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:21.820740 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 55/107] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:24:21 2021] GET /identity/v3/users/04a56319092f4998a9d4cfc7569eb00c => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:21.828015 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec58ea1-35c3-4759-9894-ba061e3da728 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:21.836499 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb4c02-7169-43c8-a13b-9480988a49b6 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:21.843212 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec58ea1-35c3-4759-9894-ba061e3da728 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:21.847033 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfefa90-740c-4a6b-83b8-e0c59349c41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:21.848119 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfefa90-740c-4a6b-83b8-e0c59349c41f admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:21.848546 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfefa90-740c-4a6b-83b8-e0c59349c41f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:21.849049 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfefa90-740c-4a6b-83b8-e0c59349c41f admin admin] PATH_INFO: `/v3/projects/c0fc8be7ace747daba1f61a78ad61736/users/1ae941093e1c476bb4677c74721b18ab/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:21.851956 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfefa90-740c-4a6b-83b8-e0c59349c41f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0fc8be7ace747daba1f61a78ad61736, user_id=1ae941093e1c476bb4677c74721b18ab, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:21.853595 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING py.warnings [None req-2cfefa90-740c-4a6b-83b8-e0c59349c41f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:24:21.853595 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: warnings.warn(msg) Oct 28 14:24:21.853595 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: Oct 28 14:24:21.856832 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfefa90-740c-4a6b-83b8-e0c59349c41f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:21.857570 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5dcc3-d480-4a40-ac1d-6af38b07f327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:21.858639 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5dcc3-d480-4a40-ac1d-6af38b07f327 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:21.859071 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5dcc3-d480-4a40-ac1d-6af38b07f327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:21.859491 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5dcc3-d480-4a40-ac1d-6af38b07f327 admin admin] PATH_INFO: `/v3/projects/c0fc8be7ace747daba1f61a78ad61736` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:21.863328 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5dcc3-d480-4a40-ac1d-6af38b07f327 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0fc8be7ace747daba1f61a78ad61736)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:21.865552 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5dcc3-d480-4a40-ac1d-6af38b07f327 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:21.868494 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 56/108] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:21 2021] GET /identity/v3/projects/c0fc8be7ace747daba1f61a78ad61736 => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:21.875161 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5dcc3-d480-4a40-ac1d-6af38b07f327 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:21.884091 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 53/109] 10.222.0.79 () {58 vars in 1460 bytes} [Thu Oct 28 14:24:21 2021] PUT /identity/v3/projects/c0fc8be7ace747daba1f61a78ad61736/users/1ae941093e1c476bb4677c74721b18ab/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:24:21.885657 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb53548-834d-49b4-9d00-df2a4a30e844 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:21.886015 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb53548-834d-49b4-9d00-df2a4a30e844 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:21.886364 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb53548-834d-49b4-9d00-df2a4a30e844 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:21.890723 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 54/110] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:21.890723 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f03dd2-5a3d-4e41-b2e7-3cffd430b95c None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:21.890723 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f03dd2-5a3d-4e41-b2e7-3cffd430b95c None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:21.890723 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f03dd2-5a3d-4e41-b2e7-3cffd430b95c None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:21.891894 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 55/111] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:21.895627 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5dcc3-d480-4a40-ac1d-6af38b07f327 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:21.903187 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e8f9d-1959-43be-807e-7940f209640d None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:21.903624 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e8f9d-1959-43be-807e-7940f209640d None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:21.904000 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e8f9d-1959-43be-807e-7940f209640d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:21.924291 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-707e8f9d-1959-43be-807e-7940f209640d None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:21.925845 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-707e8f9d-1959-43be-807e-7940f209640d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:21.965666 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41344178-eacc-4b9d-8020-15fbbbc76a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:21.966929 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41344178-eacc-4b9d-8020-15fbbbc76a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:21.967422 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41344178-eacc-4b9d-8020-15fbbbc76a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:21.967876 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41344178-eacc-4b9d-8020-15fbbbc76a7d admin admin] PATH_INFO: `/v3/projects/c0fc8be7ace747daba1f61a78ad61736/users/04a56319092f4998a9d4cfc7569eb00c/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:21.970248 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41344178-eacc-4b9d-8020-15fbbbc76a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0fc8be7ace747daba1f61a78ad61736, user_id=04a56319092f4998a9d4cfc7569eb00c, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:21.973333 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41344178-eacc-4b9d-8020-15fbbbc76a7d admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:21.990032 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 57/112] 10.222.0.79 () {58 vars in 1460 bytes} [Thu Oct 28 14:24:21 2021] PUT /identity/v3/projects/c0fc8be7ace747daba1f61a78ad61736/users/04a56319092f4998a9d4cfc7569eb00c/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:24:21.992116 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a97431-fa96-4da3-877a-bcf487fc7d8b None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:21.992668 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a97431-fa96-4da3-877a-bcf487fc7d8b None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:21.993219 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a97431-fa96-4da3-877a-bcf487fc7d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:22.006485 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 56/113] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 28 14:24:22.015989 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-35a97431-fa96-4da3-877a-bcf487fc7d8b None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:22.017672 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-35a97431-fa96-4da3-877a-bcf487fc7d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:22.031840 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e8f9d-1959-43be-807e-7940f209640d None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:22.042247 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e8f9d-1959-43be-807e-7940f209640d None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:22.089818 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 58/114] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:22.103548 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e041d-6082-4443-bb05-a50899f5ece9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:22.104416 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e041d-6082-4443-bb05-a50899f5ece9 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:22.104702 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e041d-6082-4443-bb05-a50899f5ece9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:22.104978 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e041d-6082-4443-bb05-a50899f5ece9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:22.117930 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e041d-6082-4443-bb05-a50899f5ece9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:22.125473 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-3f9e041d-6082-4443-bb05-a50899f5ece9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 14:24:22.126986 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 57/115] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Oct 28 14:24:22 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:22.132318 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a97431-fa96-4da3-877a-bcf487fc7d8b None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:22.133277 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e041d-6082-4443-bb05-a50899f5ece9 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:22.143620 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e041d-6082-4443-bb05-a50899f5ece9 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:22.145351 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a97431-fa96-4da3-877a-bcf487fc7d8b None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:22.148279 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481c975-1b75-4117-974c-29a9deff5c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:22.148999 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481c975-1b75-4117-974c-29a9deff5c81 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:22.149280 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481c975-1b75-4117-974c-29a9deff5c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:22.149556 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481c975-1b75-4117-974c-29a9deff5c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:22.150440 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481c975-1b75-4117-974c-29a9deff5c81 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:22.150763 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481c975-1b75-4117-974c-29a9deff5c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:22.152440 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481c975-1b75-4117-974c-29a9deff5c81 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:22.154147 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0186e0-3b2d-4dfe-8484-72832e4a223c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:22.155789 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0186e0-3b2d-4dfe-8484-72832e4a223c admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:22.156494 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0186e0-3b2d-4dfe-8484-72832e4a223c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:22.157193 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0186e0-3b2d-4dfe-8484-72832e4a223c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:22.159280 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0186e0-3b2d-4dfe-8484-72832e4a223c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:22.161336 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0186e0-3b2d-4dfe-8484-72832e4a223c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:22.162213 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 58/116] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:22 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:22.163572 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 59/117] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:22 2021] GET /identity/v3/domains/default => generated 199 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:22.174753 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481c975-1b75-4117-974c-29a9deff5c81 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:22.176154 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0186e0-3b2d-4dfe-8484-72832e4a223c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:22.179791 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481c975-1b75-4117-974c-29a9deff5c81 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:22.187653 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0186e0-3b2d-4dfe-8484-72832e4a223c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:22.187968 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1af3f-c479-412f-8110-75eca2a016c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:22.188883 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1af3f-c479-412f-8110-75eca2a016c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:22.189168 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1af3f-c479-412f-8110-75eca2a016c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:22.189450 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1af3f-c479-412f-8110-75eca2a016c1 admin admin] PATH_INFO: `/v3/users/1ae941093e1c476bb4677c74721b18ab` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:22.190722 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1af3f-c479-412f-8110-75eca2a016c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=1ae941093e1c476bb4677c74721b18ab)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:22.192857 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09f58e-b5ce-4cb7-8f10-12300df166e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:22.193031 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1af3f-c479-412f-8110-75eca2a016c1 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:22.193779 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09f58e-b5ce-4cb7-8f10-12300df166e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:22.194157 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09f58e-b5ce-4cb7-8f10-12300df166e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:22.194959 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09f58e-b5ce-4cb7-8f10-12300df166e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:22.195061 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 59/118] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:24:22 2021] GET /identity/v3/users/1ae941093e1c476bb4677c74721b18ab => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:22.195508 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09f58e-b5ce-4cb7-8f10-12300df166e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:22.195904 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da2d9f-ddc8-4464-80b7-3b0bafec612d None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:22.196185 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da2d9f-ddc8-4464-80b7-3b0bafec612d None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:22.196455 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da2d9f-ddc8-4464-80b7-3b0bafec612d None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:22.197798 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09f58e-b5ce-4cb7-8f10-12300df166e2 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:22.198126 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 60/119] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:22.204457 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da2d9f-ddc8-4464-80b7-3b0bafec612d None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:22.217201 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da2d9f-ddc8-4464-80b7-3b0bafec612d None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:22.222309 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01662c21-9b21-475b-b5b7-a78a6cb4e4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:22.223290 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01662c21-9b21-475b-b5b7-a78a6cb4e4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:22.223576 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01662c21-9b21-475b-b5b7-a78a6cb4e4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:22.223849 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01662c21-9b21-475b-b5b7-a78a6cb4e4c2 admin admin] PATH_INFO: `/v3/projects/c0fc8be7ace747daba1f61a78ad61736` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:22.224397 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 60/120] 10.222.0.79 () {60 vars in 1153 bytes} [Thu Oct 28 14:24:22 2021] POST /identity/v3/users => generated 283 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:24:22.225145 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01662c21-9b21-475b-b5b7-a78a6cb4e4c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0fc8be7ace747daba1f61a78ad61736)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:22.225901 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a536ad0-b682-40ff-b29d-61f465b87e9c None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:22.226301 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a536ad0-b682-40ff-b29d-61f465b87e9c None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:22.226665 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a536ad0-b682-40ff-b29d-61f465b87e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:22.227377 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01662c21-9b21-475b-b5b7-a78a6cb4e4c2 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:22.229214 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 61/121] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:22 2021] GET /identity/v3/projects/c0fc8be7ace747daba1f61a78ad61736 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:22.235733 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01662c21-9b21-475b-b5b7-a78a6cb4e4c2 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:22.254143 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-1a536ad0-b682-40ff-b29d-61f465b87e9c None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:22.254706 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01662c21-9b21-475b-b5b7-a78a6cb4e4c2 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:22.255603 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-1a536ad0-b682-40ff-b29d-61f465b87e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:22.264500 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 61/122] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:22.264978 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba66411-b691-45b9-a4d3-9a2f1d5b61d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:22.266005 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba66411-b691-45b9-a4d3-9a2f1d5b61d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:22.266288 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba66411-b691-45b9-a4d3-9a2f1d5b61d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:22.266561 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba66411-b691-45b9-a4d3-9a2f1d5b61d0 admin admin] PATH_INFO: `/v3/projects/c0fc8be7ace747daba1f61a78ad61736/users/1ae941093e1c476bb4677c74721b18ab/roles/08b906e1585f45668d988e46a5d2659a` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:22.274531 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba66411-b691-45b9-a4d3-9a2f1d5b61d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0fc8be7ace747daba1f61a78ad61736, user_id=1ae941093e1c476bb4677c74721b18ab, role_id=08b906e1585f45668d988e46a5d2659a)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:22.277429 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba66411-b691-45b9-a4d3-9a2f1d5b61d0 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:22.290135 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a536ad0-b682-40ff-b29d-61f465b87e9c None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:22.302167 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a536ad0-b682-40ff-b29d-61f465b87e9c None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:22.314468 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 62/123] 10.222.0.79 () {58 vars in 1460 bytes} [Thu Oct 28 14:24:22 2021] PUT /identity/v3/projects/c0fc8be7ace747daba1f61a78ad61736/users/1ae941093e1c476bb4677c74721b18ab/roles/08b906e1585f45668d988e46a5d2659a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:24:22.417619 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9d35d-ac11-4405-b702-e59ebe92e38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:22.418458 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9d35d-ac11-4405-b702-e59ebe92e38e admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:22.418764 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9d35d-ac11-4405-b702-e59ebe92e38e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:22.419039 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9d35d-ac11-4405-b702-e59ebe92e38e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:22.434657 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9d35d-ac11-4405-b702-e59ebe92e38e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:22.441907 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-5cc9d35d-ac11-4405-b702-e59ebe92e38e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 14:24:22.443651 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 62/124] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:22 2021] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:22.451885 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba66411-b691-45b9-a4d3-9a2f1d5b61d0 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:22.477466 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba66411-b691-45b9-a4d3-9a2f1d5b61d0 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:22.492002 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141faf4-8544-433a-97be-59f14786f9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:22.493052 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141faf4-8544-433a-97be-59f14786f9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:22.493470 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141faf4-8544-433a-97be-59f14786f9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:22.493946 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141faf4-8544-433a-97be-59f14786f9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:22.494966 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141faf4-8544-433a-97be-59f14786f9d9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:22.495429 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141faf4-8544-433a-97be-59f14786f9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:22.497472 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141faf4-8544-433a-97be-59f14786f9d9 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:22.507970 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 63/125] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Oct 28 14:24:22 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:22.514794 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9d35d-ac11-4405-b702-e59ebe92e38e admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:22.525609 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9d35d-ac11-4405-b702-e59ebe92e38e admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:22.531626 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea70d1-eab1-4b56-8c1d-34dffe0c9ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:22.532778 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea70d1-eab1-4b56-8c1d-34dffe0c9ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:22.533233 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea70d1-eab1-4b56-8c1d-34dffe0c9ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:22.533707 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea70d1-eab1-4b56-8c1d-34dffe0c9ac6 admin admin] PATH_INFO: `/v3/users/1ae941093e1c476bb4677c74721b18ab` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:22.535197 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea70d1-eab1-4b56-8c1d-34dffe0c9ac6 admin admin] RBAC: Authorizing `identity:get_user(user_id=1ae941093e1c476bb4677c74721b18ab)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:22.537729 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea70d1-eab1-4b56-8c1d-34dffe0c9ac6 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:22.539696 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 63/126] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:24:22 2021] GET /identity/v3/users/1ae941093e1c476bb4677c74721b18ab => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:22.546326 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141faf4-8544-433a-97be-59f14786f9d9 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:22.558912 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141faf4-8544-433a-97be-59f14786f9d9 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:22.565392 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947583fa-98b7-4dac-b247-4fd77feb7056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:22.566623 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947583fa-98b7-4dac-b247-4fd77feb7056 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:22.567111 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947583fa-98b7-4dac-b247-4fd77feb7056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:22.567526 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947583fa-98b7-4dac-b247-4fd77feb7056 admin admin] PATH_INFO: `/v3/projects/5e1386d4324444cb827c395a1115a38e` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:22.568979 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947583fa-98b7-4dac-b247-4fd77feb7056 admin admin] RBAC: Authorizing `identity:get_project(project_id=5e1386d4324444cb827c395a1115a38e)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:22.571485 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947583fa-98b7-4dac-b247-4fd77feb7056 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:22.573927 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 64/127] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:22 2021] GET /identity/v3/projects/5e1386d4324444cb827c395a1115a38e => generated 312 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:22.580079 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea70d1-eab1-4b56-8c1d-34dffe0c9ac6 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:22.591111 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea70d1-eab1-4b56-8c1d-34dffe0c9ac6 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:22.595562 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c305de-ca0b-4f69-a4c6-090cb908584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:22.596453 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c305de-ca0b-4f69-a4c6-090cb908584c admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:22.596725 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c305de-ca0b-4f69-a4c6-090cb908584c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:22.597000 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c305de-ca0b-4f69-a4c6-090cb908584c admin admin] PATH_INFO: `/v3/projects/5e1386d4324444cb827c395a1115a38e/users/1ae941093e1c476bb4677c74721b18ab/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:22.599083 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c305de-ca0b-4f69-a4c6-090cb908584c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e1386d4324444cb827c395a1115a38e, user_id=1ae941093e1c476bb4677c74721b18ab, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:22.601751 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c305de-ca0b-4f69-a4c6-090cb908584c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:22.618846 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 64/128] 10.222.0.79 () {58 vars in 1460 bytes} [Thu Oct 28 14:24:22 2021] PUT /identity/v3/projects/5e1386d4324444cb827c395a1115a38e/users/1ae941093e1c476bb4677c74721b18ab/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:24:24.607593 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0996bd-031a-4b34-8025-95f4b301cb20 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:24.608122 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0996bd-031a-4b34-8025-95f4b301cb20 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:24.608122 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0996bd-031a-4b34-8025-95f4b301cb20 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:24.609910 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 65/129] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:24.616100 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48579d64-ba8f-4e1e-8499-052150276f1f None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:24.616510 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48579d64-ba8f-4e1e-8499-052150276f1f None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:24.616648 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48579d64-ba8f-4e1e-8499-052150276f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:24.638808 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-48579d64-ba8f-4e1e-8499-052150276f1f None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:24.640005 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-48579d64-ba8f-4e1e-8499-052150276f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:24.716752 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 65/130] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:24:24.772130 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0996bd-031a-4b34-8025-95f4b301cb20 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:24.793284 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0996bd-031a-4b34-8025-95f4b301cb20 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:24.798037 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e912cd-ac67-459b-b7e0-f7d438699f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:24.798874 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e912cd-ac67-459b-b7e0-f7d438699f89 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:24.799154 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e912cd-ac67-459b-b7e0-f7d438699f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:24.799428 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e912cd-ac67-459b-b7e0-f7d438699f89 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:24.816175 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e912cd-ac67-459b-b7e0-f7d438699f89 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:24.823105 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-17e912cd-ac67-459b-b7e0-f7d438699f89 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 14:24:24.824325 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 66/131] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:24 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:24.831118 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48579d64-ba8f-4e1e-8499-052150276f1f None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:24.840408 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48579d64-ba8f-4e1e-8499-052150276f1f None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:24.848556 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac47887-3fcc-4be4-bd4a-c1bbed0ef3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:24.849238 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac47887-3fcc-4be4-bd4a-c1bbed0ef3ba admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:24.849515 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac47887-3fcc-4be4-bd4a-c1bbed0ef3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:24.849784 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac47887-3fcc-4be4-bd4a-c1bbed0ef3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:24.850564 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac47887-3fcc-4be4-bd4a-c1bbed0ef3ba admin admin] RBAC: Adding query filter params (name=member) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:24.850895 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac47887-3fcc-4be4-bd4a-c1bbed0ef3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:24.852514 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac47887-3fcc-4be4-bd4a-c1bbed0ef3ba admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:24.866374 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 66/132] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Oct 28 14:24:24 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:24.872441 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e912cd-ac67-459b-b7e0-f7d438699f89 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:24.882647 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e912cd-ac67-459b-b7e0-f7d438699f89 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:24.889088 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433be4d-17a5-47b1-ae22-0afe9ea2b763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:24.889972 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433be4d-17a5-47b1-ae22-0afe9ea2b763 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:24.890255 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433be4d-17a5-47b1-ae22-0afe9ea2b763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:24.890525 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433be4d-17a5-47b1-ae22-0afe9ea2b763 admin admin] PATH_INFO: `/v3/users/1ae941093e1c476bb4677c74721b18ab` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:24.891775 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433be4d-17a5-47b1-ae22-0afe9ea2b763 admin admin] RBAC: Authorizing `identity:get_user(user_id=1ae941093e1c476bb4677c74721b18ab)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:24.893977 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433be4d-17a5-47b1-ae22-0afe9ea2b763 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:24.895617 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 67/133] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:24:24 2021] GET /identity/v3/users/1ae941093e1c476bb4677c74721b18ab => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:24.908022 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac47887-3fcc-4be4-bd4a-c1bbed0ef3ba admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:24.919842 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac47887-3fcc-4be4-bd4a-c1bbed0ef3ba admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:24.927230 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831392fb-16a4-403b-8979-704470a338dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:24.927891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831392fb-16a4-403b-8979-704470a338dc admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:24.928168 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831392fb-16a4-403b-8979-704470a338dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:24.928438 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831392fb-16a4-403b-8979-704470a338dc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:24.942525 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831392fb-16a4-403b-8979-704470a338dc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:24.944345 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831392fb-16a4-403b-8979-704470a338dc admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:24.954523 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 67/134] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:24.960639 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433be4d-17a5-47b1-ae22-0afe9ea2b763 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:24.970716 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433be4d-17a5-47b1-ae22-0afe9ea2b763 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:24.978740 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b210fad-f35a-4d25-9182-261a97ee83f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:24.979607 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b210fad-f35a-4d25-9182-261a97ee83f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:24.979886 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b210fad-f35a-4d25-9182-261a97ee83f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:24.980273 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b210fad-f35a-4d25-9182-261a97ee83f7 admin admin] PATH_INFO: `/v3/projects/c0fc8be7ace747daba1f61a78ad61736` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:24.981539 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b210fad-f35a-4d25-9182-261a97ee83f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0fc8be7ace747daba1f61a78ad61736)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:24.983638 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b210fad-f35a-4d25-9182-261a97ee83f7 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:24.985502 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 68/135] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:24 2021] GET /identity/v3/projects/c0fc8be7ace747daba1f61a78ad61736 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:24.991745 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831392fb-16a4-403b-8979-704470a338dc admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:25.002224 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831392fb-16a4-403b-8979-704470a338dc admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:25.011367 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00b329-f996-4320-bf14-13cad324134a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:25.012098 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00b329-f996-4320-bf14-13cad324134a admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:25.012381 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00b329-f996-4320-bf14-13cad324134a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:25.012654 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00b329-f996-4320-bf14-13cad324134a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:25.013511 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00b329-f996-4320-bf14-13cad324134a admin admin] RBAC: Adding query filter params (role.id=60f2c4ef9f6646108916900c5bce5845, scope.project.id=c0fc8be7ace747daba1f61a78ad61736, user.id=1ae941093e1c476bb4677c74721b18ab) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:25.013820 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00b329-f996-4320-bf14-13cad324134a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:25.015720 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00b329-f996-4320-bf14-13cad324134a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:25.022239 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 68/136] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:24:24 2021] GET /identity/v3/role_assignments?user.id=1ae941093e1c476bb4677c74721b18ab&scope.project.id=c0fc8be7ace747daba1f61a78ad61736&role.id=60f2c4ef9f6646108916900c5bce5845 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:25.991488 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c1193-06c9-48c8-82b7-da7b81bcb311 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:25.992034 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c1193-06c9-48c8-82b7-da7b81bcb311 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:25.992034 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c1193-06c9-48c8-82b7-da7b81bcb311 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:25.994090 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 69/137] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:26.001262 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36800c0-5264-4e53-aec8-d931dd503505 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.001742 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36800c0-5264-4e53-aec8-d931dd503505 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.001817 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36800c0-5264-4e53-aec8-d931dd503505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.021292 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-f36800c0-5264-4e53-aec8-d931dd503505 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:26.022477 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-f36800c0-5264-4e53-aec8-d931dd503505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:26.037529 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 69/138] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:24:26.078342 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c1193-06c9-48c8-82b7-da7b81bcb311 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:26.092354 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c1193-06c9-48c8-82b7-da7b81bcb311 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:26.099262 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa0a09-df3a-4461-b18b-dc4a19a9e61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:26.100083 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa0a09-df3a-4461-b18b-dc4a19a9e61e admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.100359 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa0a09-df3a-4461-b18b-dc4a19a9e61e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.100637 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa0a09-df3a-4461-b18b-dc4a19a9e61e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.114586 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa0a09-df3a-4461-b18b-dc4a19a9e61e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:26.121541 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-9ffa0a09-df3a-4461-b18b-dc4a19a9e61e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:24:26.122813 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 70/139] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:24:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:26.129409 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36800c0-5264-4e53-aec8-d931dd503505 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:26.143182 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36800c0-5264-4e53-aec8-d931dd503505 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:26.152594 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094308f-9939-423f-8c73-c2c2c3ac63d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:26.153308 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094308f-9939-423f-8c73-c2c2c3ac63d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.153644 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094308f-9939-423f-8c73-c2c2c3ac63d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.153861 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094308f-9939-423f-8c73-c2c2c3ac63d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.154646 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094308f-9939-423f-8c73-c2c2c3ac63d0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:26.154975 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094308f-9939-423f-8c73-c2c2c3ac63d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:26.156618 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094308f-9939-423f-8c73-c2c2c3ac63d0 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:26.166243 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 70/140] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:26.176155 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa0a09-df3a-4461-b18b-dc4a19a9e61e admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:26.196217 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa0a09-df3a-4461-b18b-dc4a19a9e61e admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:26.206899 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b25788-29a5-46dc-8fa2-aa07aaaefb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:26.207813 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b25788-29a5-46dc-8fa2-aa07aaaefb37 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.208095 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b25788-29a5-46dc-8fa2-aa07aaaefb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.208429 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b25788-29a5-46dc-8fa2-aa07aaaefb37 admin admin] PATH_INFO: `/v3/users/04a56319092f4998a9d4cfc7569eb00c` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.215665 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b25788-29a5-46dc-8fa2-aa07aaaefb37 admin admin] RBAC: Authorizing `identity:get_user(user_id=04a56319092f4998a9d4cfc7569eb00c)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:26.217560 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b25788-29a5-46dc-8fa2-aa07aaaefb37 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:26.219697 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 71/141] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:24:26 2021] GET /identity/v3/users/04a56319092f4998a9d4cfc7569eb00c => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:26.225548 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094308f-9939-423f-8c73-c2c2c3ac63d0 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:26.241006 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094308f-9939-423f-8c73-c2c2c3ac63d0 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:26.255609 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25682bd2-05a0-4450-b196-04a5cace5042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:26.256319 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25682bd2-05a0-4450-b196-04a5cace5042 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.256606 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25682bd2-05a0-4450-b196-04a5cace5042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.256881 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25682bd2-05a0-4450-b196-04a5cace5042 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.266472 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25682bd2-05a0-4450-b196-04a5cace5042 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:26.268308 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25682bd2-05a0-4450-b196-04a5cace5042 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:26.287241 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 71/142] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:26 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:26.293607 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b25788-29a5-46dc-8fa2-aa07aaaefb37 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:26.311936 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b25788-29a5-46dc-8fa2-aa07aaaefb37 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:26.329125 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eecea2-cf3d-4b87-8753-debdc6cac3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:26.330057 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eecea2-cf3d-4b87-8753-debdc6cac3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.330338 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eecea2-cf3d-4b87-8753-debdc6cac3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.330611 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eecea2-cf3d-4b87-8753-debdc6cac3d9 admin admin] PATH_INFO: `/v3/projects/c0fc8be7ace747daba1f61a78ad61736` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.335755 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eecea2-cf3d-4b87-8753-debdc6cac3d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0fc8be7ace747daba1f61a78ad61736)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:26.337950 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eecea2-cf3d-4b87-8753-debdc6cac3d9 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:26.339968 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 72/143] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:26 2021] GET /identity/v3/projects/c0fc8be7ace747daba1f61a78ad61736 => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:26.344117 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3ac39-e30d-4737-96d9-0ce32a2ed449 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.344405 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3ac39-e30d-4737-96d9-0ce32a2ed449 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.344692 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3ac39-e30d-4737-96d9-0ce32a2ed449 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.346518 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 72/144] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:26.351076 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eecea2-cf3d-4b87-8753-debdc6cac3d9 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:26.358358 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c676b8-30be-4db7-b483-8f0795e92e24 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.358742 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c676b8-30be-4db7-b483-8f0795e92e24 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.358936 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c676b8-30be-4db7-b483-8f0795e92e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.365412 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eecea2-cf3d-4b87-8753-debdc6cac3d9 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:26.379550 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53211dd-d1a3-4b04-9247-7d6141032733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:26.380257 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53211dd-d1a3-4b04-9247-7d6141032733 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.380548 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53211dd-d1a3-4b04-9247-7d6141032733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.380880 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53211dd-d1a3-4b04-9247-7d6141032733 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.381756 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53211dd-d1a3-4b04-9247-7d6141032733 admin admin] RBAC: Adding query filter params (role.id=f7b8954a0fe64dc2b6146c7174498ddb, scope.project.id=c0fc8be7ace747daba1f61a78ad61736, user.id=04a56319092f4998a9d4cfc7569eb00c) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:26.382077 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53211dd-d1a3-4b04-9247-7d6141032733 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:26.384031 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53211dd-d1a3-4b04-9247-7d6141032733 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:26.387718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-90c676b8-30be-4db7-b483-8f0795e92e24 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:26.389196 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-90c676b8-30be-4db7-b483-8f0795e92e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:26.390566 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 73/145] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:24:26 2021] GET /identity/v3/role_assignments?user.id=04a56319092f4998a9d4cfc7569eb00c&scope.project.id=c0fc8be7ace747daba1f61a78ad61736&role.id=f7b8954a0fe64dc2b6146c7174498ddb => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:26.409583 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 73/146] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:26.440675 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0163ef-5ea9-407c-92e7-d08b59686873 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.441012 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0163ef-5ea9-407c-92e7-d08b59686873 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.441216 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0163ef-5ea9-407c-92e7-d08b59686873 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.443056 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 74/147] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:26.452288 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c676b8-30be-4db7-b483-8f0795e92e24 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:26.453652 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbac2a-1e19-4ebe-ada1-adef8bd24924 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.453948 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbac2a-1e19-4ebe-ada1-adef8bd24924 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.454234 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbac2a-1e19-4ebe-ada1-adef8bd24924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.461445 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c676b8-30be-4db7-b483-8f0795e92e24 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:26.472281 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ebdfb-9b39-42c6-972f-dc03c202e808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:26.473518 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ebdfb-9b39-42c6-972f-dc03c202e808 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.473814 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ebdfb-9b39-42c6-972f-dc03c202e808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.474091 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ebdfb-9b39-42c6-972f-dc03c202e808 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.488449 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ebdfb-9b39-42c6-972f-dc03c202e808 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:26.491721 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-96cbac2a-1e19-4ebe-ada1-adef8bd24924 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:26.492954 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-96cbac2a-1e19-4ebe-ada1-adef8bd24924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:26.495491 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-ec4ebdfb-9b39-42c6-972f-dc03c202e808 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 14:24:26.497219 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 74/148] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:26 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:26.503988 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ebdfb-9b39-42c6-972f-dc03c202e808 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:26.514118 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ebdfb-9b39-42c6-972f-dc03c202e808 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:26.514695 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 75/149] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 28 14:24:26.522452 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c90cc-65c4-4ed8-a20d-7f6ef67acaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:26.523170 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c90cc-65c4-4ed8-a20d-7f6ef67acaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.523453 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c90cc-65c4-4ed8-a20d-7f6ef67acaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.523734 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c90cc-65c4-4ed8-a20d-7f6ef67acaf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.524508 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c90cc-65c4-4ed8-a20d-7f6ef67acaf3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:26.524906 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c90cc-65c4-4ed8-a20d-7f6ef67acaf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:26.526583 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c90cc-65c4-4ed8-a20d-7f6ef67acaf3 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:26.540757 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 75/150] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Oct 28 14:24:26 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:26.547647 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbac2a-1e19-4ebe-ada1-adef8bd24924 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:26.564307 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbac2a-1e19-4ebe-ada1-adef8bd24924 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:26.572216 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c90cc-65c4-4ed8-a20d-7f6ef67acaf3 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:26.579403 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ed24f-4a1f-4756-bdcb-3e2c0810ec44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:26.580329 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ed24f-4a1f-4756-bdcb-3e2c0810ec44 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.580615 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ed24f-4a1f-4756-bdcb-3e2c0810ec44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.580890 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ed24f-4a1f-4756-bdcb-3e2c0810ec44 admin admin] PATH_INFO: `/v3/users/1ae941093e1c476bb4677c74721b18ab` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.582155 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ed24f-4a1f-4756-bdcb-3e2c0810ec44 admin admin] RBAC: Authorizing `identity:get_user(user_id=1ae941093e1c476bb4677c74721b18ab)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:26.582595 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c90cc-65c4-4ed8-a20d-7f6ef67acaf3 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:26.584373 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ed24f-4a1f-4756-bdcb-3e2c0810ec44 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:26.586241 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 76/151] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:24:26 2021] GET /identity/v3/users/1ae941093e1c476bb4677c74721b18ab => generated 275 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:26.593020 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ed24f-4a1f-4756-bdcb-3e2c0810ec44 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:26.595443 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbe9f0-4850-4917-912c-8c5159c208cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:26.596322 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbe9f0-4850-4917-912c-8c5159c208cf admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.596602 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbe9f0-4850-4917-912c-8c5159c208cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.596881 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbe9f0-4850-4917-912c-8c5159c208cf admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.617129 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ed24f-4a1f-4756-bdcb-3e2c0810ec44 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:26.623791 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbe9f0-4850-4917-912c-8c5159c208cf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:26.631456 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cccd48-cb51-44b9-98b7-d605d6c1f1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:26.632152 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cccd48-cb51-44b9-98b7-d605d6c1f1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.632434 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cccd48-cb51-44b9-98b7-d605d6c1f1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.632715 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cccd48-cb51-44b9-98b7-d605d6c1f1c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.635134 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-66bbe9f0-4850-4917-912c-8c5159c208cf admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 14:24:26.636457 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 76/152] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Oct 28 14:24:26 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:26.637784 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c647b04-6bfc-4c7b-8ef9-0bd80a100e80 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.638072 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c647b04-6bfc-4c7b-8ef9-0bd80a100e80 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.638351 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c647b04-6bfc-4c7b-8ef9-0bd80a100e80 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.640306 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 77/153] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:26.646022 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c647b04-6bfc-4c7b-8ef9-0bd80a100e80 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:26.647415 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cccd48-cb51-44b9-98b7-d605d6c1f1c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:26.649268 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cccd48-cb51-44b9-98b7-d605d6c1f1c9 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:26.670100 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 77/154] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:26 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:26.671435 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d84e7-7293-4727-b42d-3352b37d91da None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.671727 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d84e7-7293-4727-b42d-3352b37d91da None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.672011 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d84e7-7293-4727-b42d-3352b37d91da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.684578 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c647b04-6bfc-4c7b-8ef9-0bd80a100e80 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:26.707506 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed0b32-a7a0-4a1c-b41d-69d96717e85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:26.707925 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-085d84e7-7293-4727-b42d-3352b37d91da None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:26.708219 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed0b32-a7a0-4a1c-b41d-69d96717e85c admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.708503 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed0b32-a7a0-4a1c-b41d-69d96717e85c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.708778 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed0b32-a7a0-4a1c-b41d-69d96717e85c admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.708994 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-085d84e7-7293-4727-b42d-3352b37d91da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:26.709692 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed0b32-a7a0-4a1c-b41d-69d96717e85c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:26.709894 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed0b32-a7a0-4a1c-b41d-69d96717e85c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:26.711568 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed0b32-a7a0-4a1c-b41d-69d96717e85c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:26.726179 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 78/155] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:26 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:26.727092 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed0b32-a7a0-4a1c-b41d-69d96717e85c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:26.729002 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 78/156] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:26.735094 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d84e7-7293-4727-b42d-3352b37d91da None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:26.747392 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed0b32-a7a0-4a1c-b41d-69d96717e85c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:26.749073 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d84e7-7293-4727-b42d-3352b37d91da None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:26.752612 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10357bc1-b224-46a5-9233-1fff2f9cce77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:26.753494 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10357bc1-b224-46a5-9233-1fff2f9cce77 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.753789 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10357bc1-b224-46a5-9233-1fff2f9cce77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.754058 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10357bc1-b224-46a5-9233-1fff2f9cce77 admin admin] PATH_INFO: `/v3/projects/5e1386d4324444cb827c395a1115a38e` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.756774 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10357bc1-b224-46a5-9233-1fff2f9cce77 admin admin] RBAC: Authorizing `identity:get_project(project_id=5e1386d4324444cb827c395a1115a38e)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:26.759599 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10357bc1-b224-46a5-9233-1fff2f9cce77 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:26.761539 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 79/157] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:26 2021] GET /identity/v3/projects/5e1386d4324444cb827c395a1115a38e => generated 312 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:26.764425 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08120ac5-b674-4edc-892e-0ea7dbf3b0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:26.765331 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08120ac5-b674-4edc-892e-0ea7dbf3b0db admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.765614 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08120ac5-b674-4edc-892e-0ea7dbf3b0db admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.765884 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08120ac5-b674-4edc-892e-0ea7dbf3b0db admin admin] PATH_INFO: `/v3/users/1ae941093e1c476bb4677c74721b18ab` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.767857 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10357bc1-b224-46a5-9233-1fff2f9cce77 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:26.771442 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08120ac5-b674-4edc-892e-0ea7dbf3b0db admin admin] RBAC: Authorizing `identity:get_user(user_id=1ae941093e1c476bb4677c74721b18ab)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:26.773608 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08120ac5-b674-4edc-892e-0ea7dbf3b0db admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:26.775366 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 79/158] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:24:26 2021] GET /identity/v3/users/1ae941093e1c476bb4677c74721b18ab => generated 275 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:26.777793 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08120ac5-b674-4edc-892e-0ea7dbf3b0db admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:26.778503 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10357bc1-b224-46a5-9233-1fff2f9cce77 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:26.784161 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1f03a-03ba-4d11-aa00-08a343db262b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:26.784814 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1f03a-03ba-4d11-aa00-08a343db262b admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.785139 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1f03a-03ba-4d11-aa00-08a343db262b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.785412 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1f03a-03ba-4d11-aa00-08a343db262b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.786308 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1f03a-03ba-4d11-aa00-08a343db262b admin admin] RBAC: Adding query filter params (role.id=60f2c4ef9f6646108916900c5bce5845, scope.project.id=5e1386d4324444cb827c395a1115a38e, user.id=1ae941093e1c476bb4677c74721b18ab) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:26.786618 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1f03a-03ba-4d11-aa00-08a343db262b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:26.789429 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1f03a-03ba-4d11-aa00-08a343db262b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:26.796260 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 80/159] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:24:26 2021] GET /identity/v3/role_assignments?user.id=1ae941093e1c476bb4677c74721b18ab&scope.project.id=5e1386d4324444cb827c395a1115a38e&role.id=60f2c4ef9f6646108916900c5bce5845 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:26.797074 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1f03a-03ba-4d11-aa00-08a343db262b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:26.800933 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08120ac5-b674-4edc-892e-0ea7dbf3b0db admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:26.815978 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1b66f-e0eb-4fa7-87cd-86563989eef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:26.816318 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1f03a-03ba-4d11-aa00-08a343db262b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:26.816805 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1b66f-e0eb-4fa7-87cd-86563989eef1 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.817087 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1b66f-e0eb-4fa7-87cd-86563989eef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.817364 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1b66f-e0eb-4fa7-87cd-86563989eef1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.827993 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8d92c-df21-4f87-957f-7cd8ad625ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:26.828765 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8d92c-df21-4f87-957f-7cd8ad625ead admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.829050 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8d92c-df21-4f87-957f-7cd8ad625ead admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.829481 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8d92c-df21-4f87-957f-7cd8ad625ead admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.842876 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8d92c-df21-4f87-957f-7cd8ad625ead admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:26.844754 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8d92c-df21-4f87-957f-7cd8ad625ead admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:26.857695 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1b66f-e0eb-4fa7-87cd-86563989eef1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:26.858535 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-6bb1b66f-e0eb-4fa7-87cd-86563989eef1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 14:24:26.860070 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 80/160] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:26 2021] GET /identity/v3/roles/member => generated 84 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:26.861288 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 81/161] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:26 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:26.867686 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1b66f-e0eb-4fa7-87cd-86563989eef1 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:26.867873 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8d92c-df21-4f87-957f-7cd8ad625ead admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:26.880347 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8d92c-df21-4f87-957f-7cd8ad625ead admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:26.886543 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1b66f-e0eb-4fa7-87cd-86563989eef1 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:26.888242 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725f5d1-5b0e-40af-8109-a05c4d688ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:26.888941 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725f5d1-5b0e-40af-8109-a05c4d688ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.889267 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725f5d1-5b0e-40af-8109-a05c4d688ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.889543 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725f5d1-5b0e-40af-8109-a05c4d688ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.890362 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725f5d1-5b0e-40af-8109-a05c4d688ff6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:26.890671 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725f5d1-5b0e-40af-8109-a05c4d688ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:26.892350 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725f5d1-5b0e-40af-8109-a05c4d688ff6 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:26.894409 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88797df8-429c-4e3d-86a7-75b4fe591666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:26.895594 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88797df8-429c-4e3d-86a7-75b4fe591666 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.896094 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88797df8-429c-4e3d-86a7-75b4fe591666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.896554 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88797df8-429c-4e3d-86a7-75b4fe591666 admin admin] PATH_INFO: `/v3/projects/c0fc8be7ace747daba1f61a78ad61736` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.903600 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88797df8-429c-4e3d-86a7-75b4fe591666 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0fc8be7ace747daba1f61a78ad61736)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:26.906148 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88797df8-429c-4e3d-86a7-75b4fe591666 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:26.908301 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 82/162] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Oct 28 14:24:26 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:26.909138 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 81/163] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:26 2021] GET /identity/v3/projects/c0fc8be7ace747daba1f61a78ad61736 => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:26.915746 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725f5d1-5b0e-40af-8109-a05c4d688ff6 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:26.916224 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88797df8-429c-4e3d-86a7-75b4fe591666 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:26.929108 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725f5d1-5b0e-40af-8109-a05c4d688ff6 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:26.937754 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88797df8-429c-4e3d-86a7-75b4fe591666 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:26.942704 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9faa1-3dc9-4e3c-851d-0b2f69e5e15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:26.942704 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9faa1-3dc9-4e3c-851d-0b2f69e5e15e admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.942704 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9faa1-3dc9-4e3c-851d-0b2f69e5e15e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.942704 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9faa1-3dc9-4e3c-851d-0b2f69e5e15e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.943029 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9faa1-3dc9-4e3c-851d-0b2f69e5e15e admin admin] RBAC: Adding query filter params (role.id=08b906e1585f45668d988e46a5d2659a, scope.project.id=c0fc8be7ace747daba1f61a78ad61736, user.id=1ae941093e1c476bb4677c74721b18ab) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:26.943029 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9faa1-3dc9-4e3c-851d-0b2f69e5e15e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:26.944956 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9faa1-3dc9-4e3c-851d-0b2f69e5e15e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:26.950573 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbd1d4-d755-42ca-b0b3-31130d5f9d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:26.951866 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbd1d4-d755-42ca-b0b3-31130d5f9d43 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:26.952338 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbd1d4-d755-42ca-b0b3-31130d5f9d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:26.952798 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbd1d4-d755-42ca-b0b3-31130d5f9d43 admin admin] PATH_INFO: `/v3/users/c926f34dc68845d0b756bbde4b6f9d46` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:26.955905 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 83/164] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:24:26 2021] GET /identity/v3/role_assignments?user.id=1ae941093e1c476bb4677c74721b18ab&scope.project.id=c0fc8be7ace747daba1f61a78ad61736&role.id=08b906e1585f45668d988e46a5d2659a => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:26.981855 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbd1d4-d755-42ca-b0b3-31130d5f9d43 admin admin] RBAC: Authorizing `identity:get_user(user_id=c926f34dc68845d0b756bbde4b6f9d46)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:26.984604 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbd1d4-d755-42ca-b0b3-31130d5f9d43 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:26.986911 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 82/165] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:24:26 2021] GET /identity/v3/users/c926f34dc68845d0b756bbde4b6f9d46 => generated 283 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:26.993715 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9faa1-3dc9-4e3c-851d-0b2f69e5e15e admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:27.011455 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9faa1-3dc9-4e3c-851d-0b2f69e5e15e admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:27.019240 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410075c-feb0-426e-a05c-1c307fe7d654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:27.019981 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410075c-feb0-426e-a05c-1c307fe7d654 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:27.020262 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410075c-feb0-426e-a05c-1c307fe7d654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:27.020537 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410075c-feb0-426e-a05c-1c307fe7d654 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:27.034762 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410075c-feb0-426e-a05c-1c307fe7d654 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:27.036657 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410075c-feb0-426e-a05c-1c307fe7d654 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:27.049849 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 84/166] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:26 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:27.057649 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbd1d4-d755-42ca-b0b3-31130d5f9d43 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:27.072533 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbd1d4-d755-42ca-b0b3-31130d5f9d43 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:27.082072 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb81718-69ad-452a-b2bf-eca10e84689f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:27.083494 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb81718-69ad-452a-b2bf-eca10e84689f admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:27.083998 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb81718-69ad-452a-b2bf-eca10e84689f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:27.084464 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb81718-69ad-452a-b2bf-eca10e84689f admin admin] PATH_INFO: `/v3/projects/827891427e6b4c02918b6c82992d0bbb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:27.091672 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb81718-69ad-452a-b2bf-eca10e84689f admin admin] RBAC: Authorizing `identity:get_project(project_id=827891427e6b4c02918b6c82992d0bbb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:27.094095 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb81718-69ad-452a-b2bf-eca10e84689f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:27.096191 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 83/167] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:27 2021] GET /identity/v3/projects/827891427e6b4c02918b6c82992d0bbb => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:27.103434 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410075c-feb0-426e-a05c-1c307fe7d654 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:27.116214 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410075c-feb0-426e-a05c-1c307fe7d654 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:27.123444 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40bd2a-6756-4687-a459-4896fb587cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:27.124173 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40bd2a-6756-4687-a459-4896fb587cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:27.124493 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40bd2a-6756-4687-a459-4896fb587cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:27.124767 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40bd2a-6756-4687-a459-4896fb587cb8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:27.125694 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40bd2a-6756-4687-a459-4896fb587cb8 admin admin] RBAC: Adding query filter params (role.id=60f2c4ef9f6646108916900c5bce5845, scope.project.id=827891427e6b4c02918b6c82992d0bbb, user.id=c926f34dc68845d0b756bbde4b6f9d46) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:27.126005 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40bd2a-6756-4687-a459-4896fb587cb8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:27.127986 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40bd2a-6756-4687-a459-4896fb587cb8 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:27.137296 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 85/168] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:24:27 2021] GET /identity/v3/role_assignments?user.id=c926f34dc68845d0b756bbde4b6f9d46&scope.project.id=827891427e6b4c02918b6c82992d0bbb&role.id=60f2c4ef9f6646108916900c5bce5845 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:27.596536 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801e65b-ea0f-4d04-addf-a5ba44716291 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:27.597217 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801e65b-ea0f-4d04-addf-a5ba44716291 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:27.597691 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801e65b-ea0f-4d04-addf-a5ba44716291 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:27.599716 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 84/169] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:27.604132 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0918af-5afc-4d8e-ab4a-1ae7a0be7336 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:27.604421 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0918af-5afc-4d8e-ab4a-1ae7a0be7336 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:27.604696 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0918af-5afc-4d8e-ab4a-1ae7a0be7336 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:27.606132 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4b5a6-6205-4cc6-8cd0-d62f6e6b11a8 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:27.606628 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 86/170] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:27.607080 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4b5a6-6205-4cc6-8cd0-d62f6e6b11a8 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:27.607556 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4b5a6-6205-4cc6-8cd0-d62f6e6b11a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:27.623880 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598de1a2-c809-484b-a569-1b14c5ec94e3 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:27.623880 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598de1a2-c809-484b-a569-1b14c5ec94e3 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:27.623880 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598de1a2-c809-484b-a569-1b14c5ec94e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:27.628573 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-16a4b5a6-6205-4cc6-8cd0-d62f6e6b11a8 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:27.629996 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-16a4b5a6-6205-4cc6-8cd0-d62f6e6b11a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:27.640312 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 85/171] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:27.646979 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-598de1a2-c809-484b-a569-1b14c5ec94e3 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:27.648230 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-598de1a2-c809-484b-a569-1b14c5ec94e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:27.658822 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 87/172] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:27.668303 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4b5a6-6205-4cc6-8cd0-d62f6e6b11a8 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:27.679992 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4b5a6-6205-4cc6-8cd0-d62f6e6b11a8 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:27.687569 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598de1a2-c809-484b-a569-1b14c5ec94e3 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:27.688301 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58350f5-77ed-412b-ad22-231981f72314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:27.689293 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58350f5-77ed-412b-ad22-231981f72314 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:27.689704 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58350f5-77ed-412b-ad22-231981f72314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:27.690104 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58350f5-77ed-412b-ad22-231981f72314 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:27.701545 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58350f5-77ed-412b-ad22-231981f72314 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:27.703888 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598de1a2-c809-484b-a569-1b14c5ec94e3 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:27.708875 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-b58350f5-77ed-412b-ad22-231981f72314 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:24:27.710951 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 86/173] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:24:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:27.716233 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90566a-c3c5-4d07-b961-0b092285122f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:27.717205 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58350f5-77ed-412b-ad22-231981f72314 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:27.717675 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90566a-c3c5-4d07-b961-0b092285122f admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:27.717948 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90566a-c3c5-4d07-b961-0b092285122f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:27.718227 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90566a-c3c5-4d07-b961-0b092285122f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:27.719480 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90566a-c3c5-4d07-b961-0b092285122f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:27.721209 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90566a-c3c5-4d07-b961-0b092285122f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:27.723122 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 88/174] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:27 2021] GET /identity/v3/domains/default => generated 199 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:27.731421 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90566a-c3c5-4d07-b961-0b092285122f admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:27.733943 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58350f5-77ed-412b-ad22-231981f72314 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:27.742513 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90566a-c3c5-4d07-b961-0b092285122f admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:27.747507 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c3b94-8488-4a34-981a-c86906320bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:27.748414 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c3b94-8488-4a34-981a-c86906320bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:27.748801 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c3b94-8488-4a34-981a-c86906320bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:27.749182 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c3b94-8488-4a34-981a-c86906320bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:27.750083 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c3b94-8488-4a34-981a-c86906320bd9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:27.751477 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c3b94-8488-4a34-981a-c86906320bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:27.753736 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c3b94-8488-4a34-981a-c86906320bd9 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:27.761860 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9746d50-94f5-4982-a2b7-dd447651e4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:27.762788 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9746d50-94f5-4982-a2b7-dd447651e4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:27.763222 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9746d50-94f5-4982-a2b7-dd447651e4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:27.763601 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9746d50-94f5-4982-a2b7-dd447651e4d9 admin admin] PATH_INFO: `/v3/groups` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:27.764554 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9746d50-94f5-4982-a2b7-dd447651e4d9 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:27.765609 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING py.warnings [None req-b9746d50-94f5-4982-a2b7-dd447651e4d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:24:27.765609 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: warnings.warn(msg) Oct 28 14:24:27.765609 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: Oct 28 14:24:27.767092 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9746d50-94f5-4982-a2b7-dd447651e4d9 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:27.767427 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 87/175] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:27.775245 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c3b94-8488-4a34-981a-c86906320bd9 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:27.786007 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c3b94-8488-4a34-981a-c86906320bd9 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:27.789236 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 89/176] 10.222.0.79 () {60 vars in 1155 bytes} [Thu Oct 28 14:24:27 2021] POST /identity/v3/groups => generated 229 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:24:27.792315 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c0c26-0f83-4cf0-85f5-49f09232c793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:27.793448 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c0c26-0f83-4cf0-85f5-49f09232c793 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:27.793850 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c0c26-0f83-4cf0-85f5-49f09232c793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:27.794262 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c0c26-0f83-4cf0-85f5-49f09232c793 admin admin] PATH_INFO: `/v3/users/04a56319092f4998a9d4cfc7569eb00c` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:27.795894 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c0c26-0f83-4cf0-85f5-49f09232c793 admin admin] RBAC: Authorizing `identity:get_user(user_id=04a56319092f4998a9d4cfc7569eb00c)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:27.798021 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c0c26-0f83-4cf0-85f5-49f09232c793 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:27.800114 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 88/177] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:24:27 2021] GET /identity/v3/users/04a56319092f4998a9d4cfc7569eb00c => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:27.807864 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9746d50-94f5-4982-a2b7-dd447651e4d9 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:27.818805 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9746d50-94f5-4982-a2b7-dd447651e4d9 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:27.823903 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9c358-b386-425d-9b9c-79a454252d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:27.824803 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9c358-b386-425d-9b9c-79a454252d50 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:27.825191 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9c358-b386-425d-9b9c-79a454252d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:27.825621 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9c358-b386-425d-9b9c-79a454252d50 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:27.835217 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9c358-b386-425d-9b9c-79a454252d50 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:27.837354 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9c358-b386-425d-9b9c-79a454252d50 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:27.848361 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 90/178] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:27.854927 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c0c26-0f83-4cf0-85f5-49f09232c793 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:27.866351 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c0c26-0f83-4cf0-85f5-49f09232c793 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:27.871575 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5847c-4024-4c8b-869f-8487751c3d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:27.872705 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5847c-4024-4c8b-869f-8487751c3d4a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:27.873092 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5847c-4024-4c8b-869f-8487751c3d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:27.873542 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5847c-4024-4c8b-869f-8487751c3d4a admin admin] PATH_INFO: `/v3/projects/827891427e6b4c02918b6c82992d0bbb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:27.875004 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5847c-4024-4c8b-869f-8487751c3d4a admin admin] RBAC: Authorizing `identity:get_project(project_id=827891427e6b4c02918b6c82992d0bbb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:27.877453 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5847c-4024-4c8b-869f-8487751c3d4a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:27.879446 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 89/179] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:27 2021] GET /identity/v3/projects/827891427e6b4c02918b6c82992d0bbb => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:27.886498 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9c358-b386-425d-9b9c-79a454252d50 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:27.895954 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe2195-532d-4d70-a52d-e9e71cf90767 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:27.896403 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe2195-532d-4d70-a52d-e9e71cf90767 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:27.896787 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe2195-532d-4d70-a52d-e9e71cf90767 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:27.897149 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9c358-b386-425d-9b9c-79a454252d50 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:27.901676 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666f9d5-9552-456c-a157-24ad7a3c9247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:27.902606 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666f9d5-9552-456c-a157-24ad7a3c9247 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:27.902920 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666f9d5-9552-456c-a157-24ad7a3c9247 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:27.903190 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666f9d5-9552-456c-a157-24ad7a3c9247 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:27.904041 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666f9d5-9552-456c-a157-24ad7a3c9247 admin admin] RBAC: Adding query filter params (role.id=f7b8954a0fe64dc2b6146c7174498ddb, scope.project.id=827891427e6b4c02918b6c82992d0bbb, user.id=04a56319092f4998a9d4cfc7569eb00c) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:27.904348 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666f9d5-9552-456c-a157-24ad7a3c9247 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:27.905181 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 90/180] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:27 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:27.906329 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666f9d5-9552-456c-a157-24ad7a3c9247 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:27.912007 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0489e6a-0406-4807-b9d3-4406b2b62f92 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:27.912424 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0489e6a-0406-4807-b9d3-4406b2b62f92 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:27.912823 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 91/181] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:24:27 2021] GET /identity/v3/role_assignments?user.id=04a56319092f4998a9d4cfc7569eb00c&scope.project.id=827891427e6b4c02918b6c82992d0bbb&role.id=f7b8954a0fe64dc2b6146c7174498ddb => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:27.913114 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0489e6a-0406-4807-b9d3-4406b2b62f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:27.938618 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-b0489e6a-0406-4807-b9d3-4406b2b62f92 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:27.940421 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-b0489e6a-0406-4807-b9d3-4406b2b62f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:27.949255 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 91/182] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:27.974170 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666f9d5-9552-456c-a157-24ad7a3c9247 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:27.985823 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666f9d5-9552-456c-a157-24ad7a3c9247 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:27.991152 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50a4b6-f252-4375-91b0-50f8e22c8430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:27.992359 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50a4b6-f252-4375-91b0-50f8e22c8430 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:27.992834 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50a4b6-f252-4375-91b0-50f8e22c8430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:27.993284 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50a4b6-f252-4375-91b0-50f8e22c8430 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:28.006528 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50a4b6-f252-4375-91b0-50f8e22c8430 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:28.014629 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-4c50a4b6-f252-4375-91b0-50f8e22c8430 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 14:24:28.017038 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 92/183] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Oct 28 14:24:27 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:28.024142 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0489e6a-0406-4807-b9d3-4406b2b62f92 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:28.037377 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0489e6a-0406-4807-b9d3-4406b2b62f92 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:28.043099 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f47bc3-f897-4755-a241-fb03c186324d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:28.044114 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f47bc3-f897-4755-a241-fb03c186324d admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:28.044531 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f47bc3-f897-4755-a241-fb03c186324d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:28.044946 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f47bc3-f897-4755-a241-fb03c186324d admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:28.045878 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f47bc3-f897-4755-a241-fb03c186324d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:28.046335 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f47bc3-f897-4755-a241-fb03c186324d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:28.048134 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f47bc3-f897-4755-a241-fb03c186324d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:28.057739 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 92/184] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:28 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:28.065209 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50a4b6-f252-4375-91b0-50f8e22c8430 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:28.076527 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50a4b6-f252-4375-91b0-50f8e22c8430 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:28.081651 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec842bb-b7e8-4815-9663-98d51007ee9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:28.082923 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec842bb-b7e8-4815-9663-98d51007ee9a admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:28.083360 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec842bb-b7e8-4815-9663-98d51007ee9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:28.083834 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec842bb-b7e8-4815-9663-98d51007ee9a admin admin] PATH_INFO: `/v3/users/c926f34dc68845d0b756bbde4b6f9d46` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:28.085312 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec842bb-b7e8-4815-9663-98d51007ee9a admin admin] RBAC: Authorizing `identity:get_user(user_id=c926f34dc68845d0b756bbde4b6f9d46)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:28.087840 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec842bb-b7e8-4815-9663-98d51007ee9a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:28.090158 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 93/185] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:24:28 2021] GET /identity/v3/users/c926f34dc68845d0b756bbde4b6f9d46 => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:28.096451 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f47bc3-f897-4755-a241-fb03c186324d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:28.107817 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f47bc3-f897-4755-a241-fb03c186324d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:28.112741 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be32dd-4bf2-41bf-ae77-d0db11899a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:28.113673 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be32dd-4bf2-41bf-ae77-d0db11899a9f admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:28.114089 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be32dd-4bf2-41bf-ae77-d0db11899a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:28.114496 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be32dd-4bf2-41bf-ae77-d0db11899a9f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:28.123849 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be32dd-4bf2-41bf-ae77-d0db11899a9f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:28.125897 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be32dd-4bf2-41bf-ae77-d0db11899a9f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:28.136717 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 93/186] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:28 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:28.145313 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec842bb-b7e8-4815-9663-98d51007ee9a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:28.155286 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec842bb-b7e8-4815-9663-98d51007ee9a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:28.160354 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca74e2-45e2-456b-b4c3-9bac19ef1e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:28.161248 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca74e2-45e2-456b-b4c3-9bac19ef1e2b admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:28.161525 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca74e2-45e2-456b-b4c3-9bac19ef1e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:28.161792 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca74e2-45e2-456b-b4c3-9bac19ef1e2b admin admin] PATH_INFO: `/v3/projects/827891427e6b4c02918b6c82992d0bbb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:28.163154 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca74e2-45e2-456b-b4c3-9bac19ef1e2b admin admin] RBAC: Authorizing `identity:get_project(project_id=827891427e6b4c02918b6c82992d0bbb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:28.165235 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca74e2-45e2-456b-b4c3-9bac19ef1e2b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:28.167329 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 94/187] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:28 2021] GET /identity/v3/projects/827891427e6b4c02918b6c82992d0bbb => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:28.173902 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be32dd-4bf2-41bf-ae77-d0db11899a9f admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:28.184800 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be32dd-4bf2-41bf-ae77-d0db11899a9f admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:28.189536 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338be606-a114-4f32-bcb4-4ced2bd0dae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:28.190237 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338be606-a114-4f32-bcb4-4ced2bd0dae8 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:28.190508 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338be606-a114-4f32-bcb4-4ced2bd0dae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:28.190814 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338be606-a114-4f32-bcb4-4ced2bd0dae8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:28.191655 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338be606-a114-4f32-bcb4-4ced2bd0dae8 admin admin] RBAC: Adding query filter params (role.id=08b906e1585f45668d988e46a5d2659a, scope.project.id=827891427e6b4c02918b6c82992d0bbb, user.id=c926f34dc68845d0b756bbde4b6f9d46) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:28.191959 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338be606-a114-4f32-bcb4-4ced2bd0dae8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:28.193782 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338be606-a114-4f32-bcb4-4ced2bd0dae8 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:28.199915 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 94/188] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:24:28 2021] GET /identity/v3/role_assignments?user.id=c926f34dc68845d0b756bbde4b6f9d46&scope.project.id=827891427e6b4c02918b6c82992d0bbb&role.id=08b906e1585f45668d988e46a5d2659a => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:29.488434 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f9f26-3793-4385-9a12-ed0933c92166 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:29.488972 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f9f26-3793-4385-9a12-ed0933c92166 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:29.488972 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f9f26-3793-4385-9a12-ed0933c92166 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:29.490849 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 95/189] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:29.497030 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad0e4c-14a4-4a27-a01c-b5a21d86bca0 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:29.497851 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad0e4c-14a4-4a27-a01c-b5a21d86bca0 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:29.498338 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad0e4c-14a4-4a27-a01c-b5a21d86bca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:29.516805 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-ddad0e4c-14a4-4a27-a01c-b5a21d86bca0 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:29.518527 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-ddad0e4c-14a4-4a27-a01c-b5a21d86bca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:29.526486 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 95/190] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:29.550393 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f9f26-3793-4385-9a12-ed0933c92166 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:29.563671 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f9f26-3793-4385-9a12-ed0933c92166 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:29.568272 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f86fc-10ee-4959-ba5e-8c093316994d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:29.569380 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f86fc-10ee-4959-ba5e-8c093316994d admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:29.569887 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f86fc-10ee-4959-ba5e-8c093316994d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:29.570363 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f86fc-10ee-4959-ba5e-8c093316994d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:29.581415 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f86fc-10ee-4959-ba5e-8c093316994d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:29.588747 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-e37f86fc-10ee-4959-ba5e-8c093316994d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 14:24:29.590190 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 96/191] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:29 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:29.597179 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad0e4c-14a4-4a27-a01c-b5a21d86bca0 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:29.606808 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad0e4c-14a4-4a27-a01c-b5a21d86bca0 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:29.611541 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29021e-516a-443a-a564-33741f311d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:29.612440 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29021e-516a-443a-a564-33741f311d92 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:29.612924 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29021e-516a-443a-a564-33741f311d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:29.613421 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29021e-516a-443a-a564-33741f311d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:29.614398 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29021e-516a-443a-a564-33741f311d92 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:29.614945 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29021e-516a-443a-a564-33741f311d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:29.616761 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29021e-516a-443a-a564-33741f311d92 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:29.626086 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 96/192] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Oct 28 14:24:29 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:29.632698 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f86fc-10ee-4959-ba5e-8c093316994d admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:29.642882 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f86fc-10ee-4959-ba5e-8c093316994d admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:29.647571 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f25b91-f775-469f-b808-5dc0dff7eaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:29.648679 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f25b91-f775-469f-b808-5dc0dff7eaf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:29.649164 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f25b91-f775-469f-b808-5dc0dff7eaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:29.649661 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f25b91-f775-469f-b808-5dc0dff7eaf4 admin admin] PATH_INFO: `/v3/users/c926f34dc68845d0b756bbde4b6f9d46` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:29.651244 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f25b91-f775-469f-b808-5dc0dff7eaf4 admin admin] RBAC: Authorizing `identity:get_user(user_id=c926f34dc68845d0b756bbde4b6f9d46)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:29.653608 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f25b91-f775-469f-b808-5dc0dff7eaf4 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:29.655492 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 97/193] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:24:29 2021] GET /identity/v3/users/c926f34dc68845d0b756bbde4b6f9d46 => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:29.661718 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29021e-516a-443a-a564-33741f311d92 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:29.672201 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29021e-516a-443a-a564-33741f311d92 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:29.677228 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a12c7c-3b79-4a49-8d44-4f81d35fefda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:29.678359 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a12c7c-3b79-4a49-8d44-4f81d35fefda admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:29.678921 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a12c7c-3b79-4a49-8d44-4f81d35fefda admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:29.679399 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a12c7c-3b79-4a49-8d44-4f81d35fefda admin admin] PATH_INFO: `/v3/projects/827891427e6b4c02918b6c82992d0bbb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:29.680812 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a12c7c-3b79-4a49-8d44-4f81d35fefda admin admin] RBAC: Authorizing `identity:get_project(project_id=827891427e6b4c02918b6c82992d0bbb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:29.683256 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a12c7c-3b79-4a49-8d44-4f81d35fefda admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:29.685223 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 97/194] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:29 2021] GET /identity/v3/projects/827891427e6b4c02918b6c82992d0bbb => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:29.691663 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f25b91-f775-469f-b808-5dc0dff7eaf4 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:29.702983 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f25b91-f775-469f-b808-5dc0dff7eaf4 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:29.707633 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4ed71-4425-48e3-8c2c-09897284f4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:29.708743 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4ed71-4425-48e3-8c2c-09897284f4a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:29.709227 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4ed71-4425-48e3-8c2c-09897284f4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:29.709705 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4ed71-4425-48e3-8c2c-09897284f4a7 admin admin] PATH_INFO: `/v3/projects/827891427e6b4c02918b6c82992d0bbb/users/c926f34dc68845d0b756bbde4b6f9d46/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:29.711927 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4ed71-4425-48e3-8c2c-09897284f4a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=827891427e6b4c02918b6c82992d0bbb, user_id=c926f34dc68845d0b756bbde4b6f9d46, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:29.714893 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4ed71-4425-48e3-8c2c-09897284f4a7 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:29.732217 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 98/195] 10.222.0.79 () {58 vars in 1460 bytes} [Thu Oct 28 14:24:29 2021] PUT /identity/v3/projects/827891427e6b4c02918b6c82992d0bbb/users/c926f34dc68845d0b756bbde4b6f9d46/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:24:30.154447 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5a891-9240-4339-a186-33ac33e18b38 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:30.155168 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5a891-9240-4339-a186-33ac33e18b38 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:30.155660 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5a891-9240-4339-a186-33ac33e18b38 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:30.157678 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 98/196] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:30.163931 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd4f83-8c64-41d7-9f8d-dbf51d4b2cd4 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:30.164213 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd4f83-8c64-41d7-9f8d-dbf51d4b2cd4 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:30.164483 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd4f83-8c64-41d7-9f8d-dbf51d4b2cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:30.182553 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-c5cd4f83-8c64-41d7-9f8d-dbf51d4b2cd4 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:30.183904 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-c5cd4f83-8c64-41d7-9f8d-dbf51d4b2cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:30.224349 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1947b1b-3c07-4a77-a15c-1df45b056349 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:30.224688 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1947b1b-3c07-4a77-a15c-1df45b056349 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:30.224909 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1947b1b-3c07-4a77-a15c-1df45b056349 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:30.226807 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 99/197] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 14:24:30.233528 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c214d8f-c04d-48d9-8f8e-75b66103272c None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:30.233844 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c214d8f-c04d-48d9-8f8e-75b66103272c None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:30.234087 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c214d8f-c04d-48d9-8f8e-75b66103272c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:30.253324 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-8c214d8f-c04d-48d9-8f8e-75b66103272c None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:30.254564 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-8c214d8f-c04d-48d9-8f8e-75b66103272c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:30.318402 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 100/198] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:24:30.343757 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c214d8f-c04d-48d9-8f8e-75b66103272c None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:30.353494 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c214d8f-c04d-48d9-8f8e-75b66103272c None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:30.358613 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a5bd5-f881-4592-a5d9-97e5c8a7cc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:30.359736 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a5bd5-f881-4592-a5d9-97e5c8a7cc58 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:30.360260 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a5bd5-f881-4592-a5d9-97e5c8a7cc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:30.360641 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a5bd5-f881-4592-a5d9-97e5c8a7cc58 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:30.363741 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 99/199] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:24:30.376547 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a5bd5-f881-4592-a5d9-97e5c8a7cc58 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:30.383571 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-263a5bd5-f881-4592-a5d9-97e5c8a7cc58 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:24:30.384962 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 101/200] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:24:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:30.387617 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd4f83-8c64-41d7-9f8d-dbf51d4b2cd4 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:30.391329 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a5bd5-f881-4592-a5d9-97e5c8a7cc58 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:30.397026 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd4f83-8c64-41d7-9f8d-dbf51d4b2cd4 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:30.401243 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a5bd5-f881-4592-a5d9-97e5c8a7cc58 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:30.401517 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5133b-07ad-4477-b2af-bfb3b20644a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:30.402469 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5133b-07ad-4477-b2af-bfb3b20644a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:30.402900 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5133b-07ad-4477-b2af-bfb3b20644a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:30.403172 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5133b-07ad-4477-b2af-bfb3b20644a2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:30.404423 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5133b-07ad-4477-b2af-bfb3b20644a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:30.405575 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748f0f7-86f9-4f5a-a69d-69cb4b418aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:30.406166 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748f0f7-86f9-4f5a-a69d-69cb4b418aff admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:30.406270 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5133b-07ad-4477-b2af-bfb3b20644a2 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:30.406474 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748f0f7-86f9-4f5a-a69d-69cb4b418aff admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:30.406717 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748f0f7-86f9-4f5a-a69d-69cb4b418aff admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:30.407481 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748f0f7-86f9-4f5a-a69d-69cb4b418aff admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:30.407780 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748f0f7-86f9-4f5a-a69d-69cb4b418aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:30.407876 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 100/201] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:30 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:30.409634 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748f0f7-86f9-4f5a-a69d-69cb4b418aff admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:30.416849 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5133b-07ad-4477-b2af-bfb3b20644a2 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:30.423538 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 102/202] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:30.429929 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5133b-07ad-4477-b2af-bfb3b20644a2 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:30.430717 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748f0f7-86f9-4f5a-a69d-69cb4b418aff admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:30.434434 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059b814-e43c-4c1a-b5f3-7ccabe00446a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:30.435462 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059b814-e43c-4c1a-b5f3-7ccabe00446a admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:30.436012 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059b814-e43c-4c1a-b5f3-7ccabe00446a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:30.436687 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059b814-e43c-4c1a-b5f3-7ccabe00446a admin admin] PATH_INFO: `/v3/groups` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:30.438253 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059b814-e43c-4c1a-b5f3-7ccabe00446a admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:30.440787 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059b814-e43c-4c1a-b5f3-7ccabe00446a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:30.440912 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748f0f7-86f9-4f5a-a69d-69cb4b418aff admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:30.446069 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e1fa0-696d-4988-9af0-cedccd67e90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:30.446921 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e1fa0-696d-4988-9af0-cedccd67e90e admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:30.447150 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e1fa0-696d-4988-9af0-cedccd67e90e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:30.447449 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e1fa0-696d-4988-9af0-cedccd67e90e admin admin] PATH_INFO: `/v3/users/04a56319092f4998a9d4cfc7569eb00c` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:30.449319 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e1fa0-696d-4988-9af0-cedccd67e90e admin admin] RBAC: Authorizing `identity:get_user(user_id=04a56319092f4998a9d4cfc7569eb00c)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:30.450933 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e1fa0-696d-4988-9af0-cedccd67e90e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:30.452754 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 103/203] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:24:30 2021] GET /identity/v3/users/04a56319092f4998a9d4cfc7569eb00c => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:30.459694 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e1fa0-696d-4988-9af0-cedccd67e90e admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:30.460556 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 101/204] 10.222.0.79 () {60 vars in 1155 bytes} [Thu Oct 28 14:24:30 2021] POST /identity/v3/groups => generated 226 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:24:30.471972 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e1fa0-696d-4988-9af0-cedccd67e90e admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:30.476389 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382f91e-ef78-47c1-a399-418db11054f2 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:30.476723 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382f91e-ef78-47c1-a399-418db11054f2 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:30.476961 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382f91e-ef78-47c1-a399-418db11054f2 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:30.478989 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1707fba-106b-46e0-8e04-30f31c22b264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:30.480209 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1707fba-106b-46e0-8e04-30f31c22b264 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:30.480759 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1707fba-106b-46e0-8e04-30f31c22b264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:30.481277 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1707fba-106b-46e0-8e04-30f31c22b264 admin admin] PATH_INFO: `/v3/projects/827891427e6b4c02918b6c82992d0bbb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:30.483015 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1707fba-106b-46e0-8e04-30f31c22b264 admin admin] RBAC: Authorizing `identity:get_project(project_id=827891427e6b4c02918b6c82992d0bbb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:30.483883 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 102/205] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:30 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 14:24:30.485375 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c52a2-67f0-43d1-89db-77cf897768b6 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:30.485676 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c52a2-67f0-43d1-89db-77cf897768b6 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:30.485941 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c52a2-67f0-43d1-89db-77cf897768b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:30.486670 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1707fba-106b-46e0-8e04-30f31c22b264 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:30.489548 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 104/206] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:30 2021] GET /identity/v3/projects/827891427e6b4c02918b6c82992d0bbb => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:30.496415 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1707fba-106b-46e0-8e04-30f31c22b264 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:30.505755 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-102c52a2-67f0-43d1-89db-77cf897768b6 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:30.507041 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-102c52a2-67f0-43d1-89db-77cf897768b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:30.507971 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1707fba-106b-46e0-8e04-30f31c22b264 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:30.513667 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7787a9-6e7b-4f5c-9e64-f41806bfc52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:30.514929 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7787a9-6e7b-4f5c-9e64-f41806bfc52e admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:30.515387 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7787a9-6e7b-4f5c-9e64-f41806bfc52e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:30.515834 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7787a9-6e7b-4f5c-9e64-f41806bfc52e admin admin] PATH_INFO: `/v3/projects/827891427e6b4c02918b6c82992d0bbb/users/04a56319092f4998a9d4cfc7569eb00c/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:30.518070 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7787a9-6e7b-4f5c-9e64-f41806bfc52e admin admin] RBAC: Authorizing `identity:create_grant(project_id=827891427e6b4c02918b6c82992d0bbb, user_id=04a56319092f4998a9d4cfc7569eb00c, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:30.521133 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7787a9-6e7b-4f5c-9e64-f41806bfc52e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:30.522874 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 103/207] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:30.537569 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 105/208] 10.222.0.79 () {58 vars in 1460 bytes} [Thu Oct 28 14:24:30 2021] PUT /identity/v3/projects/827891427e6b4c02918b6c82992d0bbb/users/04a56319092f4998a9d4cfc7569eb00c/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:24:30.542822 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c52a2-67f0-43d1-89db-77cf897768b6 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:30.561665 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c52a2-67f0-43d1-89db-77cf897768b6 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:30.628827 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6885b-ca61-4f74-8751-f09d4fc5c5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:30.629736 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6885b-ca61-4f74-8751-f09d4fc5c5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:30.630019 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6885b-ca61-4f74-8751-f09d4fc5c5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:30.630291 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6885b-ca61-4f74-8751-f09d4fc5c5f4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:30.643872 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6885b-ca61-4f74-8751-f09d4fc5c5f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:30.651684 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-e6c6885b-ca61-4f74-8751-f09d4fc5c5f4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 14:24:30.652991 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 104/209] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Oct 28 14:24:30 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:30.660320 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7787a9-6e7b-4f5c-9e64-f41806bfc52e admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:30.671670 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7787a9-6e7b-4f5c-9e64-f41806bfc52e admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:30.676895 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e5076-d3e5-4dbe-8811-bc69654f1d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:30.677601 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e5076-d3e5-4dbe-8811-bc69654f1d66 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:30.677877 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e5076-d3e5-4dbe-8811-bc69654f1d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:30.678146 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e5076-d3e5-4dbe-8811-bc69654f1d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:30.678984 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e5076-d3e5-4dbe-8811-bc69654f1d66 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:30.679277 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e5076-d3e5-4dbe-8811-bc69654f1d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:30.681041 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e5076-d3e5-4dbe-8811-bc69654f1d66 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:30.693464 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 106/210] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:30 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:30.699760 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6885b-ca61-4f74-8751-f09d4fc5c5f4 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:30.712325 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6885b-ca61-4f74-8751-f09d4fc5c5f4 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:30.718873 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bea74-5bea-424e-8469-7af6d1ad373a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:30.719775 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bea74-5bea-424e-8469-7af6d1ad373a admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:30.720052 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bea74-5bea-424e-8469-7af6d1ad373a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:30.720318 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bea74-5bea-424e-8469-7af6d1ad373a admin admin] PATH_INFO: `/v3/users/c926f34dc68845d0b756bbde4b6f9d46` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:30.721583 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bea74-5bea-424e-8469-7af6d1ad373a admin admin] RBAC: Authorizing `identity:get_user(user_id=c926f34dc68845d0b756bbde4b6f9d46)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:30.723804 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bea74-5bea-424e-8469-7af6d1ad373a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:30.725497 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 105/211] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:24:30 2021] GET /identity/v3/users/c926f34dc68845d0b756bbde4b6f9d46 => generated 283 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:30.732208 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e5076-d3e5-4dbe-8811-bc69654f1d66 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:30.742393 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e5076-d3e5-4dbe-8811-bc69654f1d66 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:30.747124 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d4d11-2c9f-49d4-9e71-3d0c5fce2462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:30.748017 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d4d11-2c9f-49d4-9e71-3d0c5fce2462 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:30.748291 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d4d11-2c9f-49d4-9e71-3d0c5fce2462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:30.748557 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d4d11-2c9f-49d4-9e71-3d0c5fce2462 admin admin] PATH_INFO: `/v3/projects/827891427e6b4c02918b6c82992d0bbb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:30.749794 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d4d11-2c9f-49d4-9e71-3d0c5fce2462 admin admin] RBAC: Authorizing `identity:get_project(project_id=827891427e6b4c02918b6c82992d0bbb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:30.751937 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d4d11-2c9f-49d4-9e71-3d0c5fce2462 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:30.753875 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 107/212] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:30 2021] GET /identity/v3/projects/827891427e6b4c02918b6c82992d0bbb => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:30.760206 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bea74-5bea-424e-8469-7af6d1ad373a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:30.770477 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bea74-5bea-424e-8469-7af6d1ad373a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:30.775176 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad3cc2-2aac-4ae2-b9c9-378d30f9c359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:30.776076 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad3cc2-2aac-4ae2-b9c9-378d30f9c359 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:30.776375 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad3cc2-2aac-4ae2-b9c9-378d30f9c359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:30.776644 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad3cc2-2aac-4ae2-b9c9-378d30f9c359 admin admin] PATH_INFO: `/v3/projects/827891427e6b4c02918b6c82992d0bbb/users/c926f34dc68845d0b756bbde4b6f9d46/roles/08b906e1585f45668d988e46a5d2659a` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:30.779029 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad3cc2-2aac-4ae2-b9c9-378d30f9c359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=827891427e6b4c02918b6c82992d0bbb, user_id=c926f34dc68845d0b756bbde4b6f9d46, role_id=08b906e1585f45668d988e46a5d2659a)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:30.781683 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad3cc2-2aac-4ae2-b9c9-378d30f9c359 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:30.796626 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 106/213] 10.222.0.79 () {58 vars in 1460 bytes} [Thu Oct 28 14:24:30 2021] PUT /identity/v3/projects/827891427e6b4c02918b6c82992d0bbb/users/c926f34dc68845d0b756bbde4b6f9d46/roles/08b906e1585f45668d988e46a5d2659a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:24:32.284816 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2fa75-22dc-492b-8ef0-911ea95c9750 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:32.285323 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2fa75-22dc-492b-8ef0-911ea95c9750 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:32.285323 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2fa75-22dc-492b-8ef0-911ea95c9750 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:32.287230 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 108/214] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:32.293769 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91beb71-f910-4083-9f95-d8755531254b None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:32.294251 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91beb71-f910-4083-9f95-d8755531254b None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:32.294324 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91beb71-f910-4083-9f95-d8755531254b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:32.319747 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-a91beb71-f910-4083-9f95-d8755531254b None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:32.320975 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-a91beb71-f910-4083-9f95-d8755531254b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:32.381657 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 107/215] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:32.423298 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2fa75-22dc-492b-8ef0-911ea95c9750 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:32.440402 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2fa75-22dc-492b-8ef0-911ea95c9750 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:32.444695 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e67e57-dad5-470d-abbb-1729a65aa078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:32.445485 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e67e57-dad5-470d-abbb-1729a65aa078 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:32.445756 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e67e57-dad5-470d-abbb-1729a65aa078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:32.446020 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e67e57-dad5-470d-abbb-1729a65aa078 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:32.461698 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e67e57-dad5-470d-abbb-1729a65aa078 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:32.468997 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-91e67e57-dad5-470d-abbb-1729a65aa078 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 14:24:32.470564 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 109/216] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:32 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:32.480326 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91beb71-f910-4083-9f95-d8755531254b None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:32.489539 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91beb71-f910-4083-9f95-d8755531254b None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:32.498863 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da418e8-53b9-4f25-8675-0332b7e13a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:32.499542 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da418e8-53b9-4f25-8675-0332b7e13a31 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:32.499877 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da418e8-53b9-4f25-8675-0332b7e13a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:32.500146 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da418e8-53b9-4f25-8675-0332b7e13a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:32.500917 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da418e8-53b9-4f25-8675-0332b7e13a31 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:32.501218 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da418e8-53b9-4f25-8675-0332b7e13a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:32.502839 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da418e8-53b9-4f25-8675-0332b7e13a31 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:32.514375 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 108/217] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Oct 28 14:24:32 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:32.520914 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e67e57-dad5-470d-abbb-1729a65aa078 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:32.531162 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e67e57-dad5-470d-abbb-1729a65aa078 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:32.538647 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33aa6d6-4756-4a09-aafc-ec861de8c0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:32.539499 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33aa6d6-4756-4a09-aafc-ec861de8c0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:32.539772 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33aa6d6-4756-4a09-aafc-ec861de8c0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:32.540041 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33aa6d6-4756-4a09-aafc-ec861de8c0b2 admin admin] PATH_INFO: `/v3/users/c926f34dc68845d0b756bbde4b6f9d46` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:32.541286 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33aa6d6-4756-4a09-aafc-ec861de8c0b2 admin admin] RBAC: Authorizing `identity:get_user(user_id=c926f34dc68845d0b756bbde4b6f9d46)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:32.543579 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33aa6d6-4756-4a09-aafc-ec861de8c0b2 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:32.545248 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 110/218] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:24:32 2021] GET /identity/v3/users/c926f34dc68845d0b756bbde4b6f9d46 => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:32.551917 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da418e8-53b9-4f25-8675-0332b7e13a31 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:32.562738 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da418e8-53b9-4f25-8675-0332b7e13a31 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:32.570690 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df71e6-3436-4b1e-8387-9e0003c15889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:32.571337 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df71e6-3436-4b1e-8387-9e0003c15889 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:32.571641 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df71e6-3436-4b1e-8387-9e0003c15889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:32.571962 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df71e6-3436-4b1e-8387-9e0003c15889 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:32.582023 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df71e6-3436-4b1e-8387-9e0003c15889 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:32.583800 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df71e6-3436-4b1e-8387-9e0003c15889 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:32.596236 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 109/219] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:32 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:32.603432 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33aa6d6-4756-4a09-aafc-ec861de8c0b2 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:32.615642 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33aa6d6-4756-4a09-aafc-ec861de8c0b2 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:32.621733 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557cec5-a9e9-4abd-848f-79aa09328cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:32.622595 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557cec5-a9e9-4abd-848f-79aa09328cbd admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:32.622924 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557cec5-a9e9-4abd-848f-79aa09328cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:32.623188 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557cec5-a9e9-4abd-848f-79aa09328cbd admin admin] PATH_INFO: `/v3/projects/827891427e6b4c02918b6c82992d0bbb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:32.624420 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557cec5-a9e9-4abd-848f-79aa09328cbd admin admin] RBAC: Authorizing `identity:get_project(project_id=827891427e6b4c02918b6c82992d0bbb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:32.626528 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557cec5-a9e9-4abd-848f-79aa09328cbd admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:32.628494 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 111/220] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:32 2021] GET /identity/v3/projects/827891427e6b4c02918b6c82992d0bbb => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:32.635217 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df71e6-3436-4b1e-8387-9e0003c15889 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:32.647643 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df71e6-3436-4b1e-8387-9e0003c15889 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:32.655852 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf92b1-f1c1-41ed-998b-231a6ebbd4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:32.656571 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf92b1-f1c1-41ed-998b-231a6ebbd4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:32.656847 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf92b1-f1c1-41ed-998b-231a6ebbd4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:32.657115 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf92b1-f1c1-41ed-998b-231a6ebbd4a3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:32.658130 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf92b1-f1c1-41ed-998b-231a6ebbd4a3 admin admin] RBAC: Adding query filter params (role.id=60f2c4ef9f6646108916900c5bce5845, scope.project.id=827891427e6b4c02918b6c82992d0bbb, user.id=c926f34dc68845d0b756bbde4b6f9d46) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:32.658438 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf92b1-f1c1-41ed-998b-231a6ebbd4a3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:32.660327 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf92b1-f1c1-41ed-998b-231a6ebbd4a3 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:32.669352 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 110/221] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:24:32 2021] GET /identity/v3/role_assignments?user.id=c926f34dc68845d0b756bbde4b6f9d46&scope.project.id=827891427e6b4c02918b6c82992d0bbb&role.id=60f2c4ef9f6646108916900c5bce5845 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:33.581935 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62235baf-9b4c-4f9c-bdf3-84abdd30d1e6 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:33.582484 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62235baf-9b4c-4f9c-bdf3-84abdd30d1e6 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:33.582484 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62235baf-9b4c-4f9c-bdf3-84abdd30d1e6 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:33.584626 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 112/222] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:33.590800 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b305eb6-1b50-4b1e-8908-a171687443ba None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:33.591252 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b305eb6-1b50-4b1e-8908-a171687443ba None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:33.591339 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b305eb6-1b50-4b1e-8908-a171687443ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:33.615983 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-5b305eb6-1b50-4b1e-8908-a171687443ba None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:33.617165 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-5b305eb6-1b50-4b1e-8908-a171687443ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:33.627867 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 111/223] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:33.665718 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62235baf-9b4c-4f9c-bdf3-84abdd30d1e6 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:33.679493 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62235baf-9b4c-4f9c-bdf3-84abdd30d1e6 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:33.685075 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43104785-ab34-4be3-af56-ffd602cd1b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:33.685901 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43104785-ab34-4be3-af56-ffd602cd1b5b admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:33.686168 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43104785-ab34-4be3-af56-ffd602cd1b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:33.686436 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43104785-ab34-4be3-af56-ffd602cd1b5b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:33.703927 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43104785-ab34-4be3-af56-ffd602cd1b5b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:33.711157 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-43104785-ab34-4be3-af56-ffd602cd1b5b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 14:24:33.712730 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 113/224] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Oct 28 14:24:33 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:33.719380 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b305eb6-1b50-4b1e-8908-a171687443ba None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:33.728632 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b305eb6-1b50-4b1e-8908-a171687443ba None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:33.734816 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51801c36-b52f-48e3-9256-bd7fd40ea23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:33.735492 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51801c36-b52f-48e3-9256-bd7fd40ea23a admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:33.735766 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51801c36-b52f-48e3-9256-bd7fd40ea23a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:33.736032 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51801c36-b52f-48e3-9256-bd7fd40ea23a admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:33.736800 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51801c36-b52f-48e3-9256-bd7fd40ea23a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:33.737101 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51801c36-b52f-48e3-9256-bd7fd40ea23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:33.738711 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51801c36-b52f-48e3-9256-bd7fd40ea23a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:33.750440 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 112/225] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:33 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:33.756584 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43104785-ab34-4be3-af56-ffd602cd1b5b admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:33.767752 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43104785-ab34-4be3-af56-ffd602cd1b5b admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:33.774453 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c3ee8-2e99-4c9c-9e8a-97d5fa886e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:33.775438 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c3ee8-2e99-4c9c-9e8a-97d5fa886e1f admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:33.775711 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c3ee8-2e99-4c9c-9e8a-97d5fa886e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:33.775979 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c3ee8-2e99-4c9c-9e8a-97d5fa886e1f admin admin] PATH_INFO: `/v3/users/c926f34dc68845d0b756bbde4b6f9d46` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:33.777187 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c3ee8-2e99-4c9c-9e8a-97d5fa886e1f admin admin] RBAC: Authorizing `identity:get_user(user_id=c926f34dc68845d0b756bbde4b6f9d46)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:33.779412 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c3ee8-2e99-4c9c-9e8a-97d5fa886e1f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:33.781224 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 114/226] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:24:33 2021] GET /identity/v3/users/c926f34dc68845d0b756bbde4b6f9d46 => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:33.790178 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51801c36-b52f-48e3-9256-bd7fd40ea23a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:33.801068 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51801c36-b52f-48e3-9256-bd7fd40ea23a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:33.811292 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e24e8-efee-48d3-8704-df5533525c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:33.811965 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e24e8-efee-48d3-8704-df5533525c40 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:33.812244 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e24e8-efee-48d3-8704-df5533525c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:33.812514 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e24e8-efee-48d3-8704-df5533525c40 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:33.826441 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e24e8-efee-48d3-8704-df5533525c40 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:33.828248 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e24e8-efee-48d3-8704-df5533525c40 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:33.829295 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb387763-48be-4072-8702-d04e2b349397 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:33.829581 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb387763-48be-4072-8702-d04e2b349397 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:33.830030 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb387763-48be-4072-8702-d04e2b349397 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:33.832066 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 115/227] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 14:24:33.840163 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776c232-e1ca-47e7-bd23-7f48ac401fde None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:33.840422 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776c232-e1ca-47e7-bd23-7f48ac401fde None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:33.840690 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776c232-e1ca-47e7-bd23-7f48ac401fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:33.842931 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 113/228] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:33 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:33.869441 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e24e8-efee-48d3-8704-df5533525c40 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:33.871671 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-6776c232-e1ca-47e7-bd23-7f48ac401fde None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:33.872887 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-6776c232-e1ca-47e7-bd23-7f48ac401fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:33.882094 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 116/229] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:24:33.885132 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e24e8-efee-48d3-8704-df5533525c40 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:33.895891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a17898-9b11-48bc-bc97-1b805db7a613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:33.896780 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a17898-9b11-48bc-bc97-1b805db7a613 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:33.897055 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a17898-9b11-48bc-bc97-1b805db7a613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:33.897327 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a17898-9b11-48bc-bc97-1b805db7a613 admin admin] PATH_INFO: `/v3/projects/827891427e6b4c02918b6c82992d0bbb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:33.903643 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a17898-9b11-48bc-bc97-1b805db7a613 admin admin] RBAC: Authorizing `identity:get_project(project_id=827891427e6b4c02918b6c82992d0bbb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:33.906700 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a17898-9b11-48bc-bc97-1b805db7a613 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:33.907562 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 114/230] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:33 2021] GET /identity/v3/projects/827891427e6b4c02918b6c82992d0bbb => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:33.913897 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776c232-e1ca-47e7-bd23-7f48ac401fde None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:33.929024 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776c232-e1ca-47e7-bd23-7f48ac401fde None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:33.937277 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77aec8c-aa07-430f-830b-09dee3755734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:33.937954 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aec8c-aa07-430f-830b-09dee3755734 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:33.938232 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aec8c-aa07-430f-830b-09dee3755734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:33.938496 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aec8c-aa07-430f-830b-09dee3755734 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:33.939659 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77aec8c-aa07-430f-830b-09dee3755734 admin admin] RBAC: Adding query filter params (role.id=08b906e1585f45668d988e46a5d2659a, scope.project.id=827891427e6b4c02918b6c82992d0bbb, user.id=c926f34dc68845d0b756bbde4b6f9d46) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:33.940009 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77aec8c-aa07-430f-830b-09dee3755734 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:33.941873 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77aec8c-aa07-430f-830b-09dee3755734 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:33.948779 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 117/231] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:24:33 2021] GET /identity/v3/role_assignments?user.id=c926f34dc68845d0b756bbde4b6f9d46&scope.project.id=827891427e6b4c02918b6c82992d0bbb&role.id=08b906e1585f45668d988e46a5d2659a => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:33.948948 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a17898-9b11-48bc-bc97-1b805db7a613 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:33.963573 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a17898-9b11-48bc-bc97-1b805db7a613 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:33.971099 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c08c6f-7bb0-4bb6-a5a3-2f19e8c103b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:33.971943 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c08c6f-7bb0-4bb6-a5a3-2f19e8c103b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:33.972224 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c08c6f-7bb0-4bb6-a5a3-2f19e8c103b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:33.972494 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c08c6f-7bb0-4bb6-a5a3-2f19e8c103b5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:33.995935 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c08c6f-7bb0-4bb6-a5a3-2f19e8c103b5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:34.003060 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-35c08c6f-7bb0-4bb6-a5a3-2f19e8c103b5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 14:24:34.004603 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 115/232] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:33 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:34.011441 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77aec8c-aa07-430f-830b-09dee3755734 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:34.024956 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77aec8c-aa07-430f-830b-09dee3755734 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:34.039514 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ae200-48e4-43ca-92dc-8790461179d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:34.040301 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ae200-48e4-43ca-92dc-8790461179d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:34.040573 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ae200-48e4-43ca-92dc-8790461179d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:34.040838 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ae200-48e4-43ca-92dc-8790461179d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:34.041672 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ae200-48e4-43ca-92dc-8790461179d9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:34.041963 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ae200-48e4-43ca-92dc-8790461179d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:34.043863 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ae200-48e4-43ca-92dc-8790461179d9 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:34.057368 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 118/233] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Oct 28 14:24:34 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:34.063985 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c08c6f-7bb0-4bb6-a5a3-2f19e8c103b5 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:34.080195 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c08c6f-7bb0-4bb6-a5a3-2f19e8c103b5 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:34.087880 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87766da9-b59a-488a-b8c0-58f8bd538de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:34.088485 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87766da9-b59a-488a-b8c0-58f8bd538de3 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:34.088766 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87766da9-b59a-488a-b8c0-58f8bd538de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:34.089038 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87766da9-b59a-488a-b8c0-58f8bd538de3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:34.106608 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87766da9-b59a-488a-b8c0-58f8bd538de3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:34.108466 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87766da9-b59a-488a-b8c0-58f8bd538de3 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:34.125097 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 116/234] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:34 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:34.131552 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ae200-48e4-43ca-92dc-8790461179d9 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:34.148909 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ae200-48e4-43ca-92dc-8790461179d9 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:34.163396 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db21ccd-8ce3-471d-a8c2-8f893632fe75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:34.164350 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db21ccd-8ce3-471d-a8c2-8f893632fe75 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:34.164665 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db21ccd-8ce3-471d-a8c2-8f893632fe75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:34.164932 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db21ccd-8ce3-471d-a8c2-8f893632fe75 admin admin] PATH_INFO: `/v3/projects/c0fc8be7ace747daba1f61a78ad61736` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:34.166199 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db21ccd-8ce3-471d-a8c2-8f893632fe75 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0fc8be7ace747daba1f61a78ad61736)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:34.168426 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db21ccd-8ce3-471d-a8c2-8f893632fe75 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:34.170178 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 119/235] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:34 2021] GET /identity/v3/projects/c0fc8be7ace747daba1f61a78ad61736 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:34.176853 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87766da9-b59a-488a-b8c0-58f8bd538de3 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:34.192843 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87766da9-b59a-488a-b8c0-58f8bd538de3 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:34.202228 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385aa16-6201-4bea-9b42-a0bdfcc71fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:34.203163 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385aa16-6201-4bea-9b42-a0bdfcc71fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:34.203439 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385aa16-6201-4bea-9b42-a0bdfcc71fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:34.203711 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385aa16-6201-4bea-9b42-a0bdfcc71fc3 admin admin] PATH_INFO: `/v3/groups/3fe325c9e2d04ac3af14eca796b05f42` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:34.213318 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385aa16-6201-4bea-9b42-a0bdfcc71fc3 admin admin] RBAC: Authorizing `identity:get_group(group_id=3fe325c9e2d04ac3af14eca796b05f42)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:34.214359 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING py.warnings [None req-2385aa16-6201-4bea-9b42-a0bdfcc71fc3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:24:34.214359 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: warnings.warn(msg) Oct 28 14:24:34.214359 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: Oct 28 14:24:34.215587 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385aa16-6201-4bea-9b42-a0bdfcc71fc3 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:34.217666 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 117/236] 10.222.0.79 () {56 vars in 1201 bytes} [Thu Oct 28 14:24:34 2021] GET /identity/v3/groups/3fe325c9e2d04ac3af14eca796b05f42 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:34.224243 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db21ccd-8ce3-471d-a8c2-8f893632fe75 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:34.239994 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db21ccd-8ce3-471d-a8c2-8f893632fe75 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:34.246645 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c6e40-ce35-439a-8f16-d5c24bc38d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:34.247402 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c6e40-ce35-439a-8f16-d5c24bc38d25 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:34.247676 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c6e40-ce35-439a-8f16-d5c24bc38d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:34.247948 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c6e40-ce35-439a-8f16-d5c24bc38d25 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:34.248895 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c6e40-ce35-439a-8f16-d5c24bc38d25 admin admin] RBAC: Adding query filter params (group.id=3fe325c9e2d04ac3af14eca796b05f42, role.id=60f2c4ef9f6646108916900c5bce5845, scope.project.id=c0fc8be7ace747daba1f61a78ad61736) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:34.249201 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c6e40-ce35-439a-8f16-d5c24bc38d25 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:34.251128 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c6e40-ce35-439a-8f16-d5c24bc38d25 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:34.256627 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936b9d3-34e3-4bc2-a831-602c8d85848c None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:34.256914 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936b9d3-34e3-4bc2-a831-602c8d85848c None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:34.257194 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936b9d3-34e3-4bc2-a831-602c8d85848c None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:34.260096 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 118/237] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:34.260984 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 120/238] 10.222.0.79 () {56 vars in 1397 bytes} [Thu Oct 28 14:24:34 2021] GET /identity/v3/role_assignments?group.id=3fe325c9e2d04ac3af14eca796b05f42&scope.project.id=c0fc8be7ace747daba1f61a78ad61736&role.id=60f2c4ef9f6646108916900c5bce5845 => generated 260 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:34.292330 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d4517-359a-496e-8979-11a6c89212e6 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:34.292692 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d4517-359a-496e-8979-11a6c89212e6 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:34.292887 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d4517-359a-496e-8979-11a6c89212e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:34.332870 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-151d4517-359a-496e-8979-11a6c89212e6 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:34.334126 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-151d4517-359a-496e-8979-11a6c89212e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:34.346867 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 119/239] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:24:34.389146 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c6e40-ce35-439a-8f16-d5c24bc38d25 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:34.399497 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c6e40-ce35-439a-8f16-d5c24bc38d25 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:34.408401 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e24f38-76fd-4628-abc5-1a7743c1c263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:34.409231 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e24f38-76fd-4628-abc5-1a7743c1c263 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:34.409503 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e24f38-76fd-4628-abc5-1a7743c1c263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:34.409768 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e24f38-76fd-4628-abc5-1a7743c1c263 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:34.424978 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e24f38-76fd-4628-abc5-1a7743c1c263 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:34.434181 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-12e24f38-76fd-4628-abc5-1a7743c1c263 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:24:34.435539 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 121/240] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:24:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:34.442522 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d4517-359a-496e-8979-11a6c89212e6 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:34.454388 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d4517-359a-496e-8979-11a6c89212e6 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:34.461224 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d3968-ea9a-4f59-9627-1694e5567ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:34.461925 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d3968-ea9a-4f59-9627-1694e5567ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:34.462240 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d3968-ea9a-4f59-9627-1694e5567ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:34.462508 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d3968-ea9a-4f59-9627-1694e5567ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:34.463332 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d3968-ea9a-4f59-9627-1694e5567ed3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:34.463624 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d3968-ea9a-4f59-9627-1694e5567ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:34.465269 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d3968-ea9a-4f59-9627-1694e5567ed3 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:34.479302 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 120/241] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:34.485730 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e24f38-76fd-4628-abc5-1a7743c1c263 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:34.497161 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e24f38-76fd-4628-abc5-1a7743c1c263 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:34.507299 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b823d7-4382-4fcf-9e4e-8af407e7f0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:34.508263 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b823d7-4382-4fcf-9e4e-8af407e7f0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:34.508536 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b823d7-4382-4fcf-9e4e-8af407e7f0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:34.508811 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b823d7-4382-4fcf-9e4e-8af407e7f0f0 admin admin] PATH_INFO: `/v3/users/04a56319092f4998a9d4cfc7569eb00c` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:34.515636 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b823d7-4382-4fcf-9e4e-8af407e7f0f0 admin admin] RBAC: Authorizing `identity:get_user(user_id=04a56319092f4998a9d4cfc7569eb00c)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:34.517623 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b823d7-4382-4fcf-9e4e-8af407e7f0f0 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:34.519675 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 122/242] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:24:34 2021] GET /identity/v3/users/04a56319092f4998a9d4cfc7569eb00c => generated 247 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:34.525784 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d3968-ea9a-4f59-9627-1694e5567ed3 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:34.540480 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d3968-ea9a-4f59-9627-1694e5567ed3 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:34.550994 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2dc71-723b-4a74-943b-ad7a25519b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:34.552037 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2dc71-723b-4a74-943b-ad7a25519b25 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:34.552315 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2dc71-723b-4a74-943b-ad7a25519b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:34.552587 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2dc71-723b-4a74-943b-ad7a25519b25 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:34.566554 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2dc71-723b-4a74-943b-ad7a25519b25 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:34.568395 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2dc71-723b-4a74-943b-ad7a25519b25 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:34.584987 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 121/243] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:34 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:34.588886 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d070dc-f25e-4f1b-82fc-7484a07dd9b1 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:34.589474 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d070dc-f25e-4f1b-82fc-7484a07dd9b1 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:34.589474 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d070dc-f25e-4f1b-82fc-7484a07dd9b1 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:34.591402 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 123/244] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:34.591589 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2dc71-723b-4a74-943b-ad7a25519b25 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:34.598939 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99378c14-b58c-44bc-bade-54425c1920ae None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:34.599240 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99378c14-b58c-44bc-bade-54425c1920ae None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:34.599399 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99378c14-b58c-44bc-bade-54425c1920ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:34.604225 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2dc71-723b-4a74-943b-ad7a25519b25 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:34.610557 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc445d-31cd-4a2e-a665-dcb9f95db1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:34.611489 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc445d-31cd-4a2e-a665-dcb9f95db1df admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:34.611767 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc445d-31cd-4a2e-a665-dcb9f95db1df admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:34.612046 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc445d-31cd-4a2e-a665-dcb9f95db1df admin admin] PATH_INFO: `/v3/projects/827891427e6b4c02918b6c82992d0bbb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:34.619615 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc445d-31cd-4a2e-a665-dcb9f95db1df admin admin] RBAC: Authorizing `identity:get_project(project_id=827891427e6b4c02918b6c82992d0bbb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:34.621835 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc445d-31cd-4a2e-a665-dcb9f95db1df admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:34.623872 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 122/245] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:34 2021] GET /identity/v3/projects/827891427e6b4c02918b6c82992d0bbb => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:34.626447 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-99378c14-b58c-44bc-bade-54425c1920ae None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:34.627683 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-99378c14-b58c-44bc-bade-54425c1920ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:34.630186 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc445d-31cd-4a2e-a665-dcb9f95db1df admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:34.644001 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc445d-31cd-4a2e-a665-dcb9f95db1df admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:34.645085 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 124/246] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:24:34.651427 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c863b3-3d65-4cff-ab94-09c26e637267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:34.652103 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c863b3-3d65-4cff-ab94-09c26e637267 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:34.652382 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c863b3-3d65-4cff-ab94-09c26e637267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:34.652650 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c863b3-3d65-4cff-ab94-09c26e637267 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:34.653519 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c863b3-3d65-4cff-ab94-09c26e637267 admin admin] RBAC: Adding query filter params (role.id=f7b8954a0fe64dc2b6146c7174498ddb, scope.project.id=827891427e6b4c02918b6c82992d0bbb, user.id=04a56319092f4998a9d4cfc7569eb00c) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:34.653823 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c863b3-3d65-4cff-ab94-09c26e637267 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:34.655868 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c863b3-3d65-4cff-ab94-09c26e637267 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:34.668073 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 123/247] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:24:34 2021] GET /identity/v3/role_assignments?user.id=04a56319092f4998a9d4cfc7569eb00c&scope.project.id=827891427e6b4c02918b6c82992d0bbb&role.id=f7b8954a0fe64dc2b6146c7174498ddb => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:34.675595 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99378c14-b58c-44bc-bade-54425c1920ae None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:34.690597 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99378c14-b58c-44bc-bade-54425c1920ae None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:34.699055 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4211c2-25a2-4806-83d7-99ef636fedb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:34.699958 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4211c2-25a2-4806-83d7-99ef636fedb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:34.700235 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4211c2-25a2-4806-83d7-99ef636fedb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:34.700499 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4211c2-25a2-4806-83d7-99ef636fedb4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:34.715501 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4211c2-25a2-4806-83d7-99ef636fedb4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:34.727151 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-5a4211c2-25a2-4806-83d7-99ef636fedb4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 14:24:34.728865 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 125/248] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Oct 28 14:24:34 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:34.735301 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c863b3-3d65-4cff-ab94-09c26e637267 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:34.751181 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c863b3-3d65-4cff-ab94-09c26e637267 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:34.758763 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b2937-a8fd-4873-915c-47b90cb0768a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:34.759495 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b2937-a8fd-4873-915c-47b90cb0768a admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:34.759770 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b2937-a8fd-4873-915c-47b90cb0768a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:34.760041 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b2937-a8fd-4873-915c-47b90cb0768a admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:34.760812 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b2937-a8fd-4873-915c-47b90cb0768a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:34.761110 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b2937-a8fd-4873-915c-47b90cb0768a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:34.762750 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b2937-a8fd-4873-915c-47b90cb0768a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:34.774430 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 124/249] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:34 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:34.781397 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4211c2-25a2-4806-83d7-99ef636fedb4 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:34.792225 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4211c2-25a2-4806-83d7-99ef636fedb4 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:34.802849 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f0458-45a2-4e79-89f7-62733b60dc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:34.803569 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f0458-45a2-4e79-89f7-62733b60dc50 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:34.803850 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f0458-45a2-4e79-89f7-62733b60dc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:34.804210 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f0458-45a2-4e79-89f7-62733b60dc50 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:34.814797 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f0458-45a2-4e79-89f7-62733b60dc50 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:34.816695 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f0458-45a2-4e79-89f7-62733b60dc50 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:34.831465 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 126/250] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:34 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:34.838355 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b2937-a8fd-4873-915c-47b90cb0768a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:34.853066 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b2937-a8fd-4873-915c-47b90cb0768a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:34.858727 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886db84-3fdd-47f3-9813-894bf104cc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:34.859613 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886db84-3fdd-47f3-9813-894bf104cc79 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:34.859891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886db84-3fdd-47f3-9813-894bf104cc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:34.860159 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886db84-3fdd-47f3-9813-894bf104cc79 admin admin] PATH_INFO: `/v3/projects/c0fc8be7ace747daba1f61a78ad61736` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:34.867715 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886db84-3fdd-47f3-9813-894bf104cc79 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0fc8be7ace747daba1f61a78ad61736)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:34.869892 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886db84-3fdd-47f3-9813-894bf104cc79 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:34.871740 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 125/251] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:34 2021] GET /identity/v3/projects/c0fc8be7ace747daba1f61a78ad61736 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:34.878145 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f0458-45a2-4e79-89f7-62733b60dc50 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:34.888164 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f0458-45a2-4e79-89f7-62733b60dc50 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:34.903553 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce004d6-a902-4d2e-8439-6bd3c226a3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:34.903553 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce004d6-a902-4d2e-8439-6bd3c226a3db admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:34.903553 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce004d6-a902-4d2e-8439-6bd3c226a3db admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:34.903553 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce004d6-a902-4d2e-8439-6bd3c226a3db admin admin] PATH_INFO: `/v3/groups/3fe325c9e2d04ac3af14eca796b05f42` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:34.904942 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce004d6-a902-4d2e-8439-6bd3c226a3db admin admin] RBAC: Authorizing `identity:get_group(group_id=3fe325c9e2d04ac3af14eca796b05f42)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:34.904942 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING py.warnings [None req-0ce004d6-a902-4d2e-8439-6bd3c226a3db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:24:34.904942 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: warnings.warn(msg) Oct 28 14:24:34.904942 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: Oct 28 14:24:34.904942 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce004d6-a902-4d2e-8439-6bd3c226a3db admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:34.909064 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 127/252] 10.222.0.79 () {56 vars in 1201 bytes} [Thu Oct 28 14:24:34 2021] GET /identity/v3/groups/3fe325c9e2d04ac3af14eca796b05f42 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:34.915902 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886db84-3fdd-47f3-9813-894bf104cc79 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:34.933266 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886db84-3fdd-47f3-9813-894bf104cc79 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:34.943103 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d54b6-fa95-494a-8b2d-0a45d4e8c83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:34.943789 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d54b6-fa95-494a-8b2d-0a45d4e8c83e admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:34.944108 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d54b6-fa95-494a-8b2d-0a45d4e8c83e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:34.944382 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d54b6-fa95-494a-8b2d-0a45d4e8c83e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:34.945287 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d54b6-fa95-494a-8b2d-0a45d4e8c83e admin admin] RBAC: Adding query filter params (group.id=3fe325c9e2d04ac3af14eca796b05f42, role.id=08b906e1585f45668d988e46a5d2659a, scope.project.id=c0fc8be7ace747daba1f61a78ad61736) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:34.945594 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d54b6-fa95-494a-8b2d-0a45d4e8c83e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:34.947633 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d54b6-fa95-494a-8b2d-0a45d4e8c83e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:34.959947 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 126/253] 10.222.0.79 () {56 vars in 1397 bytes} [Thu Oct 28 14:24:34 2021] GET /identity/v3/role_assignments?group.id=3fe325c9e2d04ac3af14eca796b05f42&scope.project.id=c0fc8be7ace747daba1f61a78ad61736&role.id=08b906e1585f45668d988e46a5d2659a => generated 260 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:35.707947 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4c605-f234-4ffb-899a-8792b87aa971 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:35.708629 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4c605-f234-4ffb-899a-8792b87aa971 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:35.708629 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4c605-f234-4ffb-899a-8792b87aa971 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:35.710253 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 128/254] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:35.728800 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdd814-4c9c-4762-97ce-bebbb899ef8e None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:35.729446 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdd814-4c9c-4762-97ce-bebbb899ef8e None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:35.729446 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdd814-4c9c-4762-97ce-bebbb899ef8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:35.758732 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-cbbdd814-4c9c-4762-97ce-bebbb899ef8e None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:35.759997 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-cbbdd814-4c9c-4762-97ce-bebbb899ef8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:35.768114 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 127/255] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:24:35.804975 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4c605-f234-4ffb-899a-8792b87aa971 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:35.822166 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4c605-f234-4ffb-899a-8792b87aa971 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:35.829149 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401866f-c79b-4bb1-8700-e90b98ce3ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:35.830371 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401866f-c79b-4bb1-8700-e90b98ce3ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:35.830840 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401866f-c79b-4bb1-8700-e90b98ce3ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:35.831260 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401866f-c79b-4bb1-8700-e90b98ce3ca7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:35.845526 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401866f-c79b-4bb1-8700-e90b98ce3ca7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:35.852564 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-d401866f-c79b-4bb1-8700-e90b98ce3ca7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 14:24:35.854074 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 129/256] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:35 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:35.860679 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdd814-4c9c-4762-97ce-bebbb899ef8e None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:35.869899 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdd814-4c9c-4762-97ce-bebbb899ef8e None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:35.882818 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10310eaf-185f-4c60-82de-d2efa1301afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:35.883510 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10310eaf-185f-4c60-82de-d2efa1301afb admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:35.883791 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10310eaf-185f-4c60-82de-d2efa1301afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:35.884141 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10310eaf-185f-4c60-82de-d2efa1301afb admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:35.884909 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10310eaf-185f-4c60-82de-d2efa1301afb admin admin] RBAC: Adding query filter params (name=member) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:35.885216 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10310eaf-185f-4c60-82de-d2efa1301afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:35.886841 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10310eaf-185f-4c60-82de-d2efa1301afb admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:35.899031 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 128/257] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Oct 28 14:24:35 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:35.906700 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401866f-c79b-4bb1-8700-e90b98ce3ca7 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:35.921454 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401866f-c79b-4bb1-8700-e90b98ce3ca7 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:35.927948 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3ace4-bace-4e1c-86ff-36fca8359a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:35.928610 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3ace4-bace-4e1c-86ff-36fca8359a4a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:35.928881 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3ace4-bace-4e1c-86ff-36fca8359a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:35.929148 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3ace4-bace-4e1c-86ff-36fca8359a4a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:35.940080 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3ace4-bace-4e1c-86ff-36fca8359a4a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:35.941823 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3ace4-bace-4e1c-86ff-36fca8359a4a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:35.955637 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 130/258] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:35 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:35.962309 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10310eaf-185f-4c60-82de-d2efa1301afb admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:35.980667 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10310eaf-185f-4c60-82de-d2efa1301afb admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:35.990014 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d05e88-ad62-4fd9-813d-bf22698d7b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:35.990913 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d05e88-ad62-4fd9-813d-bf22698d7b2b admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:35.991192 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d05e88-ad62-4fd9-813d-bf22698d7b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:35.991465 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d05e88-ad62-4fd9-813d-bf22698d7b2b admin admin] PATH_INFO: `/v3/projects/827891427e6b4c02918b6c82992d0bbb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:35.995440 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d05e88-ad62-4fd9-813d-bf22698d7b2b admin admin] RBAC: Authorizing `identity:get_project(project_id=827891427e6b4c02918b6c82992d0bbb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:35.997574 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d05e88-ad62-4fd9-813d-bf22698d7b2b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:35.999304 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 129/259] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:35 2021] GET /identity/v3/projects/827891427e6b4c02918b6c82992d0bbb => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:36.006124 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3ace4-bace-4e1c-86ff-36fca8359a4a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:36.021762 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3ace4-bace-4e1c-86ff-36fca8359a4a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:36.032721 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb6e71-30d3-4e32-8e84-6d7312b16068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:36.033608 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb6e71-30d3-4e32-8e84-6d7312b16068 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:36.033889 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb6e71-30d3-4e32-8e84-6d7312b16068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:36.034159 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb6e71-30d3-4e32-8e84-6d7312b16068 admin admin] PATH_INFO: `/v3/groups/3fe325c9e2d04ac3af14eca796b05f42` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:36.035385 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb6e71-30d3-4e32-8e84-6d7312b16068 admin admin] RBAC: Authorizing `identity:get_group(group_id=3fe325c9e2d04ac3af14eca796b05f42)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:36.037277 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb6e71-30d3-4e32-8e84-6d7312b16068 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:36.038925 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 131/260] 10.222.0.79 () {56 vars in 1201 bytes} [Thu Oct 28 14:24:36 2021] GET /identity/v3/groups/3fe325c9e2d04ac3af14eca796b05f42 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:36.045631 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d05e88-ad62-4fd9-813d-bf22698d7b2b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:36.056061 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d05e88-ad62-4fd9-813d-bf22698d7b2b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:36.066933 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6a04c-46bb-4c22-9cd7-690f26eba057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:36.067608 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6a04c-46bb-4c22-9cd7-690f26eba057 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:36.067891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6a04c-46bb-4c22-9cd7-690f26eba057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:36.068163 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6a04c-46bb-4c22-9cd7-690f26eba057 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:36.069019 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6a04c-46bb-4c22-9cd7-690f26eba057 admin admin] RBAC: Adding query filter params (group.id=3fe325c9e2d04ac3af14eca796b05f42, role.id=60f2c4ef9f6646108916900c5bce5845, scope.project.id=827891427e6b4c02918b6c82992d0bbb) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:36.069329 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6a04c-46bb-4c22-9cd7-690f26eba057 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:36.071229 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6a04c-46bb-4c22-9cd7-690f26eba057 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:36.081922 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 130/261] 10.222.0.79 () {56 vars in 1397 bytes} [Thu Oct 28 14:24:36 2021] GET /identity/v3/role_assignments?group.id=3fe325c9e2d04ac3af14eca796b05f42&scope.project.id=827891427e6b4c02918b6c82992d0bbb&role.id=60f2c4ef9f6646108916900c5bce5845 => generated 260 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:36.371789 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c962e91-910a-4757-ba48-a5f100a7742f None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:36.372139 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c962e91-910a-4757-ba48-a5f100a7742f None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:36.372314 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c962e91-910a-4757-ba48-a5f100a7742f None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:36.374377 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 132/262] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:36.381690 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22504977-fc2a-4cff-9fe3-5b18f0c2346c None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:36.382004 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22504977-fc2a-4cff-9fe3-5b18f0c2346c None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:36.382235 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22504977-fc2a-4cff-9fe3-5b18f0c2346c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:36.406967 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-22504977-fc2a-4cff-9fe3-5b18f0c2346c None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:36.408188 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-22504977-fc2a-4cff-9fe3-5b18f0c2346c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:36.416209 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 131/263] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:36.463174 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c962e91-910a-4757-ba48-a5f100a7742f None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:36.476782 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c962e91-910a-4757-ba48-a5f100a7742f None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:36.481830 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895f351-e70f-4dda-95fa-4348eb9baed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:36.482637 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895f351-e70f-4dda-95fa-4348eb9baed7 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:36.482934 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895f351-e70f-4dda-95fa-4348eb9baed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:36.483199 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895f351-e70f-4dda-95fa-4348eb9baed7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:36.495764 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895f351-e70f-4dda-95fa-4348eb9baed7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:36.511203 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-e895f351-e70f-4dda-95fa-4348eb9baed7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 14:24:36.512565 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 133/264] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Oct 28 14:24:36 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:36.519230 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22504977-fc2a-4cff-9fe3-5b18f0c2346c None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:36.531910 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22504977-fc2a-4cff-9fe3-5b18f0c2346c None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:36.536433 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4eb5d-61d7-4bf8-add1-7d97c1cfb4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:36.537109 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4eb5d-61d7-4bf8-add1-7d97c1cfb4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:36.538604 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4eb5d-61d7-4bf8-add1-7d97c1cfb4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:36.538929 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4eb5d-61d7-4bf8-add1-7d97c1cfb4a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:36.539769 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4eb5d-61d7-4bf8-add1-7d97c1cfb4a5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:36.540098 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4eb5d-61d7-4bf8-add1-7d97c1cfb4a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:36.541777 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4eb5d-61d7-4bf8-add1-7d97c1cfb4a5 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:36.551178 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 132/265] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:36 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:36.558067 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895f351-e70f-4dda-95fa-4348eb9baed7 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:36.568326 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895f351-e70f-4dda-95fa-4348eb9baed7 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:36.578820 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac73d6-5344-4b84-8754-aaa68a0d6e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:36.579523 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac73d6-5344-4b84-8754-aaa68a0d6e40 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:36.579797 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac73d6-5344-4b84-8754-aaa68a0d6e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:36.580066 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac73d6-5344-4b84-8754-aaa68a0d6e40 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:36.589371 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac73d6-5344-4b84-8754-aaa68a0d6e40 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:36.591226 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac73d6-5344-4b84-8754-aaa68a0d6e40 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:36.602972 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 134/266] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:36 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:36.609277 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4eb5d-61d7-4bf8-add1-7d97c1cfb4a5 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:36.619813 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4eb5d-61d7-4bf8-add1-7d97c1cfb4a5 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:36.626848 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87888563-1517-42dd-b5ce-3a1dcc8505e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:36.627696 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87888563-1517-42dd-b5ce-3a1dcc8505e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:36.627977 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87888563-1517-42dd-b5ce-3a1dcc8505e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:36.628290 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87888563-1517-42dd-b5ce-3a1dcc8505e5 admin admin] PATH_INFO: `/v3/projects/827891427e6b4c02918b6c82992d0bbb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:36.629501 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87888563-1517-42dd-b5ce-3a1dcc8505e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=827891427e6b4c02918b6c82992d0bbb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:36.631727 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87888563-1517-42dd-b5ce-3a1dcc8505e5 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:36.633619 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 133/267] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:36 2021] GET /identity/v3/projects/827891427e6b4c02918b6c82992d0bbb => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:36.640290 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac73d6-5344-4b84-8754-aaa68a0d6e40 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:36.650263 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac73d6-5344-4b84-8754-aaa68a0d6e40 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:36.659321 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193f8ed-407a-4f79-954b-f740799eda1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:36.660313 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193f8ed-407a-4f79-954b-f740799eda1d admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:36.660632 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193f8ed-407a-4f79-954b-f740799eda1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:36.660899 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193f8ed-407a-4f79-954b-f740799eda1d admin admin] PATH_INFO: `/v3/groups/3fe325c9e2d04ac3af14eca796b05f42` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:36.662301 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193f8ed-407a-4f79-954b-f740799eda1d admin admin] RBAC: Authorizing `identity:get_group(group_id=3fe325c9e2d04ac3af14eca796b05f42)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:36.664462 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193f8ed-407a-4f79-954b-f740799eda1d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:36.666403 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 135/268] 10.222.0.79 () {56 vars in 1201 bytes} [Thu Oct 28 14:24:36 2021] GET /identity/v3/groups/3fe325c9e2d04ac3af14eca796b05f42 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:36.673509 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87888563-1517-42dd-b5ce-3a1dcc8505e5 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:36.688469 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87888563-1517-42dd-b5ce-3a1dcc8505e5 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:36.694796 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5a281-bbd2-4ded-8d06-31c725bc9858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:36.695536 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5a281-bbd2-4ded-8d06-31c725bc9858 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:36.695815 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5a281-bbd2-4ded-8d06-31c725bc9858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:36.696083 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5a281-bbd2-4ded-8d06-31c725bc9858 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:36.697103 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5a281-bbd2-4ded-8d06-31c725bc9858 admin admin] RBAC: Adding query filter params (group.id=3fe325c9e2d04ac3af14eca796b05f42, role.id=08b906e1585f45668d988e46a5d2659a, scope.project.id=827891427e6b4c02918b6c82992d0bbb) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:36.697451 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5a281-bbd2-4ded-8d06-31c725bc9858 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:36.700787 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5a281-bbd2-4ded-8d06-31c725bc9858 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:36.707413 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 134/269] 10.222.0.79 () {56 vars in 1397 bytes} [Thu Oct 28 14:24:36 2021] GET /identity/v3/role_assignments?group.id=3fe325c9e2d04ac3af14eca796b05f42&scope.project.id=827891427e6b4c02918b6c82992d0bbb&role.id=08b906e1585f45668d988e46a5d2659a => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:36.817246 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c1467-3015-4816-8c53-d5343a6862b5 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:36.817908 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c1467-3015-4816-8c53-d5343a6862b5 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:36.817908 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c1467-3015-4816-8c53-d5343a6862b5 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:36.819602 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 136/270] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:36.825913 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360abf0-dc55-46cf-abed-77401e77c8e5 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:36.826388 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360abf0-dc55-46cf-abed-77401e77c8e5 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:36.826466 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360abf0-dc55-46cf-abed-77401e77c8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:36.855802 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-3360abf0-dc55-46cf-abed-77401e77c8e5 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:36.857045 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-3360abf0-dc55-46cf-abed-77401e77c8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:36.865299 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 135/271] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:36.918737 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c1467-3015-4816-8c53-d5343a6862b5 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:36.939163 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c1467-3015-4816-8c53-d5343a6862b5 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:36.945635 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786718c-bdea-41dc-ac03-c504db4320d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:36.946941 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786718c-bdea-41dc-ac03-c504db4320d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:36.947453 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786718c-bdea-41dc-ac03-c504db4320d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:36.947961 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786718c-bdea-41dc-ac03-c504db4320d0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:36.963774 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786718c-bdea-41dc-ac03-c504db4320d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:36.971403 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-f786718c-bdea-41dc-ac03-c504db4320d0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:24:36.973476 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 137/272] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:24:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:36.979819 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360abf0-dc55-46cf-abed-77401e77c8e5 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:36.989468 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360abf0-dc55-46cf-abed-77401e77c8e5 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:37.002628 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d3bc7-f5e0-4699-9f91-bf3ea65e1614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:37.003354 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d3bc7-f5e0-4699-9f91-bf3ea65e1614 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:37.003639 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d3bc7-f5e0-4699-9f91-bf3ea65e1614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:37.003913 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d3bc7-f5e0-4699-9f91-bf3ea65e1614 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:37.004694 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d3bc7-f5e0-4699-9f91-bf3ea65e1614 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:37.004998 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d3bc7-f5e0-4699-9f91-bf3ea65e1614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:37.006628 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d3bc7-f5e0-4699-9f91-bf3ea65e1614 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:37.017060 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 136/273] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:37.023338 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786718c-bdea-41dc-ac03-c504db4320d0 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:37.033912 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786718c-bdea-41dc-ac03-c504db4320d0 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:37.038519 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25ccd3-1cbc-4e17-b7a5-ac776803db68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:37.039250 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25ccd3-1cbc-4e17-b7a5-ac776803db68 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:37.039536 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25ccd3-1cbc-4e17-b7a5-ac776803db68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:37.039811 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25ccd3-1cbc-4e17-b7a5-ac776803db68 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:37.049181 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25ccd3-1cbc-4e17-b7a5-ac776803db68 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:37.051061 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25ccd3-1cbc-4e17-b7a5-ac776803db68 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:37.061315 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 138/274] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:37 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:37.070855 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d3bc7-f5e0-4699-9f91-bf3ea65e1614 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:37.081101 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d3bc7-f5e0-4699-9f91-bf3ea65e1614 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:37.085855 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641d727-40dd-475e-962c-2647ff0e1f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:37.086806 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641d727-40dd-475e-962c-2647ff0e1f2b admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:37.087161 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641d727-40dd-475e-962c-2647ff0e1f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:37.087438 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641d727-40dd-475e-962c-2647ff0e1f2b admin admin] PATH_INFO: `/v3/projects/7760de20f300416cbabf0f95c42b2e83` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:37.088705 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641d727-40dd-475e-962c-2647ff0e1f2b admin admin] RBAC: Authorizing `identity:get_project(project_id=7760de20f300416cbabf0f95c42b2e83)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:37.090617 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641d727-40dd-475e-962c-2647ff0e1f2b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:37.092432 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 137/275] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:37 2021] GET /identity/v3/projects/7760de20f300416cbabf0f95c42b2e83 => generated 344 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:37.098755 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25ccd3-1cbc-4e17-b7a5-ac776803db68 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:37.108281 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25ccd3-1cbc-4e17-b7a5-ac776803db68 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:37.115601 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f2cab-92aa-4e60-8d42-050b5d25cd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:37.116467 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f2cab-92aa-4e60-8d42-050b5d25cd39 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:37.116788 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f2cab-92aa-4e60-8d42-050b5d25cd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:37.117057 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f2cab-92aa-4e60-8d42-050b5d25cd39 admin admin] PATH_INFO: `/v3/groups/ce2f8c650eb147459d027aaa839a8668` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:37.124027 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f2cab-92aa-4e60-8d42-050b5d25cd39 admin admin] RBAC: Authorizing `identity:get_group(group_id=ce2f8c650eb147459d027aaa839a8668)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:37.126016 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f2cab-92aa-4e60-8d42-050b5d25cd39 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:37.127991 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 139/276] 10.222.0.79 () {56 vars in 1201 bytes} [Thu Oct 28 14:24:37 2021] GET /identity/v3/groups/ce2f8c650eb147459d027aaa839a8668 => generated 229 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:37.135418 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641d727-40dd-475e-962c-2647ff0e1f2b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:37.151922 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641d727-40dd-475e-962c-2647ff0e1f2b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:37.161881 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9243f-ec47-46a0-82db-f4c1159a45ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:37.162494 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9243f-ec47-46a0-82db-f4c1159a45ad admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:37.162797 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9243f-ec47-46a0-82db-f4c1159a45ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:37.163066 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9243f-ec47-46a0-82db-f4c1159a45ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:37.163919 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9243f-ec47-46a0-82db-f4c1159a45ad admin admin] RBAC: Adding query filter params (group.id=ce2f8c650eb147459d027aaa839a8668, role.id=f7b8954a0fe64dc2b6146c7174498ddb, scope.project.id=7760de20f300416cbabf0f95c42b2e83) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:37.164225 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9243f-ec47-46a0-82db-f4c1159a45ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:37.166125 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9243f-ec47-46a0-82db-f4c1159a45ad admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:37.174865 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 138/277] 10.222.0.79 () {56 vars in 1397 bytes} [Thu Oct 28 14:24:37 2021] GET /identity/v3/role_assignments?group.id=ce2f8c650eb147459d027aaa839a8668&scope.project.id=7760de20f300416cbabf0f95c42b2e83&role.id=f7b8954a0fe64dc2b6146c7174498ddb => generated 260 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:37.553365 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b97e7-0d32-4e56-845a-2d0dd1bd16bc None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:37.553720 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b97e7-0d32-4e56-845a-2d0dd1bd16bc None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:37.553837 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b97e7-0d32-4e56-845a-2d0dd1bd16bc None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:37.555820 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 140/278] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:37.562421 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e196329-13b3-40b9-a695-9a392f730b10 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:37.563047 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e196329-13b3-40b9-a695-9a392f730b10 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:37.563521 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e196329-13b3-40b9-a695-9a392f730b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:37.591862 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-2e196329-13b3-40b9-a695-9a392f730b10 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:37.593449 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-2e196329-13b3-40b9-a695-9a392f730b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:37.602756 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 139/279] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:24:37.631820 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b97e7-0d32-4e56-845a-2d0dd1bd16bc None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:37.645508 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b97e7-0d32-4e56-845a-2d0dd1bd16bc None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:37.655523 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f443b-6587-436d-b4dd-6e2210fea54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:37.656340 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f443b-6587-436d-b4dd-6e2210fea54d admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:37.656666 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f443b-6587-436d-b4dd-6e2210fea54d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:37.656935 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f443b-6587-436d-b4dd-6e2210fea54d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:37.668399 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f443b-6587-436d-b4dd-6e2210fea54d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:37.681420 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-ee5f443b-6587-436d-b4dd-6e2210fea54d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 14:24:37.682888 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 141/280] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:37 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:37.689303 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e196329-13b3-40b9-a695-9a392f730b10 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:37.705136 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e196329-13b3-40b9-a695-9a392f730b10 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:37.714978 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed72be-5fa9-47e1-92cf-3a2242f0d0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:37.716021 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed72be-5fa9-47e1-92cf-3a2242f0d0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:37.716522 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed72be-5fa9-47e1-92cf-3a2242f0d0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:37.716995 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed72be-5fa9-47e1-92cf-3a2242f0d0d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:37.717961 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed72be-5fa9-47e1-92cf-3a2242f0d0d7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:37.718464 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed72be-5fa9-47e1-92cf-3a2242f0d0d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:37.720321 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed72be-5fa9-47e1-92cf-3a2242f0d0d7 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:37.734757 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 140/281] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Oct 28 14:24:37 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:37.740821 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f443b-6587-436d-b4dd-6e2210fea54d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:37.751961 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f443b-6587-436d-b4dd-6e2210fea54d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:37.763088 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5182a2a-72b0-4fb2-ab8c-82aaeb6324bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:37.764030 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5182a2a-72b0-4fb2-ab8c-82aaeb6324bf admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:37.764351 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5182a2a-72b0-4fb2-ab8c-82aaeb6324bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:37.764631 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5182a2a-72b0-4fb2-ab8c-82aaeb6324bf admin admin] PATH_INFO: `/v3/groups/3fe325c9e2d04ac3af14eca796b05f42` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:37.765868 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5182a2a-72b0-4fb2-ab8c-82aaeb6324bf admin admin] RBAC: Authorizing `identity:get_group(group_id=3fe325c9e2d04ac3af14eca796b05f42)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:37.767918 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5182a2a-72b0-4fb2-ab8c-82aaeb6324bf admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:37.769603 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 142/282] 10.222.0.79 () {56 vars in 1201 bytes} [Thu Oct 28 14:24:37 2021] GET /identity/v3/groups/3fe325c9e2d04ac3af14eca796b05f42 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:37.775877 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed72be-5fa9-47e1-92cf-3a2242f0d0d7 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:37.791871 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed72be-5fa9-47e1-92cf-3a2242f0d0d7 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:37.804938 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06d356-f862-432c-a77f-d7515fe4af2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:37.806291 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06d356-f862-432c-a77f-d7515fe4af2a admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:37.806801 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06d356-f862-432c-a77f-d7515fe4af2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:37.807281 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06d356-f862-432c-a77f-d7515fe4af2a admin admin] PATH_INFO: `/v3/projects/c0fc8be7ace747daba1f61a78ad61736` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:37.811625 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06d356-f862-432c-a77f-d7515fe4af2a admin admin] RBAC: Authorizing `identity:get_project(project_id=c0fc8be7ace747daba1f61a78ad61736)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:37.814079 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06d356-f862-432c-a77f-d7515fe4af2a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:37.816213 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 141/283] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:37 2021] GET /identity/v3/projects/c0fc8be7ace747daba1f61a78ad61736 => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:37.823356 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5182a2a-72b0-4fb2-ab8c-82aaeb6324bf admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:37.834481 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5182a2a-72b0-4fb2-ab8c-82aaeb6324bf admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:37.846553 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113ca91-d2ad-4088-822c-f9ebf95f02f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:37.847560 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113ca91-d2ad-4088-822c-f9ebf95f02f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:37.847842 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113ca91-d2ad-4088-822c-f9ebf95f02f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:37.848119 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113ca91-d2ad-4088-822c-f9ebf95f02f4 admin admin] PATH_INFO: `/v3/projects/c0fc8be7ace747daba1f61a78ad61736/groups/3fe325c9e2d04ac3af14eca796b05f42/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:37.850443 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113ca91-d2ad-4088-822c-f9ebf95f02f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0fc8be7ace747daba1f61a78ad61736, group_id=3fe325c9e2d04ac3af14eca796b05f42, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:37.853420 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113ca91-d2ad-4088-822c-f9ebf95f02f4 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:37.877427 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 143/284] 10.222.0.79 () {58 vars in 1463 bytes} [Thu Oct 28 14:24:37 2021] PUT /identity/v3/projects/c0fc8be7ace747daba1f61a78ad61736/groups/3fe325c9e2d04ac3af14eca796b05f42/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:24:38.072692 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97ae0e-3a9a-4964-8b8d-ef111b3d576f None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:38.073194 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97ae0e-3a9a-4964-8b8d-ef111b3d576f None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:38.073194 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97ae0e-3a9a-4964-8b8d-ef111b3d576f None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:38.075297 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 142/285] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:38.081943 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590918a4-d212-42bf-b25e-31add0e37d33 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:38.082237 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590918a4-d212-42bf-b25e-31add0e37d33 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:38.082561 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590918a4-d212-42bf-b25e-31add0e37d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:38.100603 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-590918a4-d212-42bf-b25e-31add0e37d33 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:38.101798 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-590918a4-d212-42bf-b25e-31add0e37d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:38.181884 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 144/286] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:38.208710 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97ae0e-3a9a-4964-8b8d-ef111b3d576f None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:38.221718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97ae0e-3a9a-4964-8b8d-ef111b3d576f None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:38.229872 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3bc57-b10c-48e0-a182-90c1a11b8c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:38.230845 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3bc57-b10c-48e0-a182-90c1a11b8c44 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:38.231176 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3bc57-b10c-48e0-a182-90c1a11b8c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:38.231504 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3bc57-b10c-48e0-a182-90c1a11b8c44 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:38.245562 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3bc57-b10c-48e0-a182-90c1a11b8c44 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:38.253096 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-a7c3bc57-b10c-48e0-a182-90c1a11b8c44 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 14:24:38.254768 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 143/287] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Oct 28 14:24:38 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:38.261243 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590918a4-d212-42bf-b25e-31add0e37d33 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:38.270909 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590918a4-d212-42bf-b25e-31add0e37d33 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:38.275610 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8b464-6fc0-4426-93f6-e909bae9d3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:38.276348 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8b464-6fc0-4426-93f6-e909bae9d3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:38.276626 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8b464-6fc0-4426-93f6-e909bae9d3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:38.276902 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8b464-6fc0-4426-93f6-e909bae9d3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:38.277682 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8b464-6fc0-4426-93f6-e909bae9d3b2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:38.278043 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8b464-6fc0-4426-93f6-e909bae9d3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:38.279699 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8b464-6fc0-4426-93f6-e909bae9d3b2 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:38.289172 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 145/288] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:38 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:38.296165 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3bc57-b10c-48e0-a182-90c1a11b8c44 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:38.307685 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3bc57-b10c-48e0-a182-90c1a11b8c44 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:38.317262 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcec9e0-456e-4e01-801e-e3f89bfa0c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:38.318196 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcec9e0-456e-4e01-801e-e3f89bfa0c55 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:38.318473 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcec9e0-456e-4e01-801e-e3f89bfa0c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:38.318868 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcec9e0-456e-4e01-801e-e3f89bfa0c55 admin admin] PATH_INFO: `/v3/groups/3fe325c9e2d04ac3af14eca796b05f42` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:38.320157 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcec9e0-456e-4e01-801e-e3f89bfa0c55 admin admin] RBAC: Authorizing `identity:get_group(group_id=3fe325c9e2d04ac3af14eca796b05f42)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:38.322400 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcec9e0-456e-4e01-801e-e3f89bfa0c55 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:38.324578 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 144/289] 10.222.0.79 () {56 vars in 1201 bytes} [Thu Oct 28 14:24:38 2021] GET /identity/v3/groups/3fe325c9e2d04ac3af14eca796b05f42 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:38.330908 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8b464-6fc0-4426-93f6-e909bae9d3b2 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:38.341006 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8b464-6fc0-4426-93f6-e909bae9d3b2 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:38.346048 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf7307-4bc1-43f1-8a8b-b487d51b1335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:38.346960 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf7307-4bc1-43f1-8a8b-b487d51b1335 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:38.347239 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf7307-4bc1-43f1-8a8b-b487d51b1335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:38.347514 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf7307-4bc1-43f1-8a8b-b487d51b1335 admin admin] PATH_INFO: `/v3/projects/c0fc8be7ace747daba1f61a78ad61736` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:38.348759 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf7307-4bc1-43f1-8a8b-b487d51b1335 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0fc8be7ace747daba1f61a78ad61736)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:38.350860 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf7307-4bc1-43f1-8a8b-b487d51b1335 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:38.352875 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 146/290] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:38 2021] GET /identity/v3/projects/c0fc8be7ace747daba1f61a78ad61736 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:38.360413 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcec9e0-456e-4e01-801e-e3f89bfa0c55 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:38.375855 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcec9e0-456e-4e01-801e-e3f89bfa0c55 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:38.381236 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28b816-51bf-48fd-bba3-9d1948d4ac6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:38.382172 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28b816-51bf-48fd-bba3-9d1948d4ac6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:38.382450 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28b816-51bf-48fd-bba3-9d1948d4ac6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:38.382734 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28b816-51bf-48fd-bba3-9d1948d4ac6a admin admin] PATH_INFO: `/v3/projects/c0fc8be7ace747daba1f61a78ad61736/groups/3fe325c9e2d04ac3af14eca796b05f42/roles/08b906e1585f45668d988e46a5d2659a` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:38.385152 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28b816-51bf-48fd-bba3-9d1948d4ac6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0fc8be7ace747daba1f61a78ad61736, group_id=3fe325c9e2d04ac3af14eca796b05f42, role_id=08b906e1585f45668d988e46a5d2659a)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:38.388072 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28b816-51bf-48fd-bba3-9d1948d4ac6a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:38.417104 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 145/291] 10.222.0.79 () {58 vars in 1463 bytes} [Thu Oct 28 14:24:38 2021] PUT /identity/v3/projects/c0fc8be7ace747daba1f61a78ad61736/groups/3fe325c9e2d04ac3af14eca796b05f42/roles/08b906e1585f45668d988e46a5d2659a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:24:39.286794 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7e346-378b-4adc-a933-d4d7bffffd0a None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:39.286794 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7e346-378b-4adc-a933-d4d7bffffd0a None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:39.286794 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7e346-378b-4adc-a933-d4d7bffffd0a None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:39.288412 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 147/292] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:39 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:39.296759 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a46c3-2e15-43ba-8a18-7abe706b54b1 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:39.297281 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a46c3-2e15-43ba-8a18-7abe706b54b1 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:39.297438 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a46c3-2e15-43ba-8a18-7abe706b54b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:39.323680 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-a76a46c3-2e15-43ba-8a18-7abe706b54b1 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:39.324890 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-a76a46c3-2e15-43ba-8a18-7abe706b54b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:39.391157 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 146/293] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:24:39.429780 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7e346-378b-4adc-a933-d4d7bffffd0a None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:39.449544 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7e346-378b-4adc-a933-d4d7bffffd0a None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:39.458410 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b8c64-d9d5-4b25-a253-b7d5053f6a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:39.459246 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b8c64-d9d5-4b25-a253-b7d5053f6a6a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:39.459532 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b8c64-d9d5-4b25-a253-b7d5053f6a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:39.459804 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b8c64-d9d5-4b25-a253-b7d5053f6a6a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:39.475084 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b8c64-d9d5-4b25-a253-b7d5053f6a6a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:39.482160 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-e62b8c64-d9d5-4b25-a253-b7d5053f6a6a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 14:24:39.483479 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 148/294] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:39.490215 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a46c3-2e15-43ba-8a18-7abe706b54b1 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:39.503794 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a46c3-2e15-43ba-8a18-7abe706b54b1 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:39.514935 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4954e8-1317-472c-83a5-aaaf56c7dcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:39.515634 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4954e8-1317-472c-83a5-aaaf56c7dcfe admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:39.515911 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4954e8-1317-472c-83a5-aaaf56c7dcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:39.516184 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4954e8-1317-472c-83a5-aaaf56c7dcfe admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:39.516974 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4954e8-1317-472c-83a5-aaaf56c7dcfe admin admin] RBAC: Adding query filter params (name=member) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:39.517283 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4954e8-1317-472c-83a5-aaaf56c7dcfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:39.518991 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4954e8-1317-472c-83a5-aaaf56c7dcfe admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:39.530905 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 147/295] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Oct 28 14:24:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:39.537218 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b8c64-d9d5-4b25-a253-b7d5053f6a6a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:39.552863 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b8c64-d9d5-4b25-a253-b7d5053f6a6a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:39.558938 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780563b-ec73-4be0-b7ad-dd5355d07a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:39.560043 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780563b-ec73-4be0-b7ad-dd5355d07a48 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:39.560505 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780563b-ec73-4be0-b7ad-dd5355d07a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:39.560919 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780563b-ec73-4be0-b7ad-dd5355d07a48 admin admin] PATH_INFO: `/v3/groups/3fe325c9e2d04ac3af14eca796b05f42` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:39.562301 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780563b-ec73-4be0-b7ad-dd5355d07a48 admin admin] RBAC: Authorizing `identity:get_group(group_id=3fe325c9e2d04ac3af14eca796b05f42)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:39.568595 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780563b-ec73-4be0-b7ad-dd5355d07a48 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:39.570523 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 149/296] 10.222.0.79 () {56 vars in 1201 bytes} [Thu Oct 28 14:24:39 2021] GET /identity/v3/groups/3fe325c9e2d04ac3af14eca796b05f42 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:39.577073 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4954e8-1317-472c-83a5-aaaf56c7dcfe admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:39.588007 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4954e8-1317-472c-83a5-aaaf56c7dcfe admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:39.598877 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90102f32-f57e-431f-8a4e-7a37edc9f651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:39.599759 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90102f32-f57e-431f-8a4e-7a37edc9f651 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:39.600036 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90102f32-f57e-431f-8a4e-7a37edc9f651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:39.600309 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90102f32-f57e-431f-8a4e-7a37edc9f651 admin admin] PATH_INFO: `/v3/projects/827891427e6b4c02918b6c82992d0bbb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:39.607553 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90102f32-f57e-431f-8a4e-7a37edc9f651 admin admin] RBAC: Authorizing `identity:get_project(project_id=827891427e6b4c02918b6c82992d0bbb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:39.610070 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90102f32-f57e-431f-8a4e-7a37edc9f651 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:39.612622 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 148/297] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:39 2021] GET /identity/v3/projects/827891427e6b4c02918b6c82992d0bbb => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:39.619234 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780563b-ec73-4be0-b7ad-dd5355d07a48 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:39.629990 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780563b-ec73-4be0-b7ad-dd5355d07a48 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:39.639077 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df46dc-1688-4a48-b93a-81fa9cd14dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:39.640492 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df46dc-1688-4a48-b93a-81fa9cd14dbf admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:39.641056 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df46dc-1688-4a48-b93a-81fa9cd14dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:39.641561 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df46dc-1688-4a48-b93a-81fa9cd14dbf admin admin] PATH_INFO: `/v3/projects/827891427e6b4c02918b6c82992d0bbb/groups/3fe325c9e2d04ac3af14eca796b05f42/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:39.643937 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df46dc-1688-4a48-b93a-81fa9cd14dbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=827891427e6b4c02918b6c82992d0bbb, group_id=3fe325c9e2d04ac3af14eca796b05f42, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:39.647091 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df46dc-1688-4a48-b93a-81fa9cd14dbf admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:39.675141 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 150/298] 10.222.0.79 () {58 vars in 1463 bytes} [Thu Oct 28 14:24:39 2021] PUT /identity/v3/projects/827891427e6b4c02918b6c82992d0bbb/groups/3fe325c9e2d04ac3af14eca796b05f42/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:24:39.890659 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf51b22-ec19-48b1-b6a5-250d3b80aa2b None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:39.890869 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf51b22-ec19-48b1-b6a5-250d3b80aa2b None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:39.891193 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf51b22-ec19-48b1-b6a5-250d3b80aa2b None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:39.893187 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 149/299] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:39.905360 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc925251-0678-4dd9-b468-1b6a9fa9e0b5 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:39.905881 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc925251-0678-4dd9-b468-1b6a9fa9e0b5 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:39.906362 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc925251-0678-4dd9-b468-1b6a9fa9e0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:39.940143 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-cc925251-0678-4dd9-b468-1b6a9fa9e0b5 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:39.941756 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-cc925251-0678-4dd9-b468-1b6a9fa9e0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:40.013839 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 151/300] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:40.038824 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf51b22-ec19-48b1-b6a5-250d3b80aa2b None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:40.056739 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf51b22-ec19-48b1-b6a5-250d3b80aa2b None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:40.061283 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e25252-cfd5-4a3a-9f62-cfbe090ecc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:40.062097 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e25252-cfd5-4a3a-9f62-cfbe090ecc1b admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:40.062371 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e25252-cfd5-4a3a-9f62-cfbe090ecc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:40.062632 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e25252-cfd5-4a3a-9f62-cfbe090ecc1b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:40.076110 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e25252-cfd5-4a3a-9f62-cfbe090ecc1b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:40.084840 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-66e25252-cfd5-4a3a-9f62-cfbe090ecc1b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 14:24:40.086325 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 150/301] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Oct 28 14:24:40 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:40.096739 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc925251-0678-4dd9-b468-1b6a9fa9e0b5 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:40.107698 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc925251-0678-4dd9-b468-1b6a9fa9e0b5 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:40.114087 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31338d23-bc29-42e2-9d42-a1abe2b9cb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:40.115107 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31338d23-bc29-42e2-9d42-a1abe2b9cb96 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:40.115596 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31338d23-bc29-42e2-9d42-a1abe2b9cb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:40.116096 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31338d23-bc29-42e2-9d42-a1abe2b9cb96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:40.117071 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31338d23-bc29-42e2-9d42-a1abe2b9cb96 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:40.117576 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31338d23-bc29-42e2-9d42-a1abe2b9cb96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:40.119568 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31338d23-bc29-42e2-9d42-a1abe2b9cb96 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:40.133550 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 152/302] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:40 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:40.140290 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e25252-cfd5-4a3a-9f62-cfbe090ecc1b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:40.152853 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e25252-cfd5-4a3a-9f62-cfbe090ecc1b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:40.158569 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd11b0f-3ec2-4906-929e-8a983c94aa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:40.159489 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd11b0f-3ec2-4906-929e-8a983c94aa9e admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:40.159765 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd11b0f-3ec2-4906-929e-8a983c94aa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:40.160033 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd11b0f-3ec2-4906-929e-8a983c94aa9e admin admin] PATH_INFO: `/v3/groups/3fe325c9e2d04ac3af14eca796b05f42` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:40.161276 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd11b0f-3ec2-4906-929e-8a983c94aa9e admin admin] RBAC: Authorizing `identity:get_group(group_id=3fe325c9e2d04ac3af14eca796b05f42)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:40.163225 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd11b0f-3ec2-4906-929e-8a983c94aa9e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:40.165056 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 151/303] 10.222.0.79 () {56 vars in 1201 bytes} [Thu Oct 28 14:24:40 2021] GET /identity/v3/groups/3fe325c9e2d04ac3af14eca796b05f42 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:40.172497 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31338d23-bc29-42e2-9d42-a1abe2b9cb96 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:40.183352 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31338d23-bc29-42e2-9d42-a1abe2b9cb96 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:40.189816 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b26a1b-57b7-4dfc-ba86-8c55f20b6eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:40.190713 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b26a1b-57b7-4dfc-ba86-8c55f20b6eda admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:40.191027 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b26a1b-57b7-4dfc-ba86-8c55f20b6eda admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:40.191294 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b26a1b-57b7-4dfc-ba86-8c55f20b6eda admin admin] PATH_INFO: `/v3/projects/827891427e6b4c02918b6c82992d0bbb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:40.192517 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b26a1b-57b7-4dfc-ba86-8c55f20b6eda admin admin] RBAC: Authorizing `identity:get_project(project_id=827891427e6b4c02918b6c82992d0bbb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:40.194667 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b26a1b-57b7-4dfc-ba86-8c55f20b6eda admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:40.196707 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 153/304] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:40 2021] GET /identity/v3/projects/827891427e6b4c02918b6c82992d0bbb => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:40.202999 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd11b0f-3ec2-4906-929e-8a983c94aa9e admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:40.213256 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd11b0f-3ec2-4906-929e-8a983c94aa9e admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:40.217602 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508d915-c202-402b-9693-361f96d7d18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:40.218535 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508d915-c202-402b-9693-361f96d7d18d admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:40.218824 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508d915-c202-402b-9693-361f96d7d18d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:40.219094 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508d915-c202-402b-9693-361f96d7d18d admin admin] PATH_INFO: `/v3/projects/827891427e6b4c02918b6c82992d0bbb/groups/3fe325c9e2d04ac3af14eca796b05f42/roles/08b906e1585f45668d988e46a5d2659a` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:40.221285 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508d915-c202-402b-9693-361f96d7d18d admin admin] RBAC: Authorizing `identity:create_grant(project_id=827891427e6b4c02918b6c82992d0bbb, group_id=3fe325c9e2d04ac3af14eca796b05f42, role_id=08b906e1585f45668d988e46a5d2659a)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:40.223960 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508d915-c202-402b-9693-361f96d7d18d admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:40.246942 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 152/305] 10.222.0.79 () {58 vars in 1463 bytes} [Thu Oct 28 14:24:40 2021] PUT /identity/v3/projects/827891427e6b4c02918b6c82992d0bbb/groups/3fe325c9e2d04ac3af14eca796b05f42/roles/08b906e1585f45668d988e46a5d2659a => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:24:40.335949 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6483e7-3b34-4fef-84ab-c3539438db74 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:40.336469 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6483e7-3b34-4fef-84ab-c3539438db74 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:40.336469 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6483e7-3b34-4fef-84ab-c3539438db74 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:40.338442 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 154/306] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:40.345094 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec71839-7032-4938-8ef0-8b9f8f430888 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:40.346071 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec71839-7032-4938-8ef0-8b9f8f430888 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:40.346560 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec71839-7032-4938-8ef0-8b9f8f430888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:40.368627 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-3ec71839-7032-4938-8ef0-8b9f8f430888 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:40.369839 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-3ec71839-7032-4938-8ef0-8b9f8f430888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:40.434541 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 153/307] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:40.478504 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6483e7-3b34-4fef-84ab-c3539438db74 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:40.495591 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6483e7-3b34-4fef-84ab-c3539438db74 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:40.500192 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1264c4-8df3-416b-9b21-95a8d80b7202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:40.500991 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1264c4-8df3-416b-9b21-95a8d80b7202 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:40.501265 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1264c4-8df3-416b-9b21-95a8d80b7202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:40.501534 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1264c4-8df3-416b-9b21-95a8d80b7202 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:40.517240 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1264c4-8df3-416b-9b21-95a8d80b7202 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:40.523111 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-7d1264c4-8df3-416b-9b21-95a8d80b7202 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:24:40.524557 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 155/308] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:24:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:40.531428 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec71839-7032-4938-8ef0-8b9f8f430888 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:40.540643 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec71839-7032-4938-8ef0-8b9f8f430888 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:40.545956 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559c9a3-9c32-4d21-85eb-a1ac13d6cf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:40.546629 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559c9a3-9c32-4d21-85eb-a1ac13d6cf92 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:40.546960 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559c9a3-9c32-4d21-85eb-a1ac13d6cf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:40.547245 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559c9a3-9c32-4d21-85eb-a1ac13d6cf92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:40.547993 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559c9a3-9c32-4d21-85eb-a1ac13d6cf92 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:40.548288 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559c9a3-9c32-4d21-85eb-a1ac13d6cf92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:40.549880 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559c9a3-9c32-4d21-85eb-a1ac13d6cf92 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:40.561188 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 154/309] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:40.567569 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1264c4-8df3-416b-9b21-95a8d80b7202 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:40.714221 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1264c4-8df3-416b-9b21-95a8d80b7202 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:40.718747 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927683c1-1910-4ccc-8920-c053871f6b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:40.719619 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927683c1-1910-4ccc-8920-c053871f6b7b admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:40.719894 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927683c1-1910-4ccc-8920-c053871f6b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:40.720165 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927683c1-1910-4ccc-8920-c053871f6b7b admin admin] PATH_INFO: `/v3/groups/ce2f8c650eb147459d027aaa839a8668` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:40.727529 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927683c1-1910-4ccc-8920-c053871f6b7b admin admin] RBAC: Authorizing `identity:get_group(group_id=ce2f8c650eb147459d027aaa839a8668)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:40.729459 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927683c1-1910-4ccc-8920-c053871f6b7b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:40.731534 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 156/310] 10.222.0.79 () {56 vars in 1201 bytes} [Thu Oct 28 14:24:40 2021] GET /identity/v3/groups/ce2f8c650eb147459d027aaa839a8668 => generated 229 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:40.737545 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559c9a3-9c32-4d21-85eb-a1ac13d6cf92 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:40.752346 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559c9a3-9c32-4d21-85eb-a1ac13d6cf92 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:40.766864 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f653733-3b59-4cc1-a586-17498e69b3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:40.767742 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f653733-3b59-4cc1-a586-17498e69b3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:40.768018 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f653733-3b59-4cc1-a586-17498e69b3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:40.768289 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f653733-3b59-4cc1-a586-17498e69b3c4 admin admin] PATH_INFO: `/v3/projects/7760de20f300416cbabf0f95c42b2e83` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:40.774577 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f653733-3b59-4cc1-a586-17498e69b3c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=7760de20f300416cbabf0f95c42b2e83)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:40.776413 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f653733-3b59-4cc1-a586-17498e69b3c4 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:40.778330 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 155/311] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:40 2021] GET /identity/v3/projects/7760de20f300416cbabf0f95c42b2e83 => generated 344 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:40.784962 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927683c1-1910-4ccc-8920-c053871f6b7b admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:40.799950 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927683c1-1910-4ccc-8920-c053871f6b7b admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:40.809624 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c424b-8770-4e23-9fcf-46b0f6fc54e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:40.810542 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c424b-8770-4e23-9fcf-46b0f6fc54e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:40.810940 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c424b-8770-4e23-9fcf-46b0f6fc54e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:40.811213 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c424b-8770-4e23-9fcf-46b0f6fc54e6 admin admin] PATH_INFO: `/v3/projects/7760de20f300416cbabf0f95c42b2e83/groups/ce2f8c650eb147459d027aaa839a8668/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:40.816309 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c424b-8770-4e23-9fcf-46b0f6fc54e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7760de20f300416cbabf0f95c42b2e83, group_id=ce2f8c650eb147459d027aaa839a8668, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:40.818966 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c424b-8770-4e23-9fcf-46b0f6fc54e6 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:40.846669 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 157/312] 10.222.0.79 () {58 vars in 1463 bytes} [Thu Oct 28 14:24:40 2021] PUT /identity/v3/projects/7760de20f300416cbabf0f95c42b2e83/groups/ce2f8c650eb147459d027aaa839a8668/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:24:41.257688 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550e5a8-bea0-444f-a1c7-adde63c7575c None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:41.258124 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550e5a8-bea0-444f-a1c7-adde63c7575c None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:41.258399 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550e5a8-bea0-444f-a1c7-adde63c7575c None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:41.260665 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 156/313] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:41.266803 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6ef59-0fec-442d-ab46-877d1f5c756d None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:41.267137 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6ef59-0fec-442d-ab46-877d1f5c756d None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:41.267382 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6ef59-0fec-442d-ab46-877d1f5c756d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:41.294949 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-10c6ef59-0fec-442d-ab46-877d1f5c756d None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:41.296166 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-10c6ef59-0fec-442d-ab46-877d1f5c756d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:41.376484 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 158/314] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:41.412722 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550e5a8-bea0-444f-a1c7-adde63c7575c None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:41.434485 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550e5a8-bea0-444f-a1c7-adde63c7575c None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:41.440422 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82330c19-f9a0-49ad-bdbb-9f27c209458d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:41.441236 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82330c19-f9a0-49ad-bdbb-9f27c209458d admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:41.441503 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82330c19-f9a0-49ad-bdbb-9f27c209458d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:41.441771 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82330c19-f9a0-49ad-bdbb-9f27c209458d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:41.459667 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82330c19-f9a0-49ad-bdbb-9f27c209458d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:41.466730 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-82330c19-f9a0-49ad-bdbb-9f27c209458d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 14:24:41.468278 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 157/315] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:41 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:41.474667 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6ef59-0fec-442d-ab46-877d1f5c756d None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:41.488528 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6ef59-0fec-442d-ab46-877d1f5c756d None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:41.497599 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ae50d-80d4-471d-8784-8222e20fafd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:41.498294 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ae50d-80d4-471d-8784-8222e20fafd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:41.498570 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ae50d-80d4-471d-8784-8222e20fafd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:41.498866 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ae50d-80d4-471d-8784-8222e20fafd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:41.499690 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ae50d-80d4-471d-8784-8222e20fafd2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:41.499955 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ae50d-80d4-471d-8784-8222e20fafd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:41.501586 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ae50d-80d4-471d-8784-8222e20fafd2 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:41.518027 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 159/316] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Oct 28 14:24:41 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:41.524721 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82330c19-f9a0-49ad-bdbb-9f27c209458d admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:41.539848 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82330c19-f9a0-49ad-bdbb-9f27c209458d admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:41.550651 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c58bb-0ca1-4269-9831-9c6049c1d02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:41.551323 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c58bb-0ca1-4269-9831-9c6049c1d02e admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:41.551964 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c58bb-0ca1-4269-9831-9c6049c1d02e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:41.552260 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c58bb-0ca1-4269-9831-9c6049c1d02e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:41.570274 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c58bb-0ca1-4269-9831-9c6049c1d02e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:41.572114 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c58bb-0ca1-4269-9831-9c6049c1d02e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:41.581136 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcba227-adfc-4f8b-9eb3-691432e4e9d9 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:41.581404 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcba227-adfc-4f8b-9eb3-691432e4e9d9 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:41.581685 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcba227-adfc-4f8b-9eb3-691432e4e9d9 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:41.583800 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 160/317] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 14:24:41.584263 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 158/318] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:41 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:41.590181 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ceb1a-c879-4653-b621-0e71b0f19f51 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:41.590311 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c58bb-0ca1-4269-9831-9c6049c1d02e admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:41.590522 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ceb1a-c879-4653-b621-0e71b0f19f51 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:41.590767 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ceb1a-c879-4653-b621-0e71b0f19f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:41.602797 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c58bb-0ca1-4269-9831-9c6049c1d02e admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:41.613072 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc03c2-ca8a-4719-8ff0-3f15cc8a7d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:41.613938 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc03c2-ca8a-4719-8ff0-3f15cc8a7d82 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:41.614212 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc03c2-ca8a-4719-8ff0-3f15cc8a7d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:41.614481 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc03c2-ca8a-4719-8ff0-3f15cc8a7d82 admin admin] PATH_INFO: `/v3/projects/c0fc8be7ace747daba1f61a78ad61736` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:41.618118 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc03c2-ca8a-4719-8ff0-3f15cc8a7d82 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0fc8be7ace747daba1f61a78ad61736)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:41.620235 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc03c2-ca8a-4719-8ff0-3f15cc8a7d82 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:41.621900 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 159/319] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:41 2021] GET /identity/v3/projects/c0fc8be7ace747daba1f61a78ad61736 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:41.623289 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-a32ceb1a-c879-4653-b621-0e71b0f19f51 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:41.624467 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a32ceb1a-c879-4653-b621-0e71b0f19f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:41.629127 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc03c2-ca8a-4719-8ff0-3f15cc8a7d82 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:41.639616 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 161/320] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:41.641814 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc03c2-ca8a-4719-8ff0-3f15cc8a7d82 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:41.646756 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db16ea-75f4-449d-94f8-784d04de8fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:41.647597 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db16ea-75f4-449d-94f8-784d04de8fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:41.647875 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db16ea-75f4-449d-94f8-784d04de8fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:41.648143 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db16ea-75f4-449d-94f8-784d04de8fa4 admin admin] PATH_INFO: `/v3/groups/3fe325c9e2d04ac3af14eca796b05f42` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:41.649398 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db16ea-75f4-449d-94f8-784d04de8fa4 admin admin] RBAC: Authorizing `identity:get_group(group_id=3fe325c9e2d04ac3af14eca796b05f42)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:41.651323 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db16ea-75f4-449d-94f8-784d04de8fa4 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:41.653156 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 160/321] 10.222.0.79 () {56 vars in 1201 bytes} [Thu Oct 28 14:24:41 2021] GET /identity/v3/groups/3fe325c9e2d04ac3af14eca796b05f42 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:41.659510 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ceb1a-c879-4653-b621-0e71b0f19f51 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:41.671871 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ceb1a-c879-4653-b621-0e71b0f19f51 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:41.678314 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcec6c6-bb04-4dcd-98fd-1a6cd1d3c0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:41.678995 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcec6c6-bb04-4dcd-98fd-1a6cd1d3c0cd admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:41.679272 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcec6c6-bb04-4dcd-98fd-1a6cd1d3c0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:41.679538 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcec6c6-bb04-4dcd-98fd-1a6cd1d3c0cd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:41.680485 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcec6c6-bb04-4dcd-98fd-1a6cd1d3c0cd admin admin] RBAC: Adding query filter params (group.id=3fe325c9e2d04ac3af14eca796b05f42, role.id=60f2c4ef9f6646108916900c5bce5845, scope.project.id=c0fc8be7ace747daba1f61a78ad61736) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:41.680879 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcec6c6-bb04-4dcd-98fd-1a6cd1d3c0cd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:41.682942 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcec6c6-bb04-4dcd-98fd-1a6cd1d3c0cd admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:41.692341 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 162/322] 10.222.0.79 () {56 vars in 1397 bytes} [Thu Oct 28 14:24:41 2021] GET /identity/v3/role_assignments?group.id=3fe325c9e2d04ac3af14eca796b05f42&scope.project.id=c0fc8be7ace747daba1f61a78ad61736&role.id=60f2c4ef9f6646108916900c5bce5845 => generated 611 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:41.694555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db16ea-75f4-449d-94f8-784d04de8fa4 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:41.705274 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db16ea-75f4-449d-94f8-784d04de8fa4 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:41.709824 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016331d4-38fa-4037-8261-b658ecc1318b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:41.710714 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016331d4-38fa-4037-8261-b658ecc1318b admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:41.710997 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016331d4-38fa-4037-8261-b658ecc1318b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:41.711316 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016331d4-38fa-4037-8261-b658ecc1318b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:41.734439 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016331d4-38fa-4037-8261-b658ecc1318b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:41.742168 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-016331d4-38fa-4037-8261-b658ecc1318b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 14:24:41.751780 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 161/323] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Oct 28 14:24:41 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:41.758856 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcec6c6-bb04-4dcd-98fd-1a6cd1d3c0cd admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:41.769768 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcec6c6-bb04-4dcd-98fd-1a6cd1d3c0cd admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:41.774293 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415f1f1-3749-48a3-b579-14a124594582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:41.775109 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415f1f1-3749-48a3-b579-14a124594582 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:41.775380 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415f1f1-3749-48a3-b579-14a124594582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:41.775646 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415f1f1-3749-48a3-b579-14a124594582 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:41.776565 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415f1f1-3749-48a3-b579-14a124594582 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:41.776924 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415f1f1-3749-48a3-b579-14a124594582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:41.778615 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415f1f1-3749-48a3-b579-14a124594582 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:41.788557 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 163/324] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:41 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:41.795288 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016331d4-38fa-4037-8261-b658ecc1318b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:41.806841 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016331d4-38fa-4037-8261-b658ecc1318b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:41.811643 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab8e29-7b92-42c0-b9a4-8d0eb4b65b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:41.812299 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab8e29-7b92-42c0-b9a4-8d0eb4b65b23 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:41.812621 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab8e29-7b92-42c0-b9a4-8d0eb4b65b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:41.812888 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab8e29-7b92-42c0-b9a4-8d0eb4b65b23 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:41.822027 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab8e29-7b92-42c0-b9a4-8d0eb4b65b23 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:41.824064 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab8e29-7b92-42c0-b9a4-8d0eb4b65b23 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:41.834454 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 162/325] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:41 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:41.841355 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415f1f1-3749-48a3-b579-14a124594582 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:41.852001 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415f1f1-3749-48a3-b579-14a124594582 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:41.857190 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ccb15-d912-492f-a33b-73cd73b252cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:41.858075 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ccb15-d912-492f-a33b-73cd73b252cd admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:41.858393 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ccb15-d912-492f-a33b-73cd73b252cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:41.858661 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ccb15-d912-492f-a33b-73cd73b252cd admin admin] PATH_INFO: `/v3/projects/c0fc8be7ace747daba1f61a78ad61736` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:41.859949 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ccb15-d912-492f-a33b-73cd73b252cd admin admin] RBAC: Authorizing `identity:get_project(project_id=c0fc8be7ace747daba1f61a78ad61736)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:41.862142 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ccb15-d912-492f-a33b-73cd73b252cd admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:41.864322 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 164/326] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:41 2021] GET /identity/v3/projects/c0fc8be7ace747daba1f61a78ad61736 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:41.870853 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab8e29-7b92-42c0-b9a4-8d0eb4b65b23 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:41.880742 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab8e29-7b92-42c0-b9a4-8d0eb4b65b23 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:41.885486 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe484a-6146-41a8-8302-5c5e1ee47a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:41.886591 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe484a-6146-41a8-8302-5c5e1ee47a9b admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:41.886898 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe484a-6146-41a8-8302-5c5e1ee47a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:41.887165 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe484a-6146-41a8-8302-5c5e1ee47a9b admin admin] PATH_INFO: `/v3/groups/3fe325c9e2d04ac3af14eca796b05f42` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:41.888489 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe484a-6146-41a8-8302-5c5e1ee47a9b admin admin] RBAC: Authorizing `identity:get_group(group_id=3fe325c9e2d04ac3af14eca796b05f42)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:41.890469 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe484a-6146-41a8-8302-5c5e1ee47a9b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:41.892578 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 163/327] 10.222.0.79 () {56 vars in 1201 bytes} [Thu Oct 28 14:24:41 2021] GET /identity/v3/groups/3fe325c9e2d04ac3af14eca796b05f42 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:41.903379 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ccb15-d912-492f-a33b-73cd73b252cd admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:41.916472 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ccb15-d912-492f-a33b-73cd73b252cd admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:41.927554 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a339c-bfdb-446a-b658-4cdee6ae1446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:41.928239 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a339c-bfdb-446a-b658-4cdee6ae1446 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:41.928608 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a339c-bfdb-446a-b658-4cdee6ae1446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:41.928878 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a339c-bfdb-446a-b658-4cdee6ae1446 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:41.929773 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a339c-bfdb-446a-b658-4cdee6ae1446 admin admin] RBAC: Adding query filter params (group.id=3fe325c9e2d04ac3af14eca796b05f42, role.id=08b906e1585f45668d988e46a5d2659a, scope.project.id=c0fc8be7ace747daba1f61a78ad61736) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:41.930080 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a339c-bfdb-446a-b658-4cdee6ae1446 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:41.932236 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a339c-bfdb-446a-b658-4cdee6ae1446 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:41.944187 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 165/328] 10.222.0.79 () {56 vars in 1397 bytes} [Thu Oct 28 14:24:41 2021] GET /identity/v3/role_assignments?group.id=3fe325c9e2d04ac3af14eca796b05f42&scope.project.id=c0fc8be7ace747daba1f61a78ad61736&role.id=08b906e1585f45668d988e46a5d2659a => generated 611 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:42.484781 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6c786-5a5a-4095-858e-d0b1d388d98e None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:42.485303 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6c786-5a5a-4095-858e-d0b1d388d98e None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:42.485303 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6c786-5a5a-4095-858e-d0b1d388d98e None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:42.487265 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 164/329] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:42.493443 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99849e1e-6f4c-4510-ba33-77f61b9d9a24 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:42.494313 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99849e1e-6f4c-4510-ba33-77f61b9d9a24 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:42.494826 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99849e1e-6f4c-4510-ba33-77f61b9d9a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:42.520649 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-99849e1e-6f4c-4510-ba33-77f61b9d9a24 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:42.522182 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-99849e1e-6f4c-4510-ba33-77f61b9d9a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:42.530363 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 166/330] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:42.572294 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6c786-5a5a-4095-858e-d0b1d388d98e None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:42.585606 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6c786-5a5a-4095-858e-d0b1d388d98e None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:42.591244 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe94131-71bc-47d4-bdb7-d221aee00ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:42.592118 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe94131-71bc-47d4-bdb7-d221aee00ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:42.592399 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe94131-71bc-47d4-bdb7-d221aee00ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:42.592670 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe94131-71bc-47d4-bdb7-d221aee00ce2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:42.604240 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe94131-71bc-47d4-bdb7-d221aee00ce2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:42.611194 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-bbe94131-71bc-47d4-bdb7-d221aee00ce2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 14:24:42.612783 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 165/331] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:42 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:42.619443 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99849e1e-6f4c-4510-ba33-77f61b9d9a24 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:42.629675 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99849e1e-6f4c-4510-ba33-77f61b9d9a24 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:42.634577 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16a8e4-3724-4bc7-8e8d-b2bf22dbecb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:42.635294 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16a8e4-3724-4bc7-8e8d-b2bf22dbecb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:42.635572 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16a8e4-3724-4bc7-8e8d-b2bf22dbecb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:42.635839 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16a8e4-3724-4bc7-8e8d-b2bf22dbecb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:42.636663 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16a8e4-3724-4bc7-8e8d-b2bf22dbecb9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:42.636964 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16a8e4-3724-4bc7-8e8d-b2bf22dbecb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:42.638573 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16a8e4-3724-4bc7-8e8d-b2bf22dbecb9 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:42.648480 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 167/332] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Oct 28 14:24:42 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:42.654546 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe94131-71bc-47d4-bdb7-d221aee00ce2 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:42.664529 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe94131-71bc-47d4-bdb7-d221aee00ce2 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:42.668862 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c61601-c781-4180-bd01-c37f9dcd68c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:42.669505 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c61601-c781-4180-bd01-c37f9dcd68c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:42.669785 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c61601-c781-4180-bd01-c37f9dcd68c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:42.670053 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c61601-c781-4180-bd01-c37f9dcd68c5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:42.678747 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c61601-c781-4180-bd01-c37f9dcd68c5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:42.680522 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c61601-c781-4180-bd01-c37f9dcd68c5 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:42.689473 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 166/333] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:42 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:42.695507 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16a8e4-3724-4bc7-8e8d-b2bf22dbecb9 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:42.705694 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16a8e4-3724-4bc7-8e8d-b2bf22dbecb9 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:42.710339 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8199ff-3a54-466c-ac99-df22c52835fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:42.711307 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8199ff-3a54-466c-ac99-df22c52835fb admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:42.711654 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8199ff-3a54-466c-ac99-df22c52835fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:42.711996 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8199ff-3a54-466c-ac99-df22c52835fb admin admin] PATH_INFO: `/v3/projects/827891427e6b4c02918b6c82992d0bbb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:42.713333 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8199ff-3a54-466c-ac99-df22c52835fb admin admin] RBAC: Authorizing `identity:get_project(project_id=827891427e6b4c02918b6c82992d0bbb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:42.715517 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8199ff-3a54-466c-ac99-df22c52835fb admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:42.717408 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 168/334] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:42 2021] GET /identity/v3/projects/827891427e6b4c02918b6c82992d0bbb => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:42.723604 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c61601-c781-4180-bd01-c37f9dcd68c5 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:42.732827 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c61601-c781-4180-bd01-c37f9dcd68c5 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:42.737681 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0202f9-f1dd-4eea-b154-63086ef6709e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:42.738443 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0202f9-f1dd-4eea-b154-63086ef6709e admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:42.738726 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0202f9-f1dd-4eea-b154-63086ef6709e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:42.739013 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0202f9-f1dd-4eea-b154-63086ef6709e admin admin] PATH_INFO: `/v3/groups/3fe325c9e2d04ac3af14eca796b05f42` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:42.740215 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0202f9-f1dd-4eea-b154-63086ef6709e admin admin] RBAC: Authorizing `identity:get_group(group_id=3fe325c9e2d04ac3af14eca796b05f42)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:42.742100 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0202f9-f1dd-4eea-b154-63086ef6709e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:42.743877 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 167/335] 10.222.0.79 () {56 vars in 1201 bytes} [Thu Oct 28 14:24:42 2021] GET /identity/v3/groups/3fe325c9e2d04ac3af14eca796b05f42 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:42.749799 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8199ff-3a54-466c-ac99-df22c52835fb admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:42.759707 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8199ff-3a54-466c-ac99-df22c52835fb admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:42.764071 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589a874-60f6-4996-80e8-1e38d768a144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:42.764714 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589a874-60f6-4996-80e8-1e38d768a144 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:42.764993 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589a874-60f6-4996-80e8-1e38d768a144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:42.765264 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589a874-60f6-4996-80e8-1e38d768a144 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:42.766090 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589a874-60f6-4996-80e8-1e38d768a144 admin admin] RBAC: Adding query filter params (group.id=3fe325c9e2d04ac3af14eca796b05f42, role.id=60f2c4ef9f6646108916900c5bce5845, scope.project.id=827891427e6b4c02918b6c82992d0bbb) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:42.766405 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589a874-60f6-4996-80e8-1e38d768a144 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:42.768269 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589a874-60f6-4996-80e8-1e38d768a144 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:42.774135 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 169/336] 10.222.0.79 () {56 vars in 1397 bytes} [Thu Oct 28 14:24:42 2021] GET /identity/v3/role_assignments?group.id=3fe325c9e2d04ac3af14eca796b05f42&scope.project.id=827891427e6b4c02918b6c82992d0bbb&role.id=60f2c4ef9f6646108916900c5bce5845 => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:43.035838 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4f297-e292-46c8-9afa-27fe96a8039a None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:43.036020 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4f297-e292-46c8-9afa-27fe96a8039a None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:43.036336 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4f297-e292-46c8-9afa-27fe96a8039a None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:43.038079 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 168/337] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:43.044269 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e208e3-b352-4ac6-ae27-ae409402ac11 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:43.044559 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e208e3-b352-4ac6-ae27-ae409402ac11 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:43.044839 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e208e3-b352-4ac6-ae27-ae409402ac11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:43.063474 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-24e208e3-b352-4ac6-ae27-ae409402ac11 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:43.064667 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-24e208e3-b352-4ac6-ae27-ae409402ac11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:43.072347 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 170/338] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:43.097016 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4f297-e292-46c8-9afa-27fe96a8039a None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:43.109536 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4f297-e292-46c8-9afa-27fe96a8039a None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:43.115309 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00028c57-0e45-403f-a092-cc1ab22ecc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:43.116133 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00028c57-0e45-403f-a092-cc1ab22ecc26 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:43.116416 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00028c57-0e45-403f-a092-cc1ab22ecc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:43.116688 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00028c57-0e45-403f-a092-cc1ab22ecc26 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:43.127732 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00028c57-0e45-403f-a092-cc1ab22ecc26 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:43.135266 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-00028c57-0e45-403f-a092-cc1ab22ecc26 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 14:24:43.136987 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 169/339] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Oct 28 14:24:43 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:43.143171 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e208e3-b352-4ac6-ae27-ae409402ac11 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:43.152687 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e208e3-b352-4ac6-ae27-ae409402ac11 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:43.159949 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5d754-cdcb-4b2d-bb3a-379b0e72d08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:43.160634 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5d754-cdcb-4b2d-bb3a-379b0e72d08d admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:43.160913 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5d754-cdcb-4b2d-bb3a-379b0e72d08d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:43.161184 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5d754-cdcb-4b2d-bb3a-379b0e72d08d admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:43.161960 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5d754-cdcb-4b2d-bb3a-379b0e72d08d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:43.162264 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5d754-cdcb-4b2d-bb3a-379b0e72d08d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:43.163912 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5d754-cdcb-4b2d-bb3a-379b0e72d08d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:43.173414 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 171/340] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:43 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:43.182271 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00028c57-0e45-403f-a092-cc1ab22ecc26 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:43.192702 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00028c57-0e45-403f-a092-cc1ab22ecc26 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:43.198193 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfccaa-8f6c-4e9a-b5eb-b48646277091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:43.199107 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfccaa-8f6c-4e9a-b5eb-b48646277091 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:43.199559 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfccaa-8f6c-4e9a-b5eb-b48646277091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:43.199831 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfccaa-8f6c-4e9a-b5eb-b48646277091 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:43.209179 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfccaa-8f6c-4e9a-b5eb-b48646277091 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:43.211001 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfccaa-8f6c-4e9a-b5eb-b48646277091 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:43.221222 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 170/341] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:43.227563 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5d754-cdcb-4b2d-bb3a-379b0e72d08d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:43.237325 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5d754-cdcb-4b2d-bb3a-379b0e72d08d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:43.241707 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657684a-8006-4b97-b108-132bfadbb9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:43.242549 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657684a-8006-4b97-b108-132bfadbb9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:43.242872 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657684a-8006-4b97-b108-132bfadbb9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:43.243204 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657684a-8006-4b97-b108-132bfadbb9c3 admin admin] PATH_INFO: `/v3/projects/827891427e6b4c02918b6c82992d0bbb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:43.244405 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657684a-8006-4b97-b108-132bfadbb9c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=827891427e6b4c02918b6c82992d0bbb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:43.246448 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657684a-8006-4b97-b108-132bfadbb9c3 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:43.248148 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 172/342] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:43 2021] GET /identity/v3/projects/827891427e6b4c02918b6c82992d0bbb => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:43.254230 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfccaa-8f6c-4e9a-b5eb-b48646277091 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:43.263216 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfccaa-8f6c-4e9a-b5eb-b48646277091 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:43.267733 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df254413-9a43-4221-b5a0-0b95be6a2f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:43.268578 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df254413-9a43-4221-b5a0-0b95be6a2f77 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:43.268861 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df254413-9a43-4221-b5a0-0b95be6a2f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:43.269132 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df254413-9a43-4221-b5a0-0b95be6a2f77 admin admin] PATH_INFO: `/v3/groups/3fe325c9e2d04ac3af14eca796b05f42` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:43.270313 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df254413-9a43-4221-b5a0-0b95be6a2f77 admin admin] RBAC: Authorizing `identity:get_group(group_id=3fe325c9e2d04ac3af14eca796b05f42)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:43.272253 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df254413-9a43-4221-b5a0-0b95be6a2f77 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:43.273847 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 171/343] 10.222.0.79 () {56 vars in 1201 bytes} [Thu Oct 28 14:24:43 2021] GET /identity/v3/groups/3fe325c9e2d04ac3af14eca796b05f42 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:43.280487 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657684a-8006-4b97-b108-132bfadbb9c3 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:43.290342 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657684a-8006-4b97-b108-132bfadbb9c3 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:43.294737 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f5b03-dba3-4a1b-854b-93b3aa449299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:43.295423 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f5b03-dba3-4a1b-854b-93b3aa449299 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:43.295718 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f5b03-dba3-4a1b-854b-93b3aa449299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:43.295969 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f5b03-dba3-4a1b-854b-93b3aa449299 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:43.296814 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f5b03-dba3-4a1b-854b-93b3aa449299 admin admin] RBAC: Adding query filter params (group.id=3fe325c9e2d04ac3af14eca796b05f42, role.id=08b906e1585f45668d988e46a5d2659a, scope.project.id=827891427e6b4c02918b6c82992d0bbb) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:43.297124 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f5b03-dba3-4a1b-854b-93b3aa449299 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:43.298985 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f5b03-dba3-4a1b-854b-93b3aa449299 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:43.305379 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 173/344] 10.222.0.79 () {56 vars in 1397 bytes} [Thu Oct 28 14:24:43 2021] GET /identity/v3/role_assignments?group.id=3fe325c9e2d04ac3af14eca796b05f42&scope.project.id=827891427e6b4c02918b6c82992d0bbb&role.id=08b906e1585f45668d988e46a5d2659a => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:43.578435 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a675c1f-4e35-4bb0-812c-5b1ed3445755 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:43.578953 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a675c1f-4e35-4bb0-812c-5b1ed3445755 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:43.578953 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a675c1f-4e35-4bb0-812c-5b1ed3445755 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:43.580766 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 172/345] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:43.586852 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e2632-da24-4fb7-ae5f-544657d0bdf5 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:43.587309 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e2632-da24-4fb7-ae5f-544657d0bdf5 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:43.587410 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e2632-da24-4fb7-ae5f-544657d0bdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:43.606071 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-790e2632-da24-4fb7-ae5f-544657d0bdf5 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:43.607390 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-790e2632-da24-4fb7-ae5f-544657d0bdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:43.616318 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 174/346] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:43.640741 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a675c1f-4e35-4bb0-812c-5b1ed3445755 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:43.653627 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a675c1f-4e35-4bb0-812c-5b1ed3445755 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:43.658429 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1629269-f735-4657-880f-fb9abe833c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:43.659329 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1629269-f735-4657-880f-fb9abe833c4a admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:43.659610 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1629269-f735-4657-880f-fb9abe833c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:43.659880 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1629269-f735-4657-880f-fb9abe833c4a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:43.671217 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1629269-f735-4657-880f-fb9abe833c4a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:43.678055 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-c1629269-f735-4657-880f-fb9abe833c4a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:24:43.679528 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 173/347] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:24:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:43.686005 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e2632-da24-4fb7-ae5f-544657d0bdf5 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:43.695312 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e2632-da24-4fb7-ae5f-544657d0bdf5 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:43.700052 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae514d1c-0f57-494c-94e9-a7413a3a3b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:43.700716 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae514d1c-0f57-494c-94e9-a7413a3a3b17 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:43.700997 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae514d1c-0f57-494c-94e9-a7413a3a3b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:43.701265 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae514d1c-0f57-494c-94e9-a7413a3a3b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:43.702018 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae514d1c-0f57-494c-94e9-a7413a3a3b17 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:43.702317 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae514d1c-0f57-494c-94e9-a7413a3a3b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:43.703945 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae514d1c-0f57-494c-94e9-a7413a3a3b17 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:43.712611 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 175/348] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:43.718946 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1629269-f735-4657-880f-fb9abe833c4a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:43.728729 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1629269-f735-4657-880f-fb9abe833c4a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:43.733399 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291fde08-d22d-4650-8fc7-49bef528cccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:43.734027 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fde08-d22d-4650-8fc7-49bef528cccb admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:43.734300 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fde08-d22d-4650-8fc7-49bef528cccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:43.734564 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fde08-d22d-4650-8fc7-49bef528cccb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:43.743172 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291fde08-d22d-4650-8fc7-49bef528cccb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:43.744931 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291fde08-d22d-4650-8fc7-49bef528cccb admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:43.753491 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 174/349] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:43.762420 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae514d1c-0f57-494c-94e9-a7413a3a3b17 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:43.771903 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae514d1c-0f57-494c-94e9-a7413a3a3b17 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:43.776632 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b92427-eb99-4677-afe7-c68145754fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:43.777467 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b92427-eb99-4677-afe7-c68145754fff admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:43.777744 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b92427-eb99-4677-afe7-c68145754fff admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:43.778015 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b92427-eb99-4677-afe7-c68145754fff admin admin] PATH_INFO: `/v3/projects/7760de20f300416cbabf0f95c42b2e83` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:43.779252 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b92427-eb99-4677-afe7-c68145754fff admin admin] RBAC: Authorizing `identity:get_project(project_id=7760de20f300416cbabf0f95c42b2e83)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:43.781019 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b92427-eb99-4677-afe7-c68145754fff admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:43.782659 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 176/350] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:24:43 2021] GET /identity/v3/projects/7760de20f300416cbabf0f95c42b2e83 => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:43.788981 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291fde08-d22d-4650-8fc7-49bef528cccb admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:43.803467 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291fde08-d22d-4650-8fc7-49bef528cccb admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:43.809506 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921de1d1-4605-4169-91c7-ac5003cd9f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:43.810331 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921de1d1-4605-4169-91c7-ac5003cd9f0e admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:43.810600 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921de1d1-4605-4169-91c7-ac5003cd9f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:43.810895 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921de1d1-4605-4169-91c7-ac5003cd9f0e admin admin] PATH_INFO: `/v3/groups/ce2f8c650eb147459d027aaa839a8668` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:43.812062 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921de1d1-4605-4169-91c7-ac5003cd9f0e admin admin] RBAC: Authorizing `identity:get_group(group_id=ce2f8c650eb147459d027aaa839a8668)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:43.813883 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921de1d1-4605-4169-91c7-ac5003cd9f0e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:43.815438 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 175/351] 10.222.0.79 () {56 vars in 1201 bytes} [Thu Oct 28 14:24:43 2021] GET /identity/v3/groups/ce2f8c650eb147459d027aaa839a8668 => generated 229 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:43.821128 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b92427-eb99-4677-afe7-c68145754fff admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:43.830543 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b92427-eb99-4677-afe7-c68145754fff admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:43.835068 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004547b-63a1-4dd5-a3b0-ce78b295a709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:43.835665 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004547b-63a1-4dd5-a3b0-ce78b295a709 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:43.835944 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004547b-63a1-4dd5-a3b0-ce78b295a709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:43.836209 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004547b-63a1-4dd5-a3b0-ce78b295a709 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:43.837108 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004547b-63a1-4dd5-a3b0-ce78b295a709 admin admin] RBAC: Adding query filter params (group.id=ce2f8c650eb147459d027aaa839a8668, role.id=f7b8954a0fe64dc2b6146c7174498ddb, scope.project.id=7760de20f300416cbabf0f95c42b2e83) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:43.837415 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004547b-63a1-4dd5-a3b0-ce78b295a709 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:43.839225 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004547b-63a1-4dd5-a3b0-ce78b295a709 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:43.845038 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 177/352] 10.222.0.79 () {56 vars in 1397 bytes} [Thu Oct 28 14:24:43 2021] GET /identity/v3/role_assignments?group.id=ce2f8c650eb147459d027aaa839a8668&scope.project.id=7760de20f300416cbabf0f95c42b2e83&role.id=f7b8954a0fe64dc2b6146c7174498ddb => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:46.765394 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d57125-4938-4b7e-aae3-5fee6777d57f None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:46.765958 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d57125-4938-4b7e-aae3-5fee6777d57f None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:46.766044 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d57125-4938-4b7e-aae3-5fee6777d57f None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:46.768092 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 176/353] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:46.774004 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6d1d2-a01c-4ba5-aeb3-d249f0b8d817 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:46.774480 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6d1d2-a01c-4ba5-aeb3-d249f0b8d817 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:46.774668 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6d1d2-a01c-4ba5-aeb3-d249f0b8d817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:46.795556 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-33d6d1d2-a01c-4ba5-aeb3-d249f0b8d817 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:46.796772 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-33d6d1d2-a01c-4ba5-aeb3-d249f0b8d817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:46.810672 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 178/354] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:46.852466 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d57125-4938-4b7e-aae3-5fee6777d57f None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:46.865060 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d57125-4938-4b7e-aae3-5fee6777d57f None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:46.874699 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ddd66-725a-49b3-9136-0b8ae62d61d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:46.875516 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ddd66-725a-49b3-9136-0b8ae62d61d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:46.875795 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ddd66-725a-49b3-9136-0b8ae62d61d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:46.876061 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ddd66-725a-49b3-9136-0b8ae62d61d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:46.887150 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ddd66-725a-49b3-9136-0b8ae62d61d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:46.888987 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ddd66-725a-49b3-9136-0b8ae62d61d3 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:46.912079 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-c26ddd66-725a-49b3-9136-0b8ae62d61d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:46.913316 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 177/355] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:46.919970 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6d1d2-a01c-4ba5-aeb3-d249f0b8d817 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:46.934739 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6d1d2-a01c-4ba5-aeb3-d249f0b8d817 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:46.934739 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e1990-1e71-4a75-9f56-fec31b2bd51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:46.935230 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e1990-1e71-4a75-9f56-fec31b2bd51e admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:46.935509 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e1990-1e71-4a75-9f56-fec31b2bd51e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:46.935776 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e1990-1e71-4a75-9f56-fec31b2bd51e admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:46.936526 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e1990-1e71-4a75-9f56-fec31b2bd51e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:46.936829 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e1990-1e71-4a75-9f56-fec31b2bd51e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:46.938422 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e1990-1e71-4a75-9f56-fec31b2bd51e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:46.957826 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 179/356] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:46.962927 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c79c48-e9d0-48ac-ae7b-9af19466ccb1 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:46.963143 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c79c48-e9d0-48ac-ae7b-9af19466ccb1 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:46.963420 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c79c48-e9d0-48ac-ae7b-9af19466ccb1 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:46.965493 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 178/357] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:46.966495 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e1990-1e71-4a75-9f56-fec31b2bd51e admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:46.980823 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e1990-1e71-4a75-9f56-fec31b2bd51e admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:46.983350 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963da38-222b-47cb-8c0d-6416a762e33b None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:46.983840 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963da38-222b-47cb-8c0d-6416a762e33b None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:46.984302 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963da38-222b-47cb-8c0d-6416a762e33b None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:46.985730 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2497a6-274f-48a9-8166-cc2f3055053e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:46.986403 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2497a6-274f-48a9-8166-cc2f3055053e admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:46.986818 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2497a6-274f-48a9-8166-cc2f3055053e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:46.986991 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2497a6-274f-48a9-8166-cc2f3055053e admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:46.987353 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 179/358] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:46 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 14:24:46.990728 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2497a6-274f-48a9-8166-cc2f3055053e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:46.990728 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING py.warnings [None req-1b2497a6-274f-48a9-8166-cc2f3055053e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:24:46.990728 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: warnings.warn(msg) Oct 28 14:24:46.990728 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: Oct 28 14:24:46.990728 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2497a6-274f-48a9-8166-cc2f3055053e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:46.993710 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca2963-fb26-455c-b21f-e7442198c1e6 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:46.994092 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca2963-fb26-455c-b21f-e7442198c1e6 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:46.994460 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca2963-fb26-455c-b21f-e7442198c1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:47.015976 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-f3ca2963-fb26-455c-b21f-e7442198c1e6 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:47.017103 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-f3ca2963-fb26-455c-b21f-e7442198c1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:47.025206 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 180/359] 10.222.0.79 () {60 vars in 1153 bytes} [Thu Oct 28 14:24:46 2021] POST /identity/v3/users => generated 246 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:24:47.026441 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d74a3-cca5-4503-87c2-6562ac226f25 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:47.026772 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d74a3-cca5-4503-87c2-6562ac226f25 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:47.027063 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d74a3-cca5-4503-87c2-6562ac226f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:47.040071 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 180/360] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:47.059968 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-db6d74a3-cca5-4503-87c2-6562ac226f25 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:47.061195 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-db6d74a3-cca5-4503-87c2-6562ac226f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:47.073532 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 181/361] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:47.087445 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca2963-fb26-455c-b21f-e7442198c1e6 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:47.097141 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca2963-fb26-455c-b21f-e7442198c1e6 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:47.109059 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d0ab6-596c-4faa-830e-83bc7e03d8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:47.110394 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d74a3-cca5-4503-87c2-6562ac226f25 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:47.115528 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d0ab6-596c-4faa-830e-83bc7e03d8fa admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:47.115932 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d0ab6-596c-4faa-830e-83bc7e03d8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:47.116091 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d0ab6-596c-4faa-830e-83bc7e03d8fa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:47.127221 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d74a3-cca5-4503-87c2-6562ac226f25 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:47.134950 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d0ab6-596c-4faa-830e-83bc7e03d8fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:47.137267 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d0ab6-596c-4faa-830e-83bc7e03d8fa admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:47.141084 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb9588-a671-450c-a5e4-49440a211cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:47.141929 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb9588-a671-450c-a5e4-49440a211cca admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:47.142196 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb9588-a671-450c-a5e4-49440a211cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:47.142456 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb9588-a671-450c-a5e4-49440a211cca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:47.163555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-a08d0ab6-596c-4faa-830e-83bc7e03d8fa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:47.166393 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 181/362] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:47.170931 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb9588-a671-450c-a5e4-49440a211cca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:47.170931 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb9588-a671-450c-a5e4-49440a211cca admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:47.174068 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d0ab6-596c-4faa-830e-83bc7e03d8fa admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:47.191418 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d0ab6-596c-4faa-830e-83bc7e03d8fa admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:47.199707 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-6dfb9588-a671-450c-a5e4-49440a211cca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:47.204803 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c63d1-3701-46a6-b99b-ca1d71547f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:47.205806 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c63d1-3701-46a6-b99b-ca1d71547f89 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:47.206273 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c63d1-3701-46a6-b99b-ca1d71547f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:47.206774 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c63d1-3701-46a6-b99b-ca1d71547f89 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:47.207718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c63d1-3701-46a6-b99b-ca1d71547f89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:47.208211 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c63d1-3701-46a6-b99b-ca1d71547f89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:47.208983 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 182/363] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:47.210362 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING py.warnings [None req-264c63d1-3701-46a6-b99b-ca1d71547f89 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:24:47.210362 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: warnings.warn(msg) Oct 28 14:24:47.210362 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: Oct 28 14:24:47.211656 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c63d1-3701-46a6-b99b-ca1d71547f89 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:47.215852 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb9588-a671-450c-a5e4-49440a211cca admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:47.235378 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb9588-a671-450c-a5e4-49440a211cca admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:47.245361 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094effe-851c-4053-8f5a-660f272cf83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:47.246057 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094effe-851c-4053-8f5a-660f272cf83e admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:47.246341 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094effe-851c-4053-8f5a-660f272cf83e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:47.246749 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094effe-851c-4053-8f5a-660f272cf83e admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:47.250715 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8094effe-851c-4053-8f5a-660f272cf83e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:47.250715 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8094effe-851c-4053-8f5a-660f272cf83e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:47.250715 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8094effe-851c-4053-8f5a-660f272cf83e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:47.251448 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 182/364] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:47.254469 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c63d1-3701-46a6-b99b-ca1d71547f89 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:47.269171 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c63d1-3701-46a6-b99b-ca1d71547f89 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:47.277198 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 183/365] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:47.279877 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ced17-6067-464c-a1ea-09c23f5f7a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:47.280807 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094effe-851c-4053-8f5a-660f272cf83e admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:47.281049 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ced17-6067-464c-a1ea-09c23f5f7a11 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:47.281584 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ced17-6067-464c-a1ea-09c23f5f7a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:47.282040 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ced17-6067-464c-a1ea-09c23f5f7a11 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:47.283014 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ced17-6067-464c-a1ea-09c23f5f7a11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:47.285186 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ced17-6067-464c-a1ea-09c23f5f7a11 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:47.305133 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094effe-851c-4053-8f5a-660f272cf83e admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:47.316323 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 183/366] 10.222.0.79 () {60 vars in 1153 bytes} [Thu Oct 28 14:24:47 2021] POST /identity/v3/users => generated 248 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:24:47.323565 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bf786-b813-4913-a921-42599412e66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:47.324285 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bf786-b813-4913-a921-42599412e66e admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:47.324571 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bf786-b813-4913-a921-42599412e66e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:47.324845 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bf786-b813-4913-a921-42599412e66e admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:47.325608 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96bf786-b813-4913-a921-42599412e66e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:47.327632 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96bf786-b813-4913-a921-42599412e66e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:47.363053 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 184/367] 10.222.0.79 () {60 vars in 1153 bytes} [Thu Oct 28 14:24:47 2021] POST /identity/v3/users => generated 248 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:24:47.576829 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61214694-29dc-49b3-9e43-980d661d6d06 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:47.577178 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61214694-29dc-49b3-9e43-980d661d6d06 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:47.577348 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61214694-29dc-49b3-9e43-980d661d6d06 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:47.579510 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 184/368] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:47.587716 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42572dcb-ac07-4572-b523-d8a862768999 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:47.588040 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42572dcb-ac07-4572-b523-d8a862768999 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:47.588278 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42572dcb-ac07-4572-b523-d8a862768999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:47.611524 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-42572dcb-ac07-4572-b523-d8a862768999 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:47.612737 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-42572dcb-ac07-4572-b523-d8a862768999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:47.620960 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 185/369] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:47.648227 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61214694-29dc-49b3-9e43-980d661d6d06 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:47.664638 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61214694-29dc-49b3-9e43-980d661d6d06 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:47.671659 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158258ef-bef1-44c1-9109-6d214f25aacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:47.672438 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158258ef-bef1-44c1-9109-6d214f25aacd admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:47.672914 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158258ef-bef1-44c1-9109-6d214f25aacd admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:47.673256 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158258ef-bef1-44c1-9109-6d214f25aacd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:47.689257 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158258ef-bef1-44c1-9109-6d214f25aacd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:47.691215 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158258ef-bef1-44c1-9109-6d214f25aacd admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:47.711923 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-158258ef-bef1-44c1-9109-6d214f25aacd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:47.713502 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 185/370] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:47.719670 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42572dcb-ac07-4572-b523-d8a862768999 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:47.732443 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42572dcb-ac07-4572-b523-d8a862768999 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:47.741086 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e04b57-5bc4-459f-bc63-8fc55aa767f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:47.741758 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e04b57-5bc4-459f-bc63-8fc55aa767f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:47.742032 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e04b57-5bc4-459f-bc63-8fc55aa767f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:47.742283 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e04b57-5bc4-459f-bc63-8fc55aa767f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:47.743180 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e04b57-5bc4-459f-bc63-8fc55aa767f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:47.743481 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e04b57-5bc4-459f-bc63-8fc55aa767f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:47.745219 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e04b57-5bc4-459f-bc63-8fc55aa767f3 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:47.764784 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 186/371] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:47.770892 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158258ef-bef1-44c1-9109-6d214f25aacd admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:47.781887 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158258ef-bef1-44c1-9109-6d214f25aacd admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:47.787843 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83013eb-2712-4547-b637-9284a4208e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:47.788570 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83013eb-2712-4547-b637-9284a4208e86 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:47.788848 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83013eb-2712-4547-b637-9284a4208e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:47.789111 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83013eb-2712-4547-b637-9284a4208e86 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:47.789970 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83013eb-2712-4547-b637-9284a4208e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:47.792173 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83013eb-2712-4547-b637-9284a4208e86 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:47.830383 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 186/372] 10.222.0.79 () {60 vars in 1153 bytes} [Thu Oct 28 14:24:47 2021] POST /identity/v3/users => generated 249 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:24:48.244115 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57af34-8fc2-4afc-ab06-eaac17dfc30a None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:48.244649 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57af34-8fc2-4afc-ab06-eaac17dfc30a None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:48.244724 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57af34-8fc2-4afc-ab06-eaac17dfc30a None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:48.246869 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 187/373] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:48.253062 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8d563-a55a-43b4-a7e3-e6574d0dfc40 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:48.253371 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8d563-a55a-43b4-a7e3-e6574d0dfc40 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:48.253609 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8d563-a55a-43b4-a7e3-e6574d0dfc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:48.274987 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-6cb8d563-a55a-43b4-a7e3-e6574d0dfc40 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:48.276189 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-6cb8d563-a55a-43b4-a7e3-e6574d0dfc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:48.283794 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 187/374] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:48.308500 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57af34-8fc2-4afc-ab06-eaac17dfc30a None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:48.321089 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57af34-8fc2-4afc-ab06-eaac17dfc30a None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:48.325469 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d3b10-e898-4163-b557-dea4573306f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:48.326132 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d3b10-e898-4163-b557-dea4573306f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:48.326406 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d3b10-e898-4163-b557-dea4573306f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:48.326673 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d3b10-e898-4163-b557-dea4573306f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:48.327474 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d3b10-e898-4163-b557-dea4573306f0 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:48.329058 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d3b10-e898-4163-b557-dea4573306f0 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:48.338040 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.sql.core [None req-cf7d3b10-e898-4163-b557-dea4573306f0 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 28 14:24:48.338040 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 28 14:24:48.338040 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [parameters: {'id': '4b951863fc96408bb7f31b5e1908f855', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 28 14:24:48.338040 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79413) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 14:24:48.352962 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-cf7d3b10-e898-4163-b557-dea4573306f0 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 28 14:24:48.354733 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 188/375] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:24:48 2021] POST /identity/v3/roles => generated 144 bytes in 47 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:48.361513 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8d563-a55a-43b4-a7e3-e6574d0dfc40 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:48.371365 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8d563-a55a-43b4-a7e3-e6574d0dfc40 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:48.376001 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21c91e-6930-4831-8495-3c25984795da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:48.376822 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21c91e-6930-4831-8495-3c25984795da admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:48.377097 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21c91e-6930-4831-8495-3c25984795da admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:48.377384 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21c91e-6930-4831-8495-3c25984795da admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:48.389517 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21c91e-6930-4831-8495-3c25984795da admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:48.397454 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-1a21c91e-6930-4831-8495-3c25984795da admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 14:24:48.399117 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 188/376] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Oct 28 14:24:48 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:48.405668 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d3b10-e898-4163-b557-dea4573306f0 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:48.417221 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d3b10-e898-4163-b557-dea4573306f0 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:48.421753 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fbc20-6f00-4b7d-8e42-c2922be9348a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:48.422432 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fbc20-6f00-4b7d-8e42-c2922be9348a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:48.422729 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fbc20-6f00-4b7d-8e42-c2922be9348a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:48.423047 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fbc20-6f00-4b7d-8e42-c2922be9348a admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:48.423816 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fbc20-6f00-4b7d-8e42-c2922be9348a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:48.424120 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fbc20-6f00-4b7d-8e42-c2922be9348a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:48.425731 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fbc20-6f00-4b7d-8e42-c2922be9348a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:48.435431 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 189/377] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:48 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:49.928340 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb25828-5aae-4440-8cd0-b44f76caa3eb None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:49.929096 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb25828-5aae-4440-8cd0-b44f76caa3eb None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:49.929096 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb25828-5aae-4440-8cd0-b44f76caa3eb None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:49.931319 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 189/378] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:49.938204 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c435de-b2ae-4059-a1c7-681c135e46bb None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:49.939158 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c435de-b2ae-4059-a1c7-681c135e46bb None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:49.939662 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c435de-b2ae-4059-a1c7-681c135e46bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:49.957925 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-47c435de-b2ae-4059-a1c7-681c135e46bb None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:49.959510 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-47c435de-b2ae-4059-a1c7-681c135e46bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:49.967810 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 190/379] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:49.992587 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb25828-5aae-4440-8cd0-b44f76caa3eb None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.005233 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb25828-5aae-4440-8cd0-b44f76caa3eb None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.009839 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80246bfa-8b76-4254-821d-ce331c0cc1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.010891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80246bfa-8b76-4254-821d-ce331c0cc1ca admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.011370 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80246bfa-8b76-4254-821d-ce331c0cc1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.011833 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80246bfa-8b76-4254-821d-ce331c0cc1ca admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.032225 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80246bfa-8b76-4254-821d-ce331c0cc1ca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:50.039526 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-80246bfa-8b76-4254-821d-ce331c0cc1ca admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 14:24:50.041061 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 190/380] 10.222.0.79 () {56 vars in 1123 bytes} [Thu Oct 28 14:24:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:50.047633 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c435de-b2ae-4059-a1c7-681c135e46bb None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.057483 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c435de-b2ae-4059-a1c7-681c135e46bb None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.066768 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010aa92-9ed8-47a1-9dea-9f817da72c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.067678 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010aa92-9ed8-47a1-9dea-9f817da72c11 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.068164 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010aa92-9ed8-47a1-9dea-9f817da72c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.068627 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010aa92-9ed8-47a1-9dea-9f817da72c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.069588 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010aa92-9ed8-47a1-9dea-9f817da72c11 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:50.070125 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010aa92-9ed8-47a1-9dea-9f817da72c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:50.072033 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010aa92-9ed8-47a1-9dea-9f817da72c11 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:50.081439 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 191/381] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:50.087729 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80246bfa-8b76-4254-821d-ce331c0cc1ca admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.097881 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80246bfa-8b76-4254-821d-ce331c0cc1ca admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.102873 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44465e59-01e2-4df7-a66f-c23a3d24d713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.103916 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44465e59-01e2-4df7-a66f-c23a3d24d713 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.104461 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44465e59-01e2-4df7-a66f-c23a3d24d713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.104944 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44465e59-01e2-4df7-a66f-c23a3d24d713 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.120761 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44465e59-01e2-4df7-a66f-c23a3d24d713 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:50.123026 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44465e59-01e2-4df7-a66f-c23a3d24d713 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:50.143603 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-44465e59-01e2-4df7-a66f-c23a3d24d713 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:50.145157 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 191/382] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:50.151404 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200d0b8-16e2-4c77-ac63-788963e59d05 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.151971 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200d0b8-16e2-4c77-ac63-788963e59d05 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.152460 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200d0b8-16e2-4c77-ac63-788963e59d05 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.154492 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 192/383] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:50.156504 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44465e59-01e2-4df7-a66f-c23a3d24d713 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.160316 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673bb76-8cd3-4178-a4af-c1e1021342f4 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.160828 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673bb76-8cd3-4178-a4af-c1e1021342f4 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.161313 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673bb76-8cd3-4178-a4af-c1e1021342f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.187622 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44465e59-01e2-4df7-a66f-c23a3d24d713 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.190619 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-8673bb76-8cd3-4178-a4af-c1e1021342f4 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:50.192478 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-8673bb76-8cd3-4178-a4af-c1e1021342f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:50.197595 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509170d8-b41b-4cae-895e-a4b13b1421ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.198702 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509170d8-b41b-4cae-895e-a4b13b1421ac admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.199183 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509170d8-b41b-4cae-895e-a4b13b1421ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.199669 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509170d8-b41b-4cae-895e-a4b13b1421ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.200634 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509170d8-b41b-4cae-895e-a4b13b1421ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:50.201140 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509170d8-b41b-4cae-895e-a4b13b1421ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:50.203378 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509170d8-b41b-4cae-895e-a4b13b1421ac admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:50.217181 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 193/384] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:24:50.223042 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 192/385] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:50.229299 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673bb76-8cd3-4178-a4af-c1e1021342f4 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.241431 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673bb76-8cd3-4178-a4af-c1e1021342f4 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.246339 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b78cf6-f964-4543-95a8-88f72b34fbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.247421 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b78cf6-f964-4543-95a8-88f72b34fbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.247907 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b78cf6-f964-4543-95a8-88f72b34fbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.248372 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b78cf6-f964-4543-95a8-88f72b34fbb1 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.255465 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509170d8-b41b-4cae-895e-a4b13b1421ac admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.266191 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b78cf6-f964-4543-95a8-88f72b34fbb1 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:50.268737 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509170d8-b41b-4cae-895e-a4b13b1421ac admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.271919 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b78cf6-f964-4543-95a8-88f72b34fbb1 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:50.283981 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b15bd-a582-410f-82fb-1db325fd4c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.284813 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b15bd-a582-410f-82fb-1db325fd4c99 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.285092 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b15bd-a582-410f-82fb-1db325fd4c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.285367 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b15bd-a582-410f-82fb-1db325fd4c99 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.287899 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-94b78cf6-f964-4543-95a8-88f72b34fbb1 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 14:24:50.289735 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 194/386] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/users/nova => generated 82 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:50.295952 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b78cf6-f964-4543-95a8-88f72b34fbb1 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.306980 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b78cf6-f964-4543-95a8-88f72b34fbb1 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.313698 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd4449-9d5a-48e7-a002-7a820c90439e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.315195 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd4449-9d5a-48e7-a002-7a820c90439e admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.315699 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd4449-9d5a-48e7-a002-7a820c90439e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.315803 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b15bd-a582-410f-82fb-1db325fd4c99 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:50.316321 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd4449-9d5a-48e7-a002-7a820c90439e admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.317432 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd4449-9d5a-48e7-a002-7a820c90439e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:50.317939 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd4449-9d5a-48e7-a002-7a820c90439e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:50.319287 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING py.warnings [None req-ffcd4449-9d5a-48e7-a002-7a820c90439e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:24:50.319287 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: warnings.warn(msg) Oct 28 14:24:50.319287 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: Oct 28 14:24:50.320813 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd4449-9d5a-48e7-a002-7a820c90439e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:50.322938 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-ca1b15bd-a582-410f-82fb-1db325fd4c99 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 14:24:50.324521 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 193/387] 10.222.0.79 () {56 vars in 1123 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:50.330947 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b15bd-a582-410f-82fb-1db325fd4c99 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.347133 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b15bd-a582-410f-82fb-1db325fd4c99 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.355860 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600206c-a6a7-4ca6-9033-2f1ad7e978bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.356829 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600206c-a6a7-4ca6-9033-2f1ad7e978bc admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.357337 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600206c-a6a7-4ca6-9033-2f1ad7e978bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.357968 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600206c-a6a7-4ca6-9033-2f1ad7e978bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.359632 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600206c-a6a7-4ca6-9033-2f1ad7e978bc admin admin] RBAC: Adding query filter params (name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:50.360461 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600206c-a6a7-4ca6-9033-2f1ad7e978bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:50.362427 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600206c-a6a7-4ca6-9033-2f1ad7e978bc admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:50.362649 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 195/388] 10.222.0.79 () {56 vars in 1154 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:50.368943 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08b14e-33ac-427c-adc2-80249a759d94 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.368943 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08b14e-33ac-427c-adc2-80249a759d94 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.368943 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08b14e-33ac-427c-adc2-80249a759d94 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.370758 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 196/389] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:50.372843 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08b14e-33ac-427c-adc2-80249a759d94 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.381340 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 194/390] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:50.383153 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275f266-78c5-41c3-8859-e4067c59552c None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.385555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275f266-78c5-41c3-8859-e4067c59552c None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.386150 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275f266-78c5-41c3-8859-e4067c59552c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.391615 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08b14e-33ac-427c-adc2-80249a759d94 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.396926 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2859c1b-b746-4eb3-be1f-a4271881bda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.397572 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2859c1b-b746-4eb3-be1f-a4271881bda8 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.397847 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2859c1b-b746-4eb3-be1f-a4271881bda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.398115 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2859c1b-b746-4eb3-be1f-a4271881bda8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.407336 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2859c1b-b746-4eb3-be1f-a4271881bda8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:50.408350 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-e275f266-78c5-41c3-8859-e4067c59552c None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:50.409035 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2859c1b-b746-4eb3-be1f-a4271881bda8 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:50.410057 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e275f266-78c5-41c3-8859-e4067c59552c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:50.423464 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 197/391] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:50.423464 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2859c1b-b746-4eb3-be1f-a4271881bda8 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.423721 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 195/392] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:50.426652 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275f266-78c5-41c3-8859-e4067c59552c None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.440879 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2859c1b-b746-4eb3-be1f-a4271881bda8 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.443467 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275f266-78c5-41c3-8859-e4067c59552c None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.449079 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8ba76-4e27-4aec-aa14-2c10434f36ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.449877 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8ba76-4e27-4aec-aa14-2c10434f36ff admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.450151 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8ba76-4e27-4aec-aa14-2c10434f36ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.450422 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8ba76-4e27-4aec-aa14-2c10434f36ff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.455758 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c11b6-7a3c-44be-8836-7eac861fb675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.456891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c11b6-7a3c-44be-8836-7eac861fb675 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.457376 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c11b6-7a3c-44be-8836-7eac861fb675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.458061 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c11b6-7a3c-44be-8836-7eac861fb675 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.463155 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8ba76-4e27-4aec-aa14-2c10434f36ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:50.465122 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8ba76-4e27-4aec-aa14-2c10434f36ff admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:50.471436 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c11b6-7a3c-44be-8836-7eac861fb675 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:50.474053 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c11b6-7a3c-44be-8836-7eac861fb675 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:50.485231 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-19d8ba76-4e27-4aec-aa14-2c10434f36ff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:50.486753 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 198/393] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:50.487606 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8ba76-4e27-4aec-aa14-2c10434f36ff admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.495750 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-ce2c11b6-7a3c-44be-8836-7eac861fb675 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:50.497089 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8ba76-4e27-4aec-aa14-2c10434f36ff admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.502525 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 196/394] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:50.502662 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef198a68-cd7a-48dc-be13-b8d09ea15bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.502662 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef198a68-cd7a-48dc-be13-b8d09ea15bdc admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.502662 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef198a68-cd7a-48dc-be13-b8d09ea15bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.503062 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef198a68-cd7a-48dc-be13-b8d09ea15bdc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.504136 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c11b6-7a3c-44be-8836-7eac861fb675 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.514167 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef198a68-cd7a-48dc-be13-b8d09ea15bdc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:50.516381 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c11b6-7a3c-44be-8836-7eac861fb675 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.521215 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c64a7c-56c2-44fe-ba75-df58dd721a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.521431 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-ef198a68-cd7a-48dc-be13-b8d09ea15bdc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 14:24:50.522307 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c64a7c-56c2-44fe-ba75-df58dd721a54 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.528000 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c64a7c-56c2-44fe-ba75-df58dd721a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.528132 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 199/395] 10.222.0.79 () {56 vars in 1123 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:50.528132 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef198a68-cd7a-48dc-be13-b8d09ea15bdc admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.528279 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c64a7c-56c2-44fe-ba75-df58dd721a54 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.528279 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c64a7c-56c2-44fe-ba75-df58dd721a54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:50.532195 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c64a7c-56c2-44fe-ba75-df58dd721a54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:50.533788 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c64a7c-56c2-44fe-ba75-df58dd721a54 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:50.540384 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef198a68-cd7a-48dc-be13-b8d09ea15bdc admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.545319 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac6337-3b52-4c5d-b5bb-c5d8b47d05b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.546249 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 197/396] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:50.546864 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac6337-3b52-4c5d-b5bb-c5d8b47d05b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.546984 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c64a7c-56c2-44fe-ba75-df58dd721a54 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.547487 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac6337-3b52-4c5d-b5bb-c5d8b47d05b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.547996 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac6337-3b52-4c5d-b5bb-c5d8b47d05b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.548983 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac6337-3b52-4c5d-b5bb-c5d8b47d05b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:50.549535 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac6337-3b52-4c5d-b5bb-c5d8b47d05b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:50.551860 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac6337-3b52-4c5d-b5bb-c5d8b47d05b7 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:50.556664 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c64a7c-56c2-44fe-ba75-df58dd721a54 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.560998 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555354f-d3d4-4421-b2a6-e3c53bd93ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.561652 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555354f-d3d4-4421-b2a6-e3c53bd93ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.562218 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555354f-d3d4-4421-b2a6-e3c53bd93ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.562218 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555354f-d3d4-4421-b2a6-e3c53bd93ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.562940 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555354f-d3d4-4421-b2a6-e3c53bd93ff8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:50.563237 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555354f-d3d4-4421-b2a6-e3c53bd93ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:50.564799 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555354f-d3d4-4421-b2a6-e3c53bd93ff8 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:50.570708 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 200/397] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:50.571881 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac6337-3b52-4c5d-b5bb-c5d8b47d05b7 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.573488 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 198/398] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:50.574742 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555354f-d3d4-4421-b2a6-e3c53bd93ff8 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.583837 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555354f-d3d4-4421-b2a6-e3c53bd93ff8 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.588852 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac6337-3b52-4c5d-b5bb-c5d8b47d05b7 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.592124 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df4804-d035-484d-a26c-dd4d8e277cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.593012 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df4804-d035-484d-a26c-dd4d8e277cfe admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.593368 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df4804-d035-484d-a26c-dd4d8e277cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.593629 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df4804-d035-484d-a26c-dd4d8e277cfe admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.594904 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ffd539-3352-4656-a6ac-67be53f8c355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.595965 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffd539-3352-4656-a6ac-67be53f8c355 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.596488 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffd539-3352-4656-a6ac-67be53f8c355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.597017 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffd539-3352-4656-a6ac-67be53f8c355 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.601343 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df4804-d035-484d-a26c-dd4d8e277cfe admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:50.603348 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df4804-d035-484d-a26c-dd4d8e277cfe admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:50.606323 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ffd539-3352-4656-a6ac-67be53f8c355 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:50.608611 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ffd539-3352-4656-a6ac-67be53f8c355 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:50.616143 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-68df4804-d035-484d-a26c-dd4d8e277cfe admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:24:50.617343 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 199/399] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:50.622802 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df4804-d035-484d-a26c-dd4d8e277cfe admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.627776 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df4804-d035-484d-a26c-dd4d8e277cfe admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.629239 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-41ffd539-3352-4656-a6ac-67be53f8c355 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 28 14:24:50.630785 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 201/400] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/users/glance => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:50.631842 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ffd539-3352-4656-a6ac-67be53f8c355 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.638372 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0712f4-d9d6-4f28-8cee-5b6f9311d782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.640881 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0712f4-d9d6-4f28-8cee-5b6f9311d782 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.641393 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0712f4-d9d6-4f28-8cee-5b6f9311d782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.641923 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0712f4-d9d6-4f28-8cee-5b6f9311d782 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.649985 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ffd539-3352-4656-a6ac-67be53f8c355 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.655646 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0712f4-d9d6-4f28-8cee-5b6f9311d782 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:50.656677 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcc329-a7d7-44c3-9a7a-f95fa47f5268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.657427 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcc329-a7d7-44c3-9a7a-f95fa47f5268 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.657648 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcc329-a7d7-44c3-9a7a-f95fa47f5268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.657918 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcc329-a7d7-44c3-9a7a-f95fa47f5268 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.658988 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabcc329-a7d7-44c3-9a7a-f95fa47f5268 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:50.660514 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabcc329-a7d7-44c3-9a7a-f95fa47f5268 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:50.660629 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0712f4-d9d6-4f28-8cee-5b6f9311d782 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:50.660707 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING py.warnings [None req-cabcc329-a7d7-44c3-9a7a-f95fa47f5268 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:24:50.660707 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: warnings.warn(msg) Oct 28 14:24:50.660707 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: Oct 28 14:24:50.661782 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabcc329-a7d7-44c3-9a7a-f95fa47f5268 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:50.681847 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-8f0712f4-d9d6-4f28-8cee-5b6f9311d782 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:50.690591 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 202/402] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:50.690591 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcc329-a7d7-44c3-9a7a-f95fa47f5268 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.691369 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 200/402] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:50.692688 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0712f4-d9d6-4f28-8cee-5b6f9311d782 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.703031 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcc329-a7d7-44c3-9a7a-f95fa47f5268 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.709771 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0712f4-d9d6-4f28-8cee-5b6f9311d782 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.711305 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23bf2d-b81a-45d5-8e3e-72b79f9d3c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.712347 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23bf2d-b81a-45d5-8e3e-72b79f9d3c6f admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.713328 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23bf2d-b81a-45d5-8e3e-72b79f9d3c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.713804 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23bf2d-b81a-45d5-8e3e-72b79f9d3c6f admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.715708 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23bf2d-b81a-45d5-8e3e-72b79f9d3c6f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:50.716263 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23bf2d-b81a-45d5-8e3e-72b79f9d3c6f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:50.718217 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266269a-1828-4f5e-9333-add0128ab4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.718700 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23bf2d-b81a-45d5-8e3e-72b79f9d3c6f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:50.718921 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266269a-1828-4f5e-9333-add0128ab4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.719194 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266269a-1828-4f5e-9333-add0128ab4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.719474 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266269a-1828-4f5e-9333-add0128ab4e8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.720333 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266269a-1828-4f5e-9333-add0128ab4e8 admin admin] RBAC: Adding query filter params (role.id=1ee8b426ca9a49e5b7fb33be19e8a616, scope.project.id=b433200db4784bfeadca48d24212e823, user.id=18cd6636ae7847c78be910824410d295) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:50.720644 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266269a-1828-4f5e-9333-add0128ab4e8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:50.722500 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266269a-1828-4f5e-9333-add0128ab4e8 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:50.728718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 201/403] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/role_assignments?user.id=18cd6636ae7847c78be910824410d295&scope.project.id=b433200db4784bfeadca48d24212e823&role.id=1ee8b426ca9a49e5b7fb33be19e8a616 => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:50.735676 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266269a-1828-4f5e-9333-add0128ab4e8 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.743097 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 203/404] 10.222.0.79 () {56 vars in 1158 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:50.753514 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266269a-1828-4f5e-9333-add0128ab4e8 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.760135 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23bf2d-b81a-45d5-8e3e-72b79f9d3c6f admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.766748 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77fe80-9d4a-4090-8fdf-cc3561052610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.766748 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77fe80-9d4a-4090-8fdf-cc3561052610 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.766748 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77fe80-9d4a-4090-8fdf-cc3561052610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.766748 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77fe80-9d4a-4090-8fdf-cc3561052610 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.767207 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de77fe80-9d4a-4090-8fdf-cc3561052610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:50.767207 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de77fe80-9d4a-4090-8fdf-cc3561052610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:50.767207 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de77fe80-9d4a-4090-8fdf-cc3561052610 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:50.780590 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23bf2d-b81a-45d5-8e3e-72b79f9d3c6f admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.789952 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161da98d-7e53-4c2e-a79e-219da85e9be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.791833 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161da98d-7e53-4c2e-a79e-219da85e9be6 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.792102 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161da98d-7e53-4c2e-a79e-219da85e9be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.798850 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 202/405] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:50.799349 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161da98d-7e53-4c2e-a79e-219da85e9be6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.807810 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77fe80-9d4a-4090-8fdf-cc3561052610 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.818649 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161da98d-7e53-4c2e-a79e-219da85e9be6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:50.820526 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161da98d-7e53-4c2e-a79e-219da85e9be6 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:50.821452 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77fe80-9d4a-4090-8fdf-cc3561052610 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.827000 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfd663-32e8-4579-aef6-a486695dd610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.828069 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfd663-32e8-4579-aef6-a486695dd610 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.828484 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfd663-32e8-4579-aef6-a486695dd610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.828924 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfd663-32e8-4579-aef6-a486695dd610 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.832542 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 204/406] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:50.837798 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfd663-32e8-4579-aef6-a486695dd610 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:50.839340 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aefac7-81db-4c26-b0b8-f35fa613af5a None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.839631 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aefac7-81db-4c26-b0b8-f35fa613af5a None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.839912 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aefac7-81db-4c26-b0b8-f35fa613af5a None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.840760 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfd663-32e8-4579-aef6-a486695dd610 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:50.847021 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 205/407] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:50 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:50.847021 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aefac7-81db-4c26-b0b8-f35fa613af5a None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.858543 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aefac7-81db-4c26-b0b8-f35fa613af5a None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.863147 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039e79d-d944-4dfe-b01f-c35d3c655685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.863818 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-9fcfd663-32e8-4579-aef6-a486695dd610 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 14:24:50.863959 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039e79d-d944-4dfe-b01f-c35d3c655685 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.864244 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039e79d-d944-4dfe-b01f-c35d3c655685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.864518 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039e79d-d944-4dfe-b01f-c35d3c655685 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.866089 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 203/408] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/users/cinder => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:50.867640 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba107e-94f9-4368-af41-41df19f7af19 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.868118 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba107e-94f9-4368-af41-41df19f7af19 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.868607 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba107e-94f9-4368-af41-41df19f7af19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.882841 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039e79d-d944-4dfe-b01f-c35d3c655685 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:50.884594 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039e79d-d944-4dfe-b01f-c35d3c655685 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:50.889557 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-92ba107e-94f9-4368-af41-41df19f7af19 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:50.891078 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-92ba107e-94f9-4368-af41-41df19f7af19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:50.904497 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-7039e79d-d944-4dfe-b01f-c35d3c655685 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:50.905806 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 204/409] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:50.911261 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 206/410] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:50.911616 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba107e-94f9-4368-af41-41df19f7af19 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.912574 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039e79d-d944-4dfe-b01f-c35d3c655685 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.926759 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039e79d-d944-4dfe-b01f-c35d3c655685 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.928687 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1d799-27fd-4f62-aa47-84f2d41f9da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.929031 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1d799-27fd-4f62-aa47-84f2d41f9da7 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.929321 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1d799-27fd-4f62-aa47-84f2d41f9da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.929592 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1d799-27fd-4f62-aa47-84f2d41f9da7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.930446 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1d799-27fd-4f62-aa47-84f2d41f9da7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:50.930808 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1d799-27fd-4f62-aa47-84f2d41f9da7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:50.932402 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1d799-27fd-4f62-aa47-84f2d41f9da7 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:50.941026 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba107e-94f9-4368-af41-41df19f7af19 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.946068 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045d7ea-fe57-4f8f-b6ad-92e81d28f175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.947238 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045d7ea-fe57-4f8f-b6ad-92e81d28f175 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.947761 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045d7ea-fe57-4f8f-b6ad-92e81d28f175 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.948362 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045d7ea-fe57-4f8f-b6ad-92e81d28f175 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.949550 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045d7ea-fe57-4f8f-b6ad-92e81d28f175 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:50.950053 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045d7ea-fe57-4f8f-b6ad-92e81d28f175 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:50.951358 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 207/411] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:50.952004 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING py.warnings [None req-c045d7ea-fe57-4f8f-b6ad-92e81d28f175 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:24:50.952004 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: warnings.warn(msg) Oct 28 14:24:50.952004 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: Oct 28 14:24:50.952357 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1d799-27fd-4f62-aa47-84f2d41f9da7 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:50.953901 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045d7ea-fe57-4f8f-b6ad-92e81d28f175 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:50.962891 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1d799-27fd-4f62-aa47-84f2d41f9da7 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:50.967932 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e57f3-c96a-4df7-865b-b10871a773c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:50.968325 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e57f3-c96a-4df7-865b-b10871a773c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:50.968612 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e57f3-c96a-4df7-865b-b10871a773c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:50.968889 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e57f3-c96a-4df7-865b-b10871a773c1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:50.981307 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e57f3-c96a-4df7-865b-b10871a773c1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:50.988399 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-b24e57f3-c96a-4df7-865b-b10871a773c1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 14:24:50.989792 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 208/412] 10.222.0.79 () {56 vars in 1123 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:50.994711 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e57f3-c96a-4df7-865b-b10871a773c1 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:51.003925 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 205/413] 10.222.0.79 () {56 vars in 1158 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:51.004916 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e57f3-c96a-4df7-865b-b10871a773c1 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:51.007507 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045d7ea-fe57-4f8f-b6ad-92e81d28f175 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:51.014491 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf74201-8dcd-4fb5-86ea-c73e54cfc5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:51.015827 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf74201-8dcd-4fb5-86ea-c73e54cfc5af admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:51.015827 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf74201-8dcd-4fb5-86ea-c73e54cfc5af admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:51.016015 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf74201-8dcd-4fb5-86ea-c73e54cfc5af admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:51.019486 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045d7ea-fe57-4f8f-b6ad-92e81d28f175 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:51.024288 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5b6bd-740d-410a-ab25-6b23ba91b77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:51.024504 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf74201-8dcd-4fb5-86ea-c73e54cfc5af admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:51.025357 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5b6bd-740d-410a-ab25-6b23ba91b77b admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:51.025825 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5b6bd-740d-410a-ab25-6b23ba91b77b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:51.026280 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5b6bd-740d-410a-ab25-6b23ba91b77b admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:51.026655 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf74201-8dcd-4fb5-86ea-c73e54cfc5af admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:51.027463 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5b6bd-740d-410a-ab25-6b23ba91b77b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:51.027954 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5b6bd-740d-410a-ab25-6b23ba91b77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:51.029756 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5b6bd-740d-410a-ab25-6b23ba91b77b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:51.038652 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 206/414] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Oct 28 14:24:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:51.043981 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-daf74201-8dcd-4fb5-86ea-c73e54cfc5af admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:24:51.043981 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 209/415] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:51.043981 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf74201-8dcd-4fb5-86ea-c73e54cfc5af admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:51.045698 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5b6bd-740d-410a-ab25-6b23ba91b77b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:51.056822 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf74201-8dcd-4fb5-86ea-c73e54cfc5af admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:51.063322 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58e531-54e8-446d-93b2-06caa837acdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:51.064223 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58e531-54e8-446d-93b2-06caa837acdc admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:51.064726 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58e531-54e8-446d-93b2-06caa837acdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:51.064837 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5b6bd-740d-410a-ab25-6b23ba91b77b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:51.065288 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58e531-54e8-446d-93b2-06caa837acdc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:51.069475 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc6d60-844d-48af-8b59-fe8f1affde32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:51.070363 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc6d60-844d-48af-8b59-fe8f1affde32 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:51.070650 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc6d60-844d-48af-8b59-fe8f1affde32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:51.071144 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc6d60-844d-48af-8b59-fe8f1affde32 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:51.075536 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58e531-54e8-446d-93b2-06caa837acdc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:51.077557 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58e531-54e8-446d-93b2-06caa837acdc admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:51.084434 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc6d60-844d-48af-8b59-fe8f1affde32 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:51.086709 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc6d60-844d-48af-8b59-fe8f1affde32 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:51.088935 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 210/416] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:51.089975 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58e531-54e8-446d-93b2-06caa837acdc admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:51.099571 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58e531-54e8-446d-93b2-06caa837acdc admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:51.105745 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e8518-6189-48e0-8848-084f5e5268eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:51.106650 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e8518-6189-48e0-8848-084f5e5268eb admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:51.107120 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e8518-6189-48e0-8848-084f5e5268eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:51.107576 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e8518-6189-48e0-8848-084f5e5268eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:51.108556 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e8518-6189-48e0-8848-084f5e5268eb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:51.109071 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e8518-6189-48e0-8848-084f5e5268eb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:51.111150 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e8518-6189-48e0-8848-084f5e5268eb admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:51.111685 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-4dcc6d60-844d-48af-8b59-fe8f1affde32 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:51.117982 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 207/417] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:51.117982 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc6d60-844d-48af-8b59-fe8f1affde32 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:51.124705 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc6d60-844d-48af-8b59-fe8f1affde32 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:51.130168 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 211/418] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:24:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:51.131228 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e8518-6189-48e0-8848-084f5e5268eb admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:51.135245 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7da858-b9bd-4074-a975-e02f30c9d3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:51.136389 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7da858-b9bd-4074-a975-e02f30c9d3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:51.137094 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7da858-b9bd-4074-a975-e02f30c9d3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:51.138988 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7da858-b9bd-4074-a975-e02f30c9d3b5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:51.146442 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e8518-6189-48e0-8848-084f5e5268eb admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:51.152042 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8db8f-5cf9-4532-9bc3-5d8a5efe5439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:51.153077 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8db8f-5cf9-4532-9bc3-5d8a5efe5439 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:51.153466 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8db8f-5cf9-4532-9bc3-5d8a5efe5439 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:51.153817 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7da858-b9bd-4074-a975-e02f30c9d3b5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:51.153939 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8db8f-5cf9-4532-9bc3-5d8a5efe5439 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:51.154763 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8db8f-5cf9-4532-9bc3-5d8a5efe5439 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:51.155160 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8db8f-5cf9-4532-9bc3-5d8a5efe5439 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:51.156449 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7da858-b9bd-4074-a975-e02f30c9d3b5 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:51.156941 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8db8f-5cf9-4532-9bc3-5d8a5efe5439 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:51.176588 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-6e7da858-b9bd-4074-a975-e02f30c9d3b5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:51.176892 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 212/419] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:51.177818 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8db8f-5cf9-4532-9bc3-5d8a5efe5439 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:51.183654 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 208/420] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:51.184492 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7da858-b9bd-4074-a975-e02f30c9d3b5 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:51.192601 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8db8f-5cf9-4532-9bc3-5d8a5efe5439 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:51.198100 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff64d4-363d-4c93-b25c-3895de70e2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:51.198886 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff64d4-363d-4c93-b25c-3895de70e2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:51.199082 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7da858-b9bd-4074-a975-e02f30c9d3b5 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:51.199349 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff64d4-363d-4c93-b25c-3895de70e2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:51.199711 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff64d4-363d-4c93-b25c-3895de70e2c1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:51.200644 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff64d4-363d-4c93-b25c-3895de70e2c1 admin admin] RBAC: Adding query filter params (role.id=1ee8b426ca9a49e5b7fb33be19e8a616, scope.project.id=b433200db4784bfeadca48d24212e823, user.id=73a98d6cf23e4710bfbf71b960f81a9e) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:51.201067 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff64d4-363d-4c93-b25c-3895de70e2c1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:51.203171 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff64d4-363d-4c93-b25c-3895de70e2c1 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:51.204862 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b70ae2-2ae4-4b04-8a25-25915791f2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:51.206019 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b70ae2-2ae4-4b04-8a25-25915791f2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:51.206931 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b70ae2-2ae4-4b04-8a25-25915791f2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:51.207498 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b70ae2-2ae4-4b04-8a25-25915791f2e5 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:51.214717 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 213/421] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:24:51 2021] GET /identity/v3/role_assignments?user.id=73a98d6cf23e4710bfbf71b960f81a9e&scope.project.id=b433200db4784bfeadca48d24212e823&role.id=1ee8b426ca9a49e5b7fb33be19e8a616 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:51.214717 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff64d4-363d-4c93-b25c-3895de70e2c1 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:51.227269 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b70ae2-2ae4-4b04-8a25-25915791f2e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:51.231862 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b70ae2-2ae4-4b04-8a25-25915791f2e5 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:51.232919 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff64d4-363d-4c93-b25c-3895de70e2c1 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:51.246451 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae918c33-d14e-4cfd-b910-abdc6a85d8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:51.247463 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae918c33-d14e-4cfd-b910-abdc6a85d8fb admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:51.247841 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae918c33-d14e-4cfd-b910-abdc6a85d8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:51.248207 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae918c33-d14e-4cfd-b910-abdc6a85d8fb admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:51.249195 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae918c33-d14e-4cfd-b910-abdc6a85d8fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:51.250220 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae918c33-d14e-4cfd-b910-abdc6a85d8fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:51.255554 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae918c33-d14e-4cfd-b910-abdc6a85d8fb admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:51.262289 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-27b70ae2-2ae4-4b04-8a25-25915791f2e5 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 14:24:51.264492 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 209/422] 10.222.0.79 () {56 vars in 1123 bytes} [Thu Oct 28 14:24:51 2021] GET /identity/v3/users/neutron => generated 85 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:51.274844 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 214/423] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:51.276124 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b70ae2-2ae4-4b04-8a25-25915791f2e5 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:51.282394 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae918c33-d14e-4cfd-b910-abdc6a85d8fb admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:51.293337 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b70ae2-2ae4-4b04-8a25-25915791f2e5 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:51.302944 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa7712-1a85-4c8c-a7b2-ac6f0199d4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:51.303878 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae918c33-d14e-4cfd-b910-abdc6a85d8fb admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:51.305336 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa7712-1a85-4c8c-a7b2-ac6f0199d4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:51.305794 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa7712-1a85-4c8c-a7b2-ac6f0199d4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:51.306514 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa7712-1a85-4c8c-a7b2-ac6f0199d4d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:51.308364 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa7712-1a85-4c8c-a7b2-ac6f0199d4d3 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:51.309310 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa7712-1a85-4c8c-a7b2-ac6f0199d4d3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:51.313268 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa7712-1a85-4c8c-a7b2-ac6f0199d4d3 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:51.314129 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bab582-24a3-4d95-b3ec-d58a8149bcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:51.315255 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bab582-24a3-4d95-b3ec-d58a8149bcf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:51.317641 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bab582-24a3-4d95-b3ec-d58a8149bcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:51.318021 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bab582-24a3-4d95-b3ec-d58a8149bcf4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:51.339869 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bab582-24a3-4d95-b3ec-d58a8149bcf4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:51.344865 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bab582-24a3-4d95-b3ec-d58a8149bcf4 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:51.354891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 210/424] 10.222.0.79 () {56 vars in 1160 bytes} [Thu Oct 28 14:24:51 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:51.359762 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa7712-1a85-4c8c-a7b2-ac6f0199d4d3 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:51.376389 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-07bab582-24a3-4d95-b3ec-d58a8149bcf4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:24:51.383130 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 215/425] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:51.385951 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156469f9-3ae7-405b-926c-7ac1cbbbc29b None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:51.385951 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156469f9-3ae7-405b-926c-7ac1cbbbc29b None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:51.385951 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156469f9-3ae7-405b-926c-7ac1cbbbc29b None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:51.387021 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa7712-1a85-4c8c-a7b2-ac6f0199d4d3 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:51.387466 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 216/426] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:51.392519 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad5d7f-ead6-47c5-b165-2775f4a2286f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:51.393394 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156469f9-3ae7-405b-926c-7ac1cbbbc29b None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:51.393597 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad5d7f-ead6-47c5-b165-2775f4a2286f admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:51.394106 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad5d7f-ead6-47c5-b165-2775f4a2286f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:51.394618 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad5d7f-ead6-47c5-b165-2775f4a2286f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:51.405626 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad5d7f-ead6-47c5-b165-2775f4a2286f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:51.406521 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156469f9-3ae7-405b-926c-7ac1cbbbc29b None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:51.408422 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad5d7f-ead6-47c5-b165-2775f4a2286f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:51.411768 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842da528-9554-418f-b78b-3f72fc6aa5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:51.412448 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842da528-9554-418f-b78b-3f72fc6aa5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:51.412783 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842da528-9554-418f-b78b-3f72fc6aa5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:51.413060 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842da528-9554-418f-b78b-3f72fc6aa5f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:51.413984 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842da528-9554-418f-b78b-3f72fc6aa5f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:51.414294 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842da528-9554-418f-b78b-3f72fc6aa5f7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:51.416283 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842da528-9554-418f-b78b-3f72fc6aa5f7 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:51.422004 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 211/427] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:24:51.424239 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03aa72-eb83-4135-8b2c-cb944827383c None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:51.424784 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03aa72-eb83-4135-8b2c-cb944827383c None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:51.425202 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03aa72-eb83-4135-8b2c-cb944827383c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:51.434830 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 217/428] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:24:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:51.434830 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842da528-9554-418f-b78b-3f72fc6aa5f7 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:51.446541 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842da528-9554-418f-b78b-3f72fc6aa5f7 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:51.451562 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02edc36-72e8-44ae-a994-837734a9a1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:51.452763 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02edc36-72e8-44ae-a994-837734a9a1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:51.453158 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-fe03aa72-eb83-4135-8b2c-cb944827383c None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:51.453425 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02edc36-72e8-44ae-a994-837734a9a1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:51.453852 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02edc36-72e8-44ae-a994-837734a9a1c4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:51.454374 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-fe03aa72-eb83-4135-8b2c-cb944827383c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:51.462967 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 212/429] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:51.463830 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03aa72-eb83-4135-8b2c-cb944827383c None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:51.469062 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02edc36-72e8-44ae-a994-837734a9a1c4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:51.471941 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02edc36-72e8-44ae-a994-837734a9a1c4 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:51.484047 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03aa72-eb83-4135-8b2c-cb944827383c None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:51.491530 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb6bc2-a539-4aa2-852f-c9e9f008b6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:51.492359 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb6bc2-a539-4aa2-852f-c9e9f008b6ca admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:51.492820 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb6bc2-a539-4aa2-852f-c9e9f008b6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:51.493178 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb6bc2-a539-4aa2-852f-c9e9f008b6ca admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:51.493310 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-c02edc36-72e8-44ae-a994-837734a9a1c4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:51.494259 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb6bc2-a539-4aa2-852f-c9e9f008b6ca admin admin] RBAC: Adding query filter params (role.id=1ee8b426ca9a49e5b7fb33be19e8a616, scope.project.id=b433200db4784bfeadca48d24212e823, user.id=218708788ed447499b00de12cff0f6e5) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:51.494723 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb6bc2-a539-4aa2-852f-c9e9f008b6ca admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:51.495444 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 218/430] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:51.496414 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02edc36-72e8-44ae-a994-837734a9a1c4 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:51.500414 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb6bc2-a539-4aa2-852f-c9e9f008b6ca admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:51.508999 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02edc36-72e8-44ae-a994-837734a9a1c4 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:51.513592 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae113044-6502-4782-8b20-4e75fccfc93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:51.514824 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 213/431] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:24:51 2021] GET /identity/v3/role_assignments?user.id=218708788ed447499b00de12cff0f6e5&scope.project.id=b433200db4784bfeadca48d24212e823&role.id=1ee8b426ca9a49e5b7fb33be19e8a616 => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:51.515293 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae113044-6502-4782-8b20-4e75fccfc93c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:51.515570 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae113044-6502-4782-8b20-4e75fccfc93c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:51.515825 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb6bc2-a539-4aa2-852f-c9e9f008b6ca admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:51.515922 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae113044-6502-4782-8b20-4e75fccfc93c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:51.528408 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae113044-6502-4782-8b20-4e75fccfc93c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:51.530247 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae113044-6502-4782-8b20-4e75fccfc93c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:51.537286 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb6bc2-a539-4aa2-852f-c9e9f008b6ca admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:51.548888 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-ae113044-6502-4782-8b20-4e75fccfc93c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:51.550710 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 219/432] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:51.558162 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae113044-6502-4782-8b20-4e75fccfc93c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:51.558352 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869076ab-f1c0-4071-8e53-f1072224972d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:51.558937 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869076ab-f1c0-4071-8e53-f1072224972d admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:51.559216 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869076ab-f1c0-4071-8e53-f1072224972d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:51.559484 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869076ab-f1c0-4071-8e53-f1072224972d admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:51.560234 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869076ab-f1c0-4071-8e53-f1072224972d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:51.560536 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869076ab-f1c0-4071-8e53-f1072224972d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:51.562146 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869076ab-f1c0-4071-8e53-f1072224972d admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:51.569110 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae113044-6502-4782-8b20-4e75fccfc93c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:51.574067 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5be59-1941-4713-b790-c29114aefb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:51.574904 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5be59-1941-4713-b790-c29114aefb6a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:51.575277 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5be59-1941-4713-b790-c29114aefb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:51.575658 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5be59-1941-4713-b790-c29114aefb6a admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:51.576487 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5be59-1941-4713-b790-c29114aefb6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:51.576895 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5be59-1941-4713-b790-c29114aefb6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:51.578741 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5be59-1941-4713-b790-c29114aefb6a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:51.592609 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 220/433] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:51.593003 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 214/434] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:51.599063 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869076ab-f1c0-4071-8e53-f1072224972d admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:51.599246 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5be59-1941-4713-b790-c29114aefb6a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:51.610037 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5be59-1941-4713-b790-c29114aefb6a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:51.615043 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf10ac6-7502-4167-9aa7-40ff020a3842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:51.615865 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf10ac6-7502-4167-9aa7-40ff020a3842 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:51.616219 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf10ac6-7502-4167-9aa7-40ff020a3842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:51.616568 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf10ac6-7502-4167-9aa7-40ff020a3842 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:51.617416 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf10ac6-7502-4167-9aa7-40ff020a3842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:51.618927 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869076ab-f1c0-4071-8e53-f1072224972d admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:51.619839 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf10ac6-7502-4167-9aa7-40ff020a3842 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:51.635417 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08390420-2fbc-4486-9f19-b94efdfd3de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:51.636246 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08390420-2fbc-4486-9f19-b94efdfd3de5 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:51.636526 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08390420-2fbc-4486-9f19-b94efdfd3de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:51.636797 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08390420-2fbc-4486-9f19-b94efdfd3de5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:51.645779 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08390420-2fbc-4486-9f19-b94efdfd3de5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:51.648132 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08390420-2fbc-4486-9f19-b94efdfd3de5 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:51.657321 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 221/435] 10.222.0.79 () {60 vars in 1153 bytes} [Thu Oct 28 14:24:51 2021] POST /identity/v3/users => generated 247 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:24:51.672213 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-08390420-2fbc-4486-9f19-b94efdfd3de5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:24:51.673925 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 215/436] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:51.684038 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf10ac6-7502-4167-9aa7-40ff020a3842 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:51.700844 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf10ac6-7502-4167-9aa7-40ff020a3842 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:51.706740 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5feb4-c4ea-43bb-b090-716cc95d8b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:51.707529 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5feb4-c4ea-43bb-b090-716cc95d8b37 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:51.707810 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5feb4-c4ea-43bb-b090-716cc95d8b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:51.708078 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5feb4-c4ea-43bb-b090-716cc95d8b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:51.709025 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5feb4-c4ea-43bb-b090-716cc95d8b37 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:51.709399 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5feb4-c4ea-43bb-b090-716cc95d8b37 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:51.711498 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5feb4-c4ea-43bb-b090-716cc95d8b37 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:51.731591 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 222/437] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:24:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:51.738800 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08390420-2fbc-4486-9f19-b94efdfd3de5 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:51.751029 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08390420-2fbc-4486-9f19-b94efdfd3de5 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:51.758082 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f4c75-3404-4175-b71e-18ed7b381a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:51.758838 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f4c75-3404-4175-b71e-18ed7b381a3a admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:51.759160 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f4c75-3404-4175-b71e-18ed7b381a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:51.759429 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f4c75-3404-4175-b71e-18ed7b381a3a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:51.760327 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f4c75-3404-4175-b71e-18ed7b381a3a admin admin] RBAC: Adding query filter params (role.id=1ee8b426ca9a49e5b7fb33be19e8a616, scope.project.id=b433200db4784bfeadca48d24212e823, user.id=a689fc75b37b4557a682f6cad357df6c) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:51.760635 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f4c75-3404-4175-b71e-18ed7b381a3a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:51.762625 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f4c75-3404-4175-b71e-18ed7b381a3a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:51.772117 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 216/438] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:24:51 2021] GET /identity/v3/role_assignments?user.id=a689fc75b37b4557a682f6cad357df6c&scope.project.id=b433200db4784bfeadca48d24212e823&role.id=1ee8b426ca9a49e5b7fb33be19e8a616 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:53.186035 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45ceef-9bcd-4c81-98a7-1dedad491f2c None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:53.186534 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45ceef-9bcd-4c81-98a7-1dedad491f2c None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:53.186534 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45ceef-9bcd-4c81-98a7-1dedad491f2c None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:53.188522 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 223/439] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:53.201024 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e3fe7-764b-4ac7-9930-094c9d373cd6 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:53.201472 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e3fe7-764b-4ac7-9930-094c9d373cd6 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:53.201650 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e3fe7-764b-4ac7-9930-094c9d373cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:53.231657 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-bb4e3fe7-764b-4ac7-9930-094c9d373cd6 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:53.232857 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-bb4e3fe7-764b-4ac7-9930-094c9d373cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:53.240778 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 217/440] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:24:53.279062 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45ceef-9bcd-4c81-98a7-1dedad491f2c None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:53.296258 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45ceef-9bcd-4c81-98a7-1dedad491f2c None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:53.300720 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dad44d-6771-4add-a9ac-1735e33143ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:53.301879 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dad44d-6771-4add-a9ac-1735e33143ce admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:53.302154 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dad44d-6771-4add-a9ac-1735e33143ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:53.302424 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dad44d-6771-4add-a9ac-1735e33143ce admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:53.321890 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dad44d-6771-4add-a9ac-1735e33143ce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:53.328917 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-f8dad44d-6771-4add-a9ac-1735e33143ce admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 14:24:53.330156 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 224/441] 10.222.0.79 () {56 vars in 1123 bytes} [Thu Oct 28 14:24:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:53.336630 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e3fe7-764b-4ac7-9930-094c9d373cd6 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:53.352150 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e3fe7-764b-4ac7-9930-094c9d373cd6 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:53.362293 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b52bb-14a8-48dc-9d5d-afd4971405c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:53.362995 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b52bb-14a8-48dc-9d5d-afd4971405c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:53.363277 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b52bb-14a8-48dc-9d5d-afd4971405c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:53.363542 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b52bb-14a8-48dc-9d5d-afd4971405c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:53.364309 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b52bb-14a8-48dc-9d5d-afd4971405c9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:53.364605 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b52bb-14a8-48dc-9d5d-afd4971405c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:53.366200 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b52bb-14a8-48dc-9d5d-afd4971405c9 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:53.382074 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 218/442] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Oct 28 14:24:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:53.388126 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dad44d-6771-4add-a9ac-1735e33143ce admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:53.404522 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dad44d-6771-4add-a9ac-1735e33143ce admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:53.414908 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39a54e-0cac-41f7-b0db-a81278749365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:53.415704 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39a54e-0cac-41f7-b0db-a81278749365 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:53.415956 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39a54e-0cac-41f7-b0db-a81278749365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:53.416234 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39a54e-0cac-41f7-b0db-a81278749365 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:53.434064 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39a54e-0cac-41f7-b0db-a81278749365 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:53.435969 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39a54e-0cac-41f7-b0db-a81278749365 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:53.461609 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-ff39a54e-0cac-41f7-b0db-a81278749365 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:53.463110 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 225/443] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:53.469297 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b52bb-14a8-48dc-9d5d-afd4971405c9 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:53.492818 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b52bb-14a8-48dc-9d5d-afd4971405c9 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:53.499811 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ff199-2d31-46f5-b0f0-d3002494147e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:53.500482 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ff199-2d31-46f5-b0f0-d3002494147e admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:53.500760 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ff199-2d31-46f5-b0f0-d3002494147e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:53.501032 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ff199-2d31-46f5-b0f0-d3002494147e admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:53.501844 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ff199-2d31-46f5-b0f0-d3002494147e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:53.502143 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ff199-2d31-46f5-b0f0-d3002494147e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:53.503760 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ff199-2d31-46f5-b0f0-d3002494147e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:53.524248 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 219/444] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:53.530197 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39a54e-0cac-41f7-b0db-a81278749365 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:53.543839 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39a54e-0cac-41f7-b0db-a81278749365 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:53.555063 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6280c0-8c6b-4e92-85ef-a35aa4e1fb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:53.556127 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6280c0-8c6b-4e92-85ef-a35aa4e1fb4e admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:53.556555 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6280c0-8c6b-4e92-85ef-a35aa4e1fb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:53.556970 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6280c0-8c6b-4e92-85ef-a35aa4e1fb4e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:53.571878 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6280c0-8c6b-4e92-85ef-a35aa4e1fb4e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:53.574104 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6280c0-8c6b-4e92-85ef-a35aa4e1fb4e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:53.598270 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-bb6280c0-8c6b-4e92-85ef-a35aa4e1fb4e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 14:24:53.600046 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 226/445] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Oct 28 14:24:53 2021] GET /identity/v3/users/nova => generated 82 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:53.606476 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ff199-2d31-46f5-b0f0-d3002494147e admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:53.619860 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ff199-2d31-46f5-b0f0-d3002494147e admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:53.629600 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc30e9-31ec-43ff-b2aa-8477a7282d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:53.630526 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc30e9-31ec-43ff-b2aa-8477a7282d1a admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:53.630983 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc30e9-31ec-43ff-b2aa-8477a7282d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:53.631394 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc30e9-31ec-43ff-b2aa-8477a7282d1a admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:53.632400 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc30e9-31ec-43ff-b2aa-8477a7282d1a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:53.632851 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc30e9-31ec-43ff-b2aa-8477a7282d1a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:53.635032 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc30e9-31ec-43ff-b2aa-8477a7282d1a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:53.664916 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 220/446] 10.222.0.79 () {56 vars in 1154 bytes} [Thu Oct 28 14:24:53 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:53.671286 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6280c0-8c6b-4e92-85ef-a35aa4e1fb4e admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:53.687861 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6280c0-8c6b-4e92-85ef-a35aa4e1fb4e admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:53.696236 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059cc02-067b-4b13-9443-6a4229b0da00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:53.697281 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059cc02-067b-4b13-9443-6a4229b0da00 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:53.697722 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059cc02-067b-4b13-9443-6a4229b0da00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:53.698156 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059cc02-067b-4b13-9443-6a4229b0da00 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:53.715357 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059cc02-067b-4b13-9443-6a4229b0da00 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:53.717442 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059cc02-067b-4b13-9443-6a4229b0da00 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:53.739048 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-2059cc02-067b-4b13-9443-6a4229b0da00 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:53.740667 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 227/447] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:53.746716 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc30e9-31ec-43ff-b2aa-8477a7282d1a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:53.765134 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc30e9-31ec-43ff-b2aa-8477a7282d1a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:53.773635 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91347c-b43c-4f66-93b0-ca3f7c6d6d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:53.774706 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91347c-b43c-4f66-93b0-ca3f7c6d6d04 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:53.775133 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91347c-b43c-4f66-93b0-ca3f7c6d6d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:53.775547 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91347c-b43c-4f66-93b0-ca3f7c6d6d04 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:53.776434 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91347c-b43c-4f66-93b0-ca3f7c6d6d04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:53.776883 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91347c-b43c-4f66-93b0-ca3f7c6d6d04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:53.778661 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91347c-b43c-4f66-93b0-ca3f7c6d6d04 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:53.795944 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 221/448] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:53.802189 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059cc02-067b-4b13-9443-6a4229b0da00 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:53.817855 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059cc02-067b-4b13-9443-6a4229b0da00 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:53.825942 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837acaf3-1046-4ac2-b7af-2f4cc7796187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:53.826824 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837acaf3-1046-4ac2-b7af-2f4cc7796187 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:53.827107 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837acaf3-1046-4ac2-b7af-2f4cc7796187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:53.827426 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837acaf3-1046-4ac2-b7af-2f4cc7796187 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:53.836097 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837acaf3-1046-4ac2-b7af-2f4cc7796187 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:53.838399 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837acaf3-1046-4ac2-b7af-2f4cc7796187 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:53.862216 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-837acaf3-1046-4ac2-b7af-2f4cc7796187 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:24:53.868568 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 228/449] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:53.869912 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91347c-b43c-4f66-93b0-ca3f7c6d6d04 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:53.886735 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91347c-b43c-4f66-93b0-ca3f7c6d6d04 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:53.895949 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6cfcb-a1d9-4938-802a-716f43ddab33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:53.896870 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6cfcb-a1d9-4938-802a-716f43ddab33 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:53.897295 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6cfcb-a1d9-4938-802a-716f43ddab33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:53.897721 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6cfcb-a1d9-4938-802a-716f43ddab33 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:53.898749 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a6cfcb-a1d9-4938-802a-716f43ddab33 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:53.899235 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a6cfcb-a1d9-4938-802a-716f43ddab33 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:53.900450 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING py.warnings [None req-76a6cfcb-a1d9-4938-802a-716f43ddab33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:24:53.900450 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: warnings.warn(msg) Oct 28 14:24:53.900450 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: Oct 28 14:24:53.901886 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a6cfcb-a1d9-4938-802a-716f43ddab33 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:53.933955 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 222/450] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:24:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:53.940392 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837acaf3-1046-4ac2-b7af-2f4cc7796187 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:53.957017 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837acaf3-1046-4ac2-b7af-2f4cc7796187 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:53.973366 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a0eb7-f675-4887-8db5-ddc893b804ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:53.974203 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a0eb7-f675-4887-8db5-ddc893b804ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:53.974474 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a0eb7-f675-4887-8db5-ddc893b804ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:53.974773 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a0eb7-f675-4887-8db5-ddc893b804ce admin admin] PATH_INFO: `/v3/projects/b433200db4784bfeadca48d24212e823/users/18cd6636ae7847c78be910824410d295/roles/1ee8b426ca9a49e5b7fb33be19e8a616` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:53.996107 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a0eb7-f675-4887-8db5-ddc893b804ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b433200db4784bfeadca48d24212e823, user_id=18cd6636ae7847c78be910824410d295, role_id=1ee8b426ca9a49e5b7fb33be19e8a616)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:53.998846 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a0eb7-f675-4887-8db5-ddc893b804ce admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:54.014193 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd464bef-9d8a-461d-a24b-eaa53b4d3bbb None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.014486 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd464bef-9d8a-461d-a24b-eaa53b4d3bbb None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.014807 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd464bef-9d8a-461d-a24b-eaa53b4d3bbb None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.016769 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 223/451] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 14:24:54.022779 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 229/452] 10.222.0.79 () {58 vars in 1460 bytes} [Thu Oct 28 14:24:53 2021] PUT /identity/v3/projects/b433200db4784bfeadca48d24212e823/users/18cd6636ae7847c78be910824410d295/roles/1ee8b426ca9a49e5b7fb33be19e8a616 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:24:54.027744 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c8de2-be83-47df-8be0-f5078f9cde2c None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.028041 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c8de2-be83-47df-8be0-f5078f9cde2c None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.028334 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c8de2-be83-47df-8be0-f5078f9cde2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.068709 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-b78c8de2-be83-47df-8be0-f5078f9cde2c None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:54.069969 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-b78c8de2-be83-47df-8be0-f5078f9cde2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:54.161078 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 224/453] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:54.196672 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a0eb7-f675-4887-8db5-ddc893b804ce admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:54.215077 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a0eb7-f675-4887-8db5-ddc893b804ce admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:54.220061 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698a5e8-3ea4-4d5d-91de-07112ff2834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:54.221249 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698a5e8-3ea4-4d5d-91de-07112ff2834c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.221807 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698a5e8-3ea4-4d5d-91de-07112ff2834c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.222338 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698a5e8-3ea4-4d5d-91de-07112ff2834c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.242361 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698a5e8-3ea4-4d5d-91de-07112ff2834c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:54.250006 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-a698a5e8-3ea4-4d5d-91de-07112ff2834c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 14:24:54.251841 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 230/454] 10.222.0.79 () {56 vars in 1123 bytes} [Thu Oct 28 14:24:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:54.258140 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c8de2-be83-47df-8be0-f5078f9cde2c None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:54.268997 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c8de2-be83-47df-8be0-f5078f9cde2c None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:54.275460 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ab3a8-890c-4629-9693-4a3560899271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:54.276155 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ab3a8-890c-4629-9693-4a3560899271 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.276438 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ab3a8-890c-4629-9693-4a3560899271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.276714 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ab3a8-890c-4629-9693-4a3560899271 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.277497 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ab3a8-890c-4629-9693-4a3560899271 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:54.277802 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ab3a8-890c-4629-9693-4a3560899271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:54.279466 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ab3a8-890c-4629-9693-4a3560899271 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:54.281856 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab671507-af7c-4a6d-a759-81d172b2727d None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.282359 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab671507-af7c-4a6d-a759-81d172b2727d None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.283305 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab671507-af7c-4a6d-a759-81d172b2727d None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.285563 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 231/455] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:54 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 14:24:54.291697 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980e5c2-d144-4043-97d4-1785aa4a8def None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.291889 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 225/456] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Oct 28 14:24:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:54.292119 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980e5c2-d144-4043-97d4-1785aa4a8def None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.292315 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980e5c2-d144-4043-97d4-1785aa4a8def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.299231 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ab3a8-890c-4629-9693-4a3560899271 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:54.312145 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ab3a8-890c-4629-9693-4a3560899271 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:54.316182 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-d980e5c2-d144-4043-97d4-1785aa4a8def None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:54.317395 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-d980e5c2-d144-4043-97d4-1785aa4a8def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:54.319175 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c068f-32d6-4000-b27c-1bbc421c8471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:54.320378 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c068f-32d6-4000-b27c-1bbc421c8471 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.321657 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c068f-32d6-4000-b27c-1bbc421c8471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.322109 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c068f-32d6-4000-b27c-1bbc421c8471 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.330942 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 232/457] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:24:54.335212 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c068f-32d6-4000-b27c-1bbc421c8471 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:54.337410 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c068f-32d6-4000-b27c-1bbc421c8471 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:54.354422 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-cd7c068f-32d6-4000-b27c-1bbc421c8471 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:54.355972 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980e5c2-d144-4043-97d4-1785aa4a8def None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:54.365784 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980e5c2-d144-4043-97d4-1785aa4a8def None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:54.371348 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 226/458] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:54.375170 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d0f3e-fd01-424d-89d6-03f3d757a05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:54.376152 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d0f3e-fd01-424d-89d6-03f3d757a05c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.376566 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d0f3e-fd01-424d-89d6-03f3d757a05c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.376968 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d0f3e-fd01-424d-89d6-03f3d757a05c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.381114 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c068f-32d6-4000-b27c-1bbc421c8471 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:54.394555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c068f-32d6-4000-b27c-1bbc421c8471 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:54.401862 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d0f3e-fd01-424d-89d6-03f3d757a05c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:54.403715 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1b035-46ef-431a-b27f-f1cb53ba523c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:54.405322 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1b035-46ef-431a-b27f-f1cb53ba523c admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.406446 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1b035-46ef-431a-b27f-f1cb53ba523c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.407300 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1b035-46ef-431a-b27f-f1cb53ba523c admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.408218 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1b035-46ef-431a-b27f-f1cb53ba523c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:54.409735 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1b035-46ef-431a-b27f-f1cb53ba523c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:54.413978 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1b035-46ef-431a-b27f-f1cb53ba523c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:54.417312 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-d43d0f3e-fd01-424d-89d6-03f3d757a05c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 14:24:54.420272 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 233/459] 10.222.0.79 () {56 vars in 1123 bytes} [Thu Oct 28 14:24:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:54.427179 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d0f3e-fd01-424d-89d6-03f3d757a05c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:54.436166 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 227/460] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:54.441270 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d0f3e-fd01-424d-89d6-03f3d757a05c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:54.445995 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b0844-71dd-4938-8af9-8ff489996ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:54.446901 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b0844-71dd-4938-8af9-8ff489996ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.447307 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b0844-71dd-4938-8af9-8ff489996ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.448429 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1b035-46ef-431a-b27f-f1cb53ba523c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:54.453844 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b0844-71dd-4938-8af9-8ff489996ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.456999 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b0844-71dd-4938-8af9-8ff489996ce7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:54.457620 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b0844-71dd-4938-8af9-8ff489996ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:54.459762 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1b035-46ef-431a-b27f-f1cb53ba523c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:54.461679 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b0844-71dd-4938-8af9-8ff489996ce7 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:54.469948 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf769892-0468-4989-b27a-4d96d0723135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:54.471771 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf769892-0468-4989-b27a-4d96d0723135 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.472215 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf769892-0468-4989-b27a-4d96d0723135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.473147 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf769892-0468-4989-b27a-4d96d0723135 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.481849 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 234/461] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Oct 28 14:24:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:54.485593 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf769892-0468-4989-b27a-4d96d0723135 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:54.488434 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b0844-71dd-4938-8af9-8ff489996ce7 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:54.493424 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf769892-0468-4989-b27a-4d96d0723135 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:54.504068 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b0844-71dd-4938-8af9-8ff489996ce7 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:54.512674 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce33a82-01ad-4cef-8d4d-831b49667821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:54.513774 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce33a82-01ad-4cef-8d4d-831b49667821 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.514211 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce33a82-01ad-4cef-8d4d-831b49667821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.514662 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce33a82-01ad-4cef-8d4d-831b49667821 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.517408 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-bf769892-0468-4989-b27a-4d96d0723135 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 28 14:24:54.522874 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 228/462] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:54 2021] GET /identity/v3/users/glance => generated 84 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:54.527025 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce33a82-01ad-4cef-8d4d-831b49667821 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:54.529260 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce33a82-01ad-4cef-8d4d-831b49667821 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:54.534318 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf769892-0468-4989-b27a-4d96d0723135 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:54.546635 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf769892-0468-4989-b27a-4d96d0723135 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:54.554157 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434671c-bddf-4a65-862f-336a63df4b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:54.555151 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434671c-bddf-4a65-862f-336a63df4b8a admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.555583 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434671c-bddf-4a65-862f-336a63df4b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.555988 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434671c-bddf-4a65-862f-336a63df4b8a admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.557036 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434671c-bddf-4a65-862f-336a63df4b8a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:54.557476 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434671c-bddf-4a65-862f-336a63df4b8a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:54.559661 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434671c-bddf-4a65-862f-336a63df4b8a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:54.567335 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-9ce33a82-01ad-4cef-8d4d-831b49667821 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:54.568859 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 235/463] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:54.575620 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce33a82-01ad-4cef-8d4d-831b49667821 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:54.588108 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce33a82-01ad-4cef-8d4d-831b49667821 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:54.589200 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 229/464] 10.222.0.79 () {56 vars in 1158 bytes} [Thu Oct 28 14:24:54 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:54.595950 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434671c-bddf-4a65-862f-336a63df4b8a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:54.600194 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62873769-9548-43cc-a2c0-d8635ee0c851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:54.600862 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62873769-9548-43cc-a2c0-d8635ee0c851 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.602711 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62873769-9548-43cc-a2c0-d8635ee0c851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.603049 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62873769-9548-43cc-a2c0-d8635ee0c851 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.605605 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62873769-9548-43cc-a2c0-d8635ee0c851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:54.605924 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62873769-9548-43cc-a2c0-d8635ee0c851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:54.608684 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62873769-9548-43cc-a2c0-d8635ee0c851 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:54.614347 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434671c-bddf-4a65-862f-336a63df4b8a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:54.624645 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35789f5-4a37-43e9-8bac-f9cc236b4435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:54.625451 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35789f5-4a37-43e9-8bac-f9cc236b4435 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.625730 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35789f5-4a37-43e9-8bac-f9cc236b4435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.626357 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35789f5-4a37-43e9-8bac-f9cc236b4435 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.632461 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 236/465] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:54.637474 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62873769-9548-43cc-a2c0-d8635ee0c851 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:54.643232 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35789f5-4a37-43e9-8bac-f9cc236b4435 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:54.645090 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35789f5-4a37-43e9-8bac-f9cc236b4435 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:54.648005 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62873769-9548-43cc-a2c0-d8635ee0c851 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:54.658151 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c76358-872a-4998-83cc-dc358a8b3e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:54.660134 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c76358-872a-4998-83cc-dc358a8b3e9a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.660604 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c76358-872a-4998-83cc-dc358a8b3e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.661396 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c76358-872a-4998-83cc-dc358a8b3e9a admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.677111 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c76358-872a-4998-83cc-dc358a8b3e9a admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:54.679235 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c76358-872a-4998-83cc-dc358a8b3e9a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:54.681403 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-f35789f5-4a37-43e9-8bac-f9cc236b4435 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:54.683107 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 230/466] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:54.684567 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce797623-4e21-47c5-a1e8-2ceca8f77dca None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.684994 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce797623-4e21-47c5-a1e8-2ceca8f77dca None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.685405 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce797623-4e21-47c5-a1e8-2ceca8f77dca None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.687528 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 231/467] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:54.689692 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce797623-4e21-47c5-a1e8-2ceca8f77dca None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:54.697942 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-b1c76358-872a-4998-83cc-dc358a8b3e9a admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 14:24:54.699800 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 237/468] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:54 2021] GET /identity/v3/users/cinder => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:54.702201 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77111659-f877-4318-856e-6c5f1c9fe8a7 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.702831 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77111659-f877-4318-856e-6c5f1c9fe8a7 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.704646 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77111659-f877-4318-856e-6c5f1c9fe8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.707816 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce797623-4e21-47c5-a1e8-2ceca8f77dca None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:54.714308 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ec167-5eff-4d12-b140-4b201df7d980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:54.715198 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ec167-5eff-4d12-b140-4b201df7d980 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.715578 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ec167-5eff-4d12-b140-4b201df7d980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.715913 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ec167-5eff-4d12-b140-4b201df7d980 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.716752 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ec167-5eff-4d12-b140-4b201df7d980 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:54.717134 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ec167-5eff-4d12-b140-4b201df7d980 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:54.719016 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ec167-5eff-4d12-b140-4b201df7d980 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:54.727676 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-77111659-f877-4318-856e-6c5f1c9fe8a7 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:54.729810 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-77111659-f877-4318-856e-6c5f1c9fe8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:54.731631 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 232/469] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:54.732491 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ec167-5eff-4d12-b140-4b201df7d980 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:54.739395 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 238/470] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:54.740523 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77111659-f877-4318-856e-6c5f1c9fe8a7 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:54.749148 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ec167-5eff-4d12-b140-4b201df7d980 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:54.750383 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77111659-f877-4318-856e-6c5f1c9fe8a7 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:54.759717 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d616f4-b063-4a80-b4c4-6dc36c707379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:54.760798 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec068d5-c05a-4bd0-b08e-1163b8e20fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:54.762778 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec068d5-c05a-4bd0-b08e-1163b8e20fea admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.763119 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d616f4-b063-4a80-b4c4-6dc36c707379 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.763393 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d616f4-b063-4a80-b4c4-6dc36c707379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.763655 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d616f4-b063-4a80-b4c4-6dc36c707379 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.764281 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec068d5-c05a-4bd0-b08e-1163b8e20fea admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.764562 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec068d5-c05a-4bd0-b08e-1163b8e20fea admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.765559 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec068d5-c05a-4bd0-b08e-1163b8e20fea admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:54.765864 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec068d5-c05a-4bd0-b08e-1163b8e20fea admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:54.770282 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec068d5-c05a-4bd0-b08e-1163b8e20fea admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:54.777308 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d616f4-b063-4a80-b4c4-6dc36c707379 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:54.779955 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d616f4-b063-4a80-b4c4-6dc36c707379 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:54.794600 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-19d616f4-b063-4a80-b4c4-6dc36c707379 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:24:54.795845 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 233/471] 10.222.0.79 () {56 vars in 1158 bytes} [Thu Oct 28 14:24:54 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:54.795955 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 239/472] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:54.796703 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d616f4-b063-4a80-b4c4-6dc36c707379 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:54.802735 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec068d5-c05a-4bd0-b08e-1163b8e20fea admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:54.808404 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d616f4-b063-4a80-b4c4-6dc36c707379 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:54.813222 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4e9d3-9b74-4686-85de-57a2cff7a557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:54.814193 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4e9d3-9b74-4686-85de-57a2cff7a557 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.814653 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4e9d3-9b74-4686-85de-57a2cff7a557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.815103 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4e9d3-9b74-4686-85de-57a2cff7a557 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.816488 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec068d5-c05a-4bd0-b08e-1163b8e20fea admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:54.821825 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbc8cb-ecbb-49b8-ba07-1f8ba8a252ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:54.822784 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbc8cb-ecbb-49b8-ba07-1f8ba8a252ac admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.823192 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbc8cb-ecbb-49b8-ba07-1f8ba8a252ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.823566 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbc8cb-ecbb-49b8-ba07-1f8ba8a252ac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.827850 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4e9d3-9b74-4686-85de-57a2cff7a557 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:54.834795 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbc8cb-ecbb-49b8-ba07-1f8ba8a252ac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:54.835221 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-e2f4e9d3-9b74-4686-85de-57a2cff7a557 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 14:24:54.836944 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbc8cb-ecbb-49b8-ba07-1f8ba8a252ac admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:54.837115 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 240/473] 10.222.0.79 () {56 vars in 1123 bytes} [Thu Oct 28 14:24:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:54.838011 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4e9d3-9b74-4686-85de-57a2cff7a557 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:54.847829 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4e9d3-9b74-4686-85de-57a2cff7a557 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:54.852643 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aee20e-8d3b-4f4c-889c-264d8f61d61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:54.853448 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aee20e-8d3b-4f4c-889c-264d8f61d61f admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.853930 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aee20e-8d3b-4f4c-889c-264d8f61d61f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.854467 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aee20e-8d3b-4f4c-889c-264d8f61d61f admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.855453 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-86cbc8cb-ecbb-49b8-ba07-1f8ba8a252ac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:54.855618 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aee20e-8d3b-4f4c-889c-264d8f61d61f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:54.856050 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aee20e-8d3b-4f4c-889c-264d8f61d61f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:54.857214 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 234/474] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:54.858083 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbc8cb-ecbb-49b8-ba07-1f8ba8a252ac admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:54.858857 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aee20e-8d3b-4f4c-889c-264d8f61d61f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:54.868723 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbc8cb-ecbb-49b8-ba07-1f8ba8a252ac admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:54.873221 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 241/475] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:24:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:54.874236 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aee20e-8d3b-4f4c-889c-264d8f61d61f admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:54.879279 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bedbc-653a-4302-9d9b-e79824a46596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:54.880197 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bedbc-653a-4302-9d9b-e79824a46596 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.880537 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bedbc-653a-4302-9d9b-e79824a46596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.880892 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bedbc-653a-4302-9d9b-e79824a46596 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.882258 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3bedbc-653a-4302-9d9b-e79824a46596 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:54.882630 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3bedbc-653a-4302-9d9b-e79824a46596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:54.884652 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3bedbc-653a-4302-9d9b-e79824a46596 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:54.885907 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aee20e-8d3b-4f4c-889c-264d8f61d61f admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:54.892075 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b031c-61f8-4116-b2b9-c6bfd3441d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:54.893054 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b031c-61f8-4116-b2b9-c6bfd3441d01 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.893518 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b031c-61f8-4116-b2b9-c6bfd3441d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.893620 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 235/476] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Oct 28 14:24:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:54.894041 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b031c-61f8-4116-b2b9-c6bfd3441d01 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.894592 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bedbc-653a-4302-9d9b-e79824a46596 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:54.895312 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b031c-61f8-4116-b2b9-c6bfd3441d01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:54.895840 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b031c-61f8-4116-b2b9-c6bfd3441d01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:54.897632 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b031c-61f8-4116-b2b9-c6bfd3441d01 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:54.904216 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bedbc-653a-4302-9d9b-e79824a46596 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:54.909435 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdd146-df4a-4126-bad4-3430d2e18b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:54.910386 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdd146-df4a-4126-bad4-3430d2e18b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.910780 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdd146-df4a-4126-bad4-3430d2e18b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.911116 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdd146-df4a-4126-bad4-3430d2e18b8a admin admin] PATH_INFO: `/v3/projects/b433200db4784bfeadca48d24212e823/users/73a98d6cf23e4710bfbf71b960f81a9e/roles/1ee8b426ca9a49e5b7fb33be19e8a616` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.917553 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 242/477] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:54.923972 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b031c-61f8-4116-b2b9-c6bfd3441d01 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:54.928287 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdd146-df4a-4126-bad4-3430d2e18b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b433200db4784bfeadca48d24212e823, user_id=73a98d6cf23e4710bfbf71b960f81a9e, role_id=1ee8b426ca9a49e5b7fb33be19e8a616)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:54.931786 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdd146-df4a-4126-bad4-3430d2e18b8a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:54.935271 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b031c-61f8-4116-b2b9-c6bfd3441d01 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:54.940690 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e958cb-accd-472a-94e9-706b1955054c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:54.941899 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e958cb-accd-472a-94e9-706b1955054c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.942449 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e958cb-accd-472a-94e9-706b1955054c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.942960 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e958cb-accd-472a-94e9-706b1955054c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.949598 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 236/478] 10.222.0.79 () {58 vars in 1460 bytes} [Thu Oct 28 14:24:54 2021] PUT /identity/v3/projects/b433200db4784bfeadca48d24212e823/users/73a98d6cf23e4710bfbf71b960f81a9e/roles/1ee8b426ca9a49e5b7fb33be19e8a616 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:24:54.951488 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdd146-df4a-4126-bad4-3430d2e18b8a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:54.957070 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e958cb-accd-472a-94e9-706b1955054c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:54.959657 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e958cb-accd-472a-94e9-706b1955054c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:54.978313 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-70e958cb-accd-472a-94e9-706b1955054c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:54.986414 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 243/479] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:54.986414 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a88161-2d0e-4a63-bcc4-ecf2de39de58 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:54.986414 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a88161-2d0e-4a63-bcc4-ecf2de39de58 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:54.986414 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a88161-2d0e-4a63-bcc4-ecf2de39de58 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:54.986414 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 244/480] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:54.986414 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a88161-2d0e-4a63-bcc4-ecf2de39de58 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:55.049872 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdd146-df4a-4126-bad4-3430d2e18b8a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:55.056524 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bde3b-bc3a-4a2d-b6bc-dbd152c52201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:55.057673 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bde3b-bc3a-4a2d-b6bc-dbd152c52201 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:55.058128 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bde3b-bc3a-4a2d-b6bc-dbd152c52201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:55.058447 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bde3b-bc3a-4a2d-b6bc-dbd152c52201 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:55.067693 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bde3b-bc3a-4a2d-b6bc-dbd152c52201 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:55.068870 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a88161-2d0e-4a63-bcc4-ecf2de39de58 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:55.069887 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bde3b-bc3a-4a2d-b6bc-dbd152c52201 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:55.073553 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08c004-7b79-4097-ab2a-19a2a9250844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:55.074321 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08c004-7b79-4097-ab2a-19a2a9250844 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:55.074672 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08c004-7b79-4097-ab2a-19a2a9250844 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:55.075037 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08c004-7b79-4097-ab2a-19a2a9250844 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:55.075860 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08c004-7b79-4097-ab2a-19a2a9250844 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:55.076232 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08c004-7b79-4097-ab2a-19a2a9250844 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:55.077941 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08c004-7b79-4097-ab2a-19a2a9250844 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:55.086869 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-5a0bde3b-bc3a-4a2d-b6bc-dbd152c52201 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:24:55.089245 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 237/481] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 139 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:55.090767 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448c084-e824-46ce-b09f-48d9d1605930 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:55.091057 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448c084-e824-46ce-b09f-48d9d1605930 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:55.091333 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448c084-e824-46ce-b09f-48d9d1605930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:55.097088 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 245/482] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:55.098059 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08c004-7b79-4097-ab2a-19a2a9250844 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:55.108911 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08c004-7b79-4097-ab2a-19a2a9250844 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:55.113884 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eab5fa-5f12-47c6-a86c-447fbb730ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:55.114612 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eab5fa-5f12-47c6-a86c-447fbb730ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:55.114929 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eab5fa-5f12-47c6-a86c-447fbb730ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:55.115199 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eab5fa-5f12-47c6-a86c-447fbb730ca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:55.116073 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eab5fa-5f12-47c6-a86c-447fbb730ca3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:55.116429 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eab5fa-5f12-47c6-a86c-447fbb730ca3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:55.118494 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eab5fa-5f12-47c6-a86c-447fbb730ca3 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:55.119981 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-a448c084-e824-46ce-b09f-48d9d1605930 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:55.122107 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-a448c084-e824-46ce-b09f-48d9d1605930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:55.139031 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 238/484] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:55.139415 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 246/484] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:24:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:55.140442 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eab5fa-5f12-47c6-a86c-447fbb730ca3 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:55.140653 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448c084-e824-46ce-b09f-48d9d1605930 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:55.152423 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448c084-e824-46ce-b09f-48d9d1605930 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:55.162715 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eab5fa-5f12-47c6-a86c-447fbb730ca3 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:55.170659 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cc8b8-620b-4cb9-a8ce-58d4934220c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:55.172022 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cc8b8-620b-4cb9-a8ce-58d4934220c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:55.172290 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cc8b8-620b-4cb9-a8ce-58d4934220c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:55.172561 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cc8b8-620b-4cb9-a8ce-58d4934220c2 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:55.173701 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180e468-b5eb-4822-b47e-5c2518725cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:55.175202 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180e468-b5eb-4822-b47e-5c2518725cea admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:55.175202 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180e468-b5eb-4822-b47e-5c2518725cea admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:55.175202 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180e468-b5eb-4822-b47e-5c2518725cea admin admin] PATH_INFO: `/v3/projects/b433200db4784bfeadca48d24212e823/users/218708788ed447499b00de12cff0f6e5/roles/1ee8b426ca9a49e5b7fb33be19e8a616` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:55.188019 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cc8b8-620b-4cb9-a8ce-58d4934220c2 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:55.190118 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cc8b8-620b-4cb9-a8ce-58d4934220c2 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:55.195844 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180e468-b5eb-4822-b47e-5c2518725cea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b433200db4784bfeadca48d24212e823, user_id=218708788ed447499b00de12cff0f6e5, role_id=1ee8b426ca9a49e5b7fb33be19e8a616)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:55.198182 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180e468-b5eb-4822-b47e-5c2518725cea admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:55.204867 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-be4cc8b8-620b-4cb9-a8ce-58d4934220c2 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 14:24:55.206289 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 239/485] 10.222.0.79 () {56 vars in 1123 bytes} [Thu Oct 28 14:24:55 2021] GET /identity/v3/users/neutron => generated 85 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:55.208460 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cc8b8-620b-4cb9-a8ce-58d4934220c2 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:55.217942 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 247/486] 10.222.0.79 () {58 vars in 1460 bytes} [Thu Oct 28 14:24:55 2021] PUT /identity/v3/projects/b433200db4784bfeadca48d24212e823/users/218708788ed447499b00de12cff0f6e5/roles/1ee8b426ca9a49e5b7fb33be19e8a616 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:24:55.219090 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180e468-b5eb-4822-b47e-5c2518725cea admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:55.220585 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cc8b8-620b-4cb9-a8ce-58d4934220c2 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:55.287816 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b26e3-010f-4a52-9b4c-e2ba63ff0b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:55.288933 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b26e3-010f-4a52-9b4c-e2ba63ff0b35 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:55.289358 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b26e3-010f-4a52-9b4c-e2ba63ff0b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:55.289917 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b26e3-010f-4a52-9b4c-e2ba63ff0b35 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:55.297936 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180e468-b5eb-4822-b47e-5c2518725cea admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:55.303599 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd70094-fd40-480d-9535-c8ccb23f92f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:55.304267 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd70094-fd40-480d-9535-c8ccb23f92f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:55.304550 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd70094-fd40-480d-9535-c8ccb23f92f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:55.304836 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b26e3-010f-4a52-9b4c-e2ba63ff0b35 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:55.304962 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd70094-fd40-480d-9535-c8ccb23f92f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:55.305827 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd70094-fd40-480d-9535-c8ccb23f92f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:55.306135 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd70094-fd40-480d-9535-c8ccb23f92f7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:55.308124 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd70094-fd40-480d-9535-c8ccb23f92f7 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:55.314262 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-734b26e3-010f-4a52-9b4c-e2ba63ff0b35 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 14:24:55.316425 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 240/487] 10.222.0.79 () {56 vars in 1123 bytes} [Thu Oct 28 14:24:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:55.325797 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b26e3-010f-4a52-9b4c-e2ba63ff0b35 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:55.333533 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 248/488] 10.222.0.79 () {56 vars in 1160 bytes} [Thu Oct 28 14:24:55 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:55.339954 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd70094-fd40-480d-9535-c8ccb23f92f7 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:55.340722 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b26e3-010f-4a52-9b4c-e2ba63ff0b35 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:55.354345 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f99d3b-b60b-4daf-8f0f-c3f31890414a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:55.356339 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f99d3b-b60b-4daf-8f0f-c3f31890414a admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:55.356620 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f99d3b-b60b-4daf-8f0f-c3f31890414a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:55.356895 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f99d3b-b60b-4daf-8f0f-c3f31890414a admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:55.357111 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd70094-fd40-480d-9535-c8ccb23f92f7 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:55.359420 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f99d3b-b60b-4daf-8f0f-c3f31890414a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:55.359743 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f99d3b-b60b-4daf-8f0f-c3f31890414a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:55.364097 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f99d3b-b60b-4daf-8f0f-c3f31890414a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:55.366823 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e5203-9371-4cc2-b754-6343d97ec290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:55.367931 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e5203-9371-4cc2-b754-6343d97ec290 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:55.368209 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e5203-9371-4cc2-b754-6343d97ec290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:55.368481 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e5203-9371-4cc2-b754-6343d97ec290 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:55.384751 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 241/489] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Oct 28 14:24:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:55.394752 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f99d3b-b60b-4daf-8f0f-c3f31890414a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:55.401045 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e5203-9371-4cc2-b754-6343d97ec290 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:55.405635 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e5203-9371-4cc2-b754-6343d97ec290 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:55.412099 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f99d3b-b60b-4daf-8f0f-c3f31890414a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:55.424642 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20017c87-c00a-408d-9416-74068afecd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:55.425531 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20017c87-c00a-408d-9416-74068afecd54 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:55.425813 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20017c87-c00a-408d-9416-74068afecd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:55.426087 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20017c87-c00a-408d-9416-74068afecd54 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:55.442008 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-bb9e5203-9371-4cc2-b754-6343d97ec290 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:55.445243 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 249/490] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:55.452105 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20017c87-c00a-408d-9416-74068afecd54 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:55.454063 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20017c87-c00a-408d-9416-74068afecd54 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:55.456320 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e5203-9371-4cc2-b754-6343d97ec290 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:55.476220 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e5203-9371-4cc2-b754-6343d97ec290 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:55.483159 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-20017c87-c00a-408d-9416-74068afecd54 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:55.484470 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 242/491] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:55.491599 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20017c87-c00a-408d-9416-74068afecd54 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:55.492071 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd76654-b7cb-4bcb-8e87-c778ac92f1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:55.493043 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd76654-b7cb-4bcb-8e87-c778ac92f1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:55.493465 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd76654-b7cb-4bcb-8e87-c778ac92f1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:55.493879 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd76654-b7cb-4bcb-8e87-c778ac92f1e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:55.494817 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd76654-b7cb-4bcb-8e87-c778ac92f1e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:55.495290 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd76654-b7cb-4bcb-8e87-c778ac92f1e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:55.497085 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd76654-b7cb-4bcb-8e87-c778ac92f1e8 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:55.502144 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20017c87-c00a-408d-9416-74068afecd54 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:55.507826 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207cde24-ba35-486f-81fb-9f11997f2e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:55.509128 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cde24-ba35-486f-81fb-9f11997f2e8d admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:55.509411 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cde24-ba35-486f-81fb-9f11997f2e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:55.509705 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cde24-ba35-486f-81fb-9f11997f2e8d admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:55.510447 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207cde24-ba35-486f-81fb-9f11997f2e8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:55.510784 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207cde24-ba35-486f-81fb-9f11997f2e8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:55.512431 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207cde24-ba35-486f-81fb-9f11997f2e8d admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:55.518406 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 250/492] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:55.525559 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd76654-b7cb-4bcb-8e87-c778ac92f1e8 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:55.526515 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 243/493] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:55.532449 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207cde24-ba35-486f-81fb-9f11997f2e8d admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:55.540061 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd76654-b7cb-4bcb-8e87-c778ac92f1e8 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:55.542303 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207cde24-ba35-486f-81fb-9f11997f2e8d admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:55.545909 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e1a58-22ee-4c64-a287-b0882fa2a07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:55.547257 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e1a58-22ee-4c64-a287-b0882fa2a07a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:55.547632 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636d24b-2f2b-4495-a77c-c20128836f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:55.547760 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e1a58-22ee-4c64-a287-b0882fa2a07a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:55.548060 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e1a58-22ee-4c64-a287-b0882fa2a07a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:55.548891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636d24b-2f2b-4495-a77c-c20128836f09 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:55.549341 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636d24b-2f2b-4495-a77c-c20128836f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:55.549833 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636d24b-2f2b-4495-a77c-c20128836f09 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:55.556727 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e1a58-22ee-4c64-a287-b0882fa2a07a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:55.558759 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e1a58-22ee-4c64-a287-b0882fa2a07a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:55.561676 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636d24b-2f2b-4495-a77c-c20128836f09 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:55.565073 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636d24b-2f2b-4495-a77c-c20128836f09 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:55.572657 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-160e1a58-22ee-4c64-a287-b0882fa2a07a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:24:55.574160 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 251/494] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:55.580035 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-0636d24b-2f2b-4495-a77c-c20128836f09 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 14:24:55.580369 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e1a58-22ee-4c64-a287-b0882fa2a07a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:55.581912 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 244/495] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:24:55 2021] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:55.588169 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636d24b-2f2b-4495-a77c-c20128836f09 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:55.590475 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e1a58-22ee-4c64-a287-b0882fa2a07a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:55.595023 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02406269-151c-4b6d-a594-ca2dd35fb426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:55.595687 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02406269-151c-4b6d-a594-ca2dd35fb426 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:55.595963 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02406269-151c-4b6d-a594-ca2dd35fb426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:55.596233 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02406269-151c-4b6d-a594-ca2dd35fb426 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:55.597031 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02406269-151c-4b6d-a594-ca2dd35fb426 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:55.597336 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02406269-151c-4b6d-a594-ca2dd35fb426 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:55.599208 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02406269-151c-4b6d-a594-ca2dd35fb426 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:55.599701 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636d24b-2f2b-4495-a77c-c20128836f09 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:55.604962 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81580197-e2bb-41b4-90b0-5c6c189df27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:55.605799 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81580197-e2bb-41b4-90b0-5c6c189df27a admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:55.606251 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81580197-e2bb-41b4-90b0-5c6c189df27a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:55.606664 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81580197-e2bb-41b4-90b0-5c6c189df27a admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:55.607770 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81580197-e2bb-41b4-90b0-5c6c189df27a admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:55.608215 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81580197-e2bb-41b4-90b0-5c6c189df27a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:55.610358 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81580197-e2bb-41b4-90b0-5c6c189df27a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:55.612402 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 252/496] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:24:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:55.618889 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02406269-151c-4b6d-a594-ca2dd35fb426 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:55.628824 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02406269-151c-4b6d-a594-ca2dd35fb426 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:55.633249 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27696055-cc8f-4053-81b3-30edc3c1026a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:55.634388 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27696055-cc8f-4053-81b3-30edc3c1026a admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:55.634535 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27696055-cc8f-4053-81b3-30edc3c1026a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:55.634704 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27696055-cc8f-4053-81b3-30edc3c1026a admin admin] PATH_INFO: `/v3/projects/b433200db4784bfeadca48d24212e823/users/a689fc75b37b4557a682f6cad357df6c/roles/1ee8b426ca9a49e5b7fb33be19e8a616` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:55.641051 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 245/497] 10.222.0.79 () {56 vars in 1156 bytes} [Thu Oct 28 14:24:55 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:55.647795 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81580197-e2bb-41b4-90b0-5c6c189df27a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:55.650562 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27696055-cc8f-4053-81b3-30edc3c1026a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b433200db4784bfeadca48d24212e823, user_id=a689fc75b37b4557a682f6cad357df6c, role_id=1ee8b426ca9a49e5b7fb33be19e8a616)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:55.653330 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27696055-cc8f-4053-81b3-30edc3c1026a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:55.663078 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81580197-e2bb-41b4-90b0-5c6c189df27a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:55.668366 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497462a-23a2-4470-bd05-aac24e0c4173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:55.669305 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497462a-23a2-4470-bd05-aac24e0c4173 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:55.669782 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497462a-23a2-4470-bd05-aac24e0c4173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:55.670219 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497462a-23a2-4470-bd05-aac24e0c4173 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:55.673936 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 253/498] 10.222.0.79 () {58 vars in 1460 bytes} [Thu Oct 28 14:24:55 2021] PUT /identity/v3/projects/b433200db4784bfeadca48d24212e823/users/a689fc75b37b4557a682f6cad357df6c/roles/1ee8b426ca9a49e5b7fb33be19e8a616 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:24:55.680881 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497462a-23a2-4470-bd05-aac24e0c4173 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:55.683526 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497462a-23a2-4470-bd05-aac24e0c4173 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:55.695625 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 246/499] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:55 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:24:55.702255 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27696055-cc8f-4053-81b3-30edc3c1026a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:55.800004 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27696055-cc8f-4053-81b3-30edc3c1026a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:55.810436 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc293f60-5135-4538-875e-f18d393c063d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:55.811216 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc293f60-5135-4538-875e-f18d393c063d admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:55.811498 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc293f60-5135-4538-875e-f18d393c063d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:55.811769 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc293f60-5135-4538-875e-f18d393c063d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:55.833354 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc293f60-5135-4538-875e-f18d393c063d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:55.835245 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc293f60-5135-4538-875e-f18d393c063d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:55.855484 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-dc293f60-5135-4538-875e-f18d393c063d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:55.857227 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 254/500] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:55.864488 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497462a-23a2-4470-bd05-aac24e0c4173 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:55.881073 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497462a-23a2-4470-bd05-aac24e0c4173 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:55.903738 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65584cbb-c772-47af-bb4c-99aa23c493ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:55.904767 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65584cbb-c772-47af-bb4c-99aa23c493ba admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:55.905795 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65584cbb-c772-47af-bb4c-99aa23c493ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:55.906213 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65584cbb-c772-47af-bb4c-99aa23c493ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:55.907125 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65584cbb-c772-47af-bb4c-99aa23c493ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:55.907570 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65584cbb-c772-47af-bb4c-99aa23c493ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:55.916303 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65584cbb-c772-47af-bb4c-99aa23c493ba admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:55.954755 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 247/501] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:55.959799 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc293f60-5135-4538-875e-f18d393c063d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:55.984743 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc293f60-5135-4538-875e-f18d393c063d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:56.012055 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa016848-c943-4a5a-8594-34e7386ff505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:56.012880 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa016848-c943-4a5a-8594-34e7386ff505 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:56.013155 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa016848-c943-4a5a-8594-34e7386ff505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:56.013420 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa016848-c943-4a5a-8594-34e7386ff505 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:56.025723 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa016848-c943-4a5a-8594-34e7386ff505 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:56.027840 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa016848-c943-4a5a-8594-34e7386ff505 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:56.041180 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-fa016848-c943-4a5a-8594-34e7386ff505 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:24:56.042847 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 255/502] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:56.049291 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65584cbb-c772-47af-bb4c-99aa23c493ba admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:56.061125 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65584cbb-c772-47af-bb4c-99aa23c493ba admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:56.065638 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71c921-eb46-4c0b-966d-78085e396e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:56.066432 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71c921-eb46-4c0b-966d-78085e396e9a admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:56.066859 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71c921-eb46-4c0b-966d-78085e396e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:56.067231 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71c921-eb46-4c0b-966d-78085e396e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:56.068133 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71c921-eb46-4c0b-966d-78085e396e9a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:56.068540 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71c921-eb46-4c0b-966d-78085e396e9a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:56.070497 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71c921-eb46-4c0b-966d-78085e396e9a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:56.083867 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 248/503] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:24:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:56.090588 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa016848-c943-4a5a-8594-34e7386ff505 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:56.101287 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa016848-c943-4a5a-8594-34e7386ff505 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:56.105918 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e364f45-21f8-4df2-ac4a-3caae35a19d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:56.106699 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e364f45-21f8-4df2-ac4a-3caae35a19d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:56.107078 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e364f45-21f8-4df2-ac4a-3caae35a19d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:56.107454 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e364f45-21f8-4df2-ac4a-3caae35a19d9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:56.108391 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e364f45-21f8-4df2-ac4a-3caae35a19d9 admin admin] RBAC: Adding query filter params (role.id=1ee8b426ca9a49e5b7fb33be19e8a616, scope.project.id=b433200db4784bfeadca48d24212e823, user.id=889e7be1dcaf47f599af9c9b7ad33042) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:56.108798 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e364f45-21f8-4df2-ac4a-3caae35a19d9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:56.110758 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e364f45-21f8-4df2-ac4a-3caae35a19d9 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:56.117011 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 256/504] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:24:56 2021] GET /identity/v3/role_assignments?user.id=889e7be1dcaf47f599af9c9b7ad33042&scope.project.id=b433200db4784bfeadca48d24212e823&role.id=1ee8b426ca9a49e5b7fb33be19e8a616 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:56.784777 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654c712-d4ac-4ac1-bbd3-fee6f768cb26 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:56.785340 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654c712-d4ac-4ac1-bbd3-fee6f768cb26 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:56.785340 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654c712-d4ac-4ac1-bbd3-fee6f768cb26 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:56.787389 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 249/505] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:56.793535 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80f3e5-f096-4b67-a132-915f24c2bbb3 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:56.793985 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80f3e5-f096-4b67-a132-915f24c2bbb3 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:56.794076 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80f3e5-f096-4b67-a132-915f24c2bbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:56.815597 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-4d80f3e5-f096-4b67-a132-915f24c2bbb3 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:56.816815 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-4d80f3e5-f096-4b67-a132-915f24c2bbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:56.828404 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 257/506] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:56.877150 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654c712-d4ac-4ac1-bbd3-fee6f768cb26 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:56.892361 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654c712-d4ac-4ac1-bbd3-fee6f768cb26 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:56.896738 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161011d-b167-4ef3-811e-08baa48fb871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:56.897540 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161011d-b167-4ef3-811e-08baa48fb871 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:56.897814 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161011d-b167-4ef3-811e-08baa48fb871 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:56.898082 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161011d-b167-4ef3-811e-08baa48fb871 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:56.927653 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161011d-b167-4ef3-811e-08baa48fb871 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:56.934768 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-e161011d-b167-4ef3-811e-08baa48fb871 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 14:24:56.936193 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 250/507] 10.222.0.79 () {56 vars in 1123 bytes} [Thu Oct 28 14:24:56 2021] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:56.942706 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80f3e5-f096-4b67-a132-915f24c2bbb3 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:56.951932 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80f3e5-f096-4b67-a132-915f24c2bbb3 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:56.962358 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c615f-baa7-4bef-9762-f1ffd3424886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:56.963076 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c615f-baa7-4bef-9762-f1ffd3424886 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:56.963355 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c615f-baa7-4bef-9762-f1ffd3424886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:56.963625 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c615f-baa7-4bef-9762-f1ffd3424886 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:56.964392 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c615f-baa7-4bef-9762-f1ffd3424886 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:56.964696 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c615f-baa7-4bef-9762-f1ffd3424886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:56.966279 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c615f-baa7-4bef-9762-f1ffd3424886 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:56.974984 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 258/508] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Oct 28 14:24:56 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:56.981301 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161011d-b167-4ef3-811e-08baa48fb871 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:56.995663 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161011d-b167-4ef3-811e-08baa48fb871 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:57.000041 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a8975-01d2-45b0-93bd-c32623a34e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:57.000838 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a8975-01d2-45b0-93bd-c32623a34e47 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:57.001115 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a8975-01d2-45b0-93bd-c32623a34e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:57.001384 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a8975-01d2-45b0-93bd-c32623a34e47 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:57.015786 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a8975-01d2-45b0-93bd-c32623a34e47 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:57.017630 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a8975-01d2-45b0-93bd-c32623a34e47 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:57.037118 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-2d0a8975-01d2-45b0-93bd-c32623a34e47 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:57.038225 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 251/509] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:57.044535 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c615f-baa7-4bef-9762-f1ffd3424886 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:57.059570 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c615f-baa7-4bef-9762-f1ffd3424886 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:57.063964 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3351e3-5e80-4e56-90fe-6d86796b6b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:57.064628 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3351e3-5e80-4e56-90fe-6d86796b6b02 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:57.064910 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3351e3-5e80-4e56-90fe-6d86796b6b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:57.065186 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3351e3-5e80-4e56-90fe-6d86796b6b02 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:57.065928 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3351e3-5e80-4e56-90fe-6d86796b6b02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:57.066232 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3351e3-5e80-4e56-90fe-6d86796b6b02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:57.067853 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3351e3-5e80-4e56-90fe-6d86796b6b02 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:57.085300 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 259/510] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:57.091646 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a8975-01d2-45b0-93bd-c32623a34e47 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:57.107550 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a8975-01d2-45b0-93bd-c32623a34e47 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:57.111900 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4624204-3f30-4a91-b54f-078f6741f98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:57.112693 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4624204-3f30-4a91-b54f-078f6741f98f admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:57.112974 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4624204-3f30-4a91-b54f-078f6741f98f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:57.113251 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4624204-3f30-4a91-b54f-078f6741f98f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:57.121436 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4624204-3f30-4a91-b54f-078f6741f98f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:57.123498 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4624204-3f30-4a91-b54f-078f6741f98f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:57.136900 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-b4624204-3f30-4a91-b54f-078f6741f98f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 14:24:57.138412 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 252/511] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Oct 28 14:24:57 2021] GET /identity/v3/users/nova => generated 82 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:57.144475 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3351e3-5e80-4e56-90fe-6d86796b6b02 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:57.155572 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3351e3-5e80-4e56-90fe-6d86796b6b02 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:57.160941 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6367cc-f7f1-4e24-9a71-5ee97c106cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:57.161607 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6367cc-f7f1-4e24-9a71-5ee97c106cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:57.161885 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6367cc-f7f1-4e24-9a71-5ee97c106cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:57.162156 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6367cc-f7f1-4e24-9a71-5ee97c106cd5 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:57.163035 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6367cc-f7f1-4e24-9a71-5ee97c106cd5 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:57.163337 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6367cc-f7f1-4e24-9a71-5ee97c106cd5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:57.165206 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6367cc-f7f1-4e24-9a71-5ee97c106cd5 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:57.190280 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 260/512] 10.222.0.79 () {56 vars in 1154 bytes} [Thu Oct 28 14:24:57 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:57.196658 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4624204-3f30-4a91-b54f-078f6741f98f admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:57.207674 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4624204-3f30-4a91-b54f-078f6741f98f admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:57.214586 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac0206-f8f7-4ea5-bc18-379aacb8958b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:57.215254 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac0206-f8f7-4ea5-bc18-379aacb8958b admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:57.215530 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac0206-f8f7-4ea5-bc18-379aacb8958b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:57.215796 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac0206-f8f7-4ea5-bc18-379aacb8958b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:57.226653 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac0206-f8f7-4ea5-bc18-379aacb8958b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:57.228471 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac0206-f8f7-4ea5-bc18-379aacb8958b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:57.247102 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 253/513] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:57 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:57.253512 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6367cc-f7f1-4e24-9a71-5ee97c106cd5 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:57.267809 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6367cc-f7f1-4e24-9a71-5ee97c106cd5 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:57.279406 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842be440-0ade-4dc3-a2b8-09afa0bf1fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:57.280538 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842be440-0ade-4dc3-a2b8-09afa0bf1fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:57.280943 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842be440-0ade-4dc3-a2b8-09afa0bf1fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:57.281346 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842be440-0ade-4dc3-a2b8-09afa0bf1fc1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:57.299468 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842be440-0ade-4dc3-a2b8-09afa0bf1fc1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:57.302241 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842be440-0ade-4dc3-a2b8-09afa0bf1fc1 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:57.328863 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-842be440-0ade-4dc3-a2b8-09afa0bf1fc1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:57.330410 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 261/514] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:57.336671 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac0206-f8f7-4ea5-bc18-379aacb8958b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:57.345715 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac0206-f8f7-4ea5-bc18-379aacb8958b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:57.350112 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96388b86-1c25-4b17-837b-66e8fc3c77bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:57.350791 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96388b86-1c25-4b17-837b-66e8fc3c77bc admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:57.351071 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96388b86-1c25-4b17-837b-66e8fc3c77bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:57.351345 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96388b86-1c25-4b17-837b-66e8fc3c77bc admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:57.352108 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96388b86-1c25-4b17-837b-66e8fc3c77bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:57.352412 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96388b86-1c25-4b17-837b-66e8fc3c77bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:57.354026 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96388b86-1c25-4b17-837b-66e8fc3c77bc admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:57.366735 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 254/515] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:57.375795 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842be440-0ade-4dc3-a2b8-09afa0bf1fc1 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:57.387633 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842be440-0ade-4dc3-a2b8-09afa0bf1fc1 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:57.393075 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b19869-baf0-4d93-a948-7ad9e2dc36f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:57.393994 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b19869-baf0-4d93-a948-7ad9e2dc36f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:57.394219 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b19869-baf0-4d93-a948-7ad9e2dc36f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:57.394446 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b19869-baf0-4d93-a948-7ad9e2dc36f3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:57.408590 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b19869-baf0-4d93-a948-7ad9e2dc36f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:57.410598 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b19869-baf0-4d93-a948-7ad9e2dc36f3 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:57.427235 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-07b19869-baf0-4d93-a948-7ad9e2dc36f3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:24:57.428801 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 262/516] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:57.435398 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96388b86-1c25-4b17-837b-66e8fc3c77bc admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:57.445460 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96388b86-1c25-4b17-837b-66e8fc3c77bc admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:57.450077 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0822df-a85d-4f43-b671-cdae7bef814c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:57.454809 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0822df-a85d-4f43-b671-cdae7bef814c admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:57.455126 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0822df-a85d-4f43-b671-cdae7bef814c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:57.455408 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0822df-a85d-4f43-b671-cdae7bef814c admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:57.456287 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0822df-a85d-4f43-b671-cdae7bef814c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:57.456593 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0822df-a85d-4f43-b671-cdae7bef814c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:57.458641 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0822df-a85d-4f43-b671-cdae7bef814c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:57.474617 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 255/517] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:24:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:57.481186 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b19869-baf0-4d93-a948-7ad9e2dc36f3 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:57.493192 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b19869-baf0-4d93-a948-7ad9e2dc36f3 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:57.498640 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31163a0a-7727-4d6b-8931-fbf59e1b8088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:57.499349 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31163a0a-7727-4d6b-8931-fbf59e1b8088 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:57.499672 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31163a0a-7727-4d6b-8931-fbf59e1b8088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:57.499943 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31163a0a-7727-4d6b-8931-fbf59e1b8088 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:57.500856 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31163a0a-7727-4d6b-8931-fbf59e1b8088 admin admin] RBAC: Adding query filter params (role.id=1ee8b426ca9a49e5b7fb33be19e8a616, scope.project.id=b433200db4784bfeadca48d24212e823, user.id=18cd6636ae7847c78be910824410d295) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:57.501162 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31163a0a-7727-4d6b-8931-fbf59e1b8088 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:57.503136 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31163a0a-7727-4d6b-8931-fbf59e1b8088 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:57.520637 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 263/518] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:24:57 2021] GET /identity/v3/role_assignments?user.id=18cd6636ae7847c78be910824410d295&scope.project.id=b433200db4784bfeadca48d24212e823&role.id=1ee8b426ca9a49e5b7fb33be19e8a616 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:57.919738 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae67e7-d56a-4892-a674-718a5502cf61 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:57.920391 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae67e7-d56a-4892-a674-718a5502cf61 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:57.920391 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae67e7-d56a-4892-a674-718a5502cf61 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:57.922061 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 256/519] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:57.928803 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5605d-f1f1-4cae-9433-030c0112de7e None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:57.929330 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5605d-f1f1-4cae-9433-030c0112de7e None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:57.929330 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5605d-f1f1-4cae-9433-030c0112de7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:57.947962 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-7ef5605d-f1f1-4cae-9433-030c0112de7e None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:57.949218 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-7ef5605d-f1f1-4cae-9433-030c0112de7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:57.962871 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 264/520] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:24:57.983232 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae67e7-d56a-4892-a674-718a5502cf61 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:57.996258 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae67e7-d56a-4892-a674-718a5502cf61 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.000608 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1557a1a-4f00-43b5-8319-71bb58d8d9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.001440 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1557a1a-4f00-43b5-8319-71bb58d8d9de admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.001710 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1557a1a-4f00-43b5-8319-71bb58d8d9de admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.001986 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1557a1a-4f00-43b5-8319-71bb58d8d9de admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.013892 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1557a1a-4f00-43b5-8319-71bb58d8d9de admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:58.020799 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-b1557a1a-4f00-43b5-8319-71bb58d8d9de admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 14:24:58.026787 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 257/521] 10.222.0.79 () {56 vars in 1123 bytes} [Thu Oct 28 14:24:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:58.029207 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5605d-f1f1-4cae-9433-030c0112de7e None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.039080 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5605d-f1f1-4cae-9433-030c0112de7e None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.043614 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400dcb2-90a9-4aaa-ad40-871fe4aae0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.044287 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400dcb2-90a9-4aaa-ad40-871fe4aae0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.044558 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400dcb2-90a9-4aaa-ad40-871fe4aae0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.044823 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400dcb2-90a9-4aaa-ad40-871fe4aae0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.045584 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8400dcb2-90a9-4aaa-ad40-871fe4aae0c8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:58.045880 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8400dcb2-90a9-4aaa-ad40-871fe4aae0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:58.047501 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8400dcb2-90a9-4aaa-ad40-871fe4aae0c8 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:58.062029 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 265/522] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:58.063435 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1557a1a-4f00-43b5-8319-71bb58d8d9de admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.073834 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1557a1a-4f00-43b5-8319-71bb58d8d9de admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.078232 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42cbb52-2add-4292-ac91-0235717532de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.079036 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cbb52-2add-4292-ac91-0235717532de admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.079308 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cbb52-2add-4292-ac91-0235717532de admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.079591 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cbb52-2add-4292-ac91-0235717532de admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.091414 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42cbb52-2add-4292-ac91-0235717532de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:58.093256 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42cbb52-2add-4292-ac91-0235717532de admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:58.110536 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-a42cbb52-2add-4292-ac91-0235717532de admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:58.114671 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 258/523] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:58.118485 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400dcb2-90a9-4aaa-ad40-871fe4aae0c8 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.128566 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400dcb2-90a9-4aaa-ad40-871fe4aae0c8 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.134755 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec92b3-af93-4b5e-bf99-a27d5d37ddea None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.135039 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec92b3-af93-4b5e-bf99-a27d5d37ddea None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.135221 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7e52d-f046-489f-b034-b78d9ca85474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.135485 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec92b3-af93-4b5e-bf99-a27d5d37ddea None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.135928 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7e52d-f046-489f-b034-b78d9ca85474 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.136205 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7e52d-f046-489f-b034-b78d9ca85474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.136477 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7e52d-f046-489f-b034-b78d9ca85474 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.137228 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7e52d-f046-489f-b034-b78d9ca85474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:58.137531 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7e52d-f046-489f-b034-b78d9ca85474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:58.137689 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 259/524] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 14:24:58.139161 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7e52d-f046-489f-b034-b78d9ca85474 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:58.144718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d244e01-1742-4fa9-84ca-4014fe417a4b None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.144999 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d244e01-1742-4fa9-84ca-4014fe417a4b None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.145267 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d244e01-1742-4fa9-84ca-4014fe417a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.155710 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 266/525] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:58.162312 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7e52d-f046-489f-b034-b78d9ca85474 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.171996 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-1d244e01-1742-4fa9-84ca-4014fe417a4b None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:58.173216 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-1d244e01-1742-4fa9-84ca-4014fe417a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:58.173738 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7e52d-f046-489f-b034-b78d9ca85474 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.179014 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3af14b-5afa-46a0-94d9-3b508e44271f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.179805 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3af14b-5afa-46a0-94d9-3b508e44271f admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.180266 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3af14b-5afa-46a0-94d9-3b508e44271f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.180667 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3af14b-5afa-46a0-94d9-3b508e44271f admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.187127 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 260/526] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:24:58.193881 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3af14b-5afa-46a0-94d9-3b508e44271f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:58.196177 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3af14b-5afa-46a0-94d9-3b508e44271f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:58.210988 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-cb3af14b-5afa-46a0-94d9-3b508e44271f admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 28 14:24:58.212649 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 267/527] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/users/glance => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:58.216645 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d244e01-1742-4fa9-84ca-4014fe417a4b None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.223942 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3af14b-5afa-46a0-94d9-3b508e44271f admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.226964 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d244e01-1742-4fa9-84ca-4014fe417a4b None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.231477 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3af48-7d16-4cf4-91f1-d244769a8dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.232282 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3af48-7d16-4cf4-91f1-d244769a8dfa admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.232555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3af48-7d16-4cf4-91f1-d244769a8dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.232823 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3af48-7d16-4cf4-91f1-d244769a8dfa admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.235980 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3af14b-5afa-46a0-94d9-3b508e44271f admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.241067 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534a38f-4bbf-466f-85f7-12241379ab8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.241980 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534a38f-4bbf-466f-85f7-12241379ab8b admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.242256 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534a38f-4bbf-466f-85f7-12241379ab8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.242639 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534a38f-4bbf-466f-85f7-12241379ab8b admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.243640 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534a38f-4bbf-466f-85f7-12241379ab8b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:58.243947 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534a38f-4bbf-466f-85f7-12241379ab8b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:58.244757 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3af48-7d16-4cf4-91f1-d244769a8dfa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:58.245947 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534a38f-4bbf-466f-85f7-12241379ab8b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:58.251618 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-8ff3af48-7d16-4cf4-91f1-d244769a8dfa admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 14:24:58.253133 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 261/528] 10.222.0.79 () {56 vars in 1123 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:58.259436 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3af48-7d16-4cf4-91f1-d244769a8dfa admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.266500 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 268/529] 10.222.0.79 () {56 vars in 1158 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:58.269079 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3af48-7d16-4cf4-91f1-d244769a8dfa admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.272826 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534a38f-4bbf-466f-85f7-12241379ab8b admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.274281 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a1d89-9cd7-45a0-9032-3faa94f29251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.275113 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a1d89-9cd7-45a0-9032-3faa94f29251 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.275462 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a1d89-9cd7-45a0-9032-3faa94f29251 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.275839 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a1d89-9cd7-45a0-9032-3faa94f29251 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.276673 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a1d89-9cd7-45a0-9032-3faa94f29251 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:58.277087 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a1d89-9cd7-45a0-9032-3faa94f29251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:58.278872 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a1d89-9cd7-45a0-9032-3faa94f29251 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:58.284825 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534a38f-4bbf-466f-85f7-12241379ab8b admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.288282 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 262/530] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:58.291414 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa1c71-930e-48e3-ae94-9e56555bf0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.292287 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa1c71-930e-48e3-ae94-9e56555bf0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.292739 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa1c71-930e-48e3-ae94-9e56555bf0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.293518 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa1c71-930e-48e3-ae94-9e56555bf0b7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.294407 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a1d89-9cd7-45a0-9032-3faa94f29251 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.304407 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa1c71-930e-48e3-ae94-9e56555bf0b7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:58.304538 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a1d89-9cd7-45a0-9032-3faa94f29251 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.306736 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa1c71-930e-48e3-ae94-9e56555bf0b7 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:58.309309 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f2603-f4aa-4e62-9364-8fa9d1b83161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.310309 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f2603-f4aa-4e62-9364-8fa9d1b83161 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.310651 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f2603-f4aa-4e62-9364-8fa9d1b83161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.311015 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f2603-f4aa-4e62-9364-8fa9d1b83161 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.317826 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 269/531] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:58.324246 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa1c71-930e-48e3-ae94-9e56555bf0b7 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.331853 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f2603-f4aa-4e62-9364-8fa9d1b83161 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:58.333755 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f2603-f4aa-4e62-9364-8fa9d1b83161 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:58.340386 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa1c71-930e-48e3-ae94-9e56555bf0b7 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.352393 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb2920-8800-43c9-a2b4-dcb96e3e7e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.353245 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb2920-8800-43c9-a2b4-dcb96e3e7e06 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.353523 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb2920-8800-43c9-a2b4-dcb96e3e7e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.353847 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb2920-8800-43c9-a2b4-dcb96e3e7e06 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.366705 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-f99f2603-f4aa-4e62-9364-8fa9d1b83161 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:58.368297 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 263/532] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:58.374666 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f2603-f4aa-4e62-9364-8fa9d1b83161 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.383729 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb2920-8800-43c9-a2b4-dcb96e3e7e06 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:58.384934 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f2603-f4aa-4e62-9364-8fa9d1b83161 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.387920 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb2920-8800-43c9-a2b4-dcb96e3e7e06 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:58.390053 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a304ddf-c025-4bf8-a526-9c7d27695fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.390745 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a304ddf-c025-4bf8-a526-9c7d27695fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.391074 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a304ddf-c025-4bf8-a526-9c7d27695fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.391345 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a304ddf-c025-4bf8-a526-9c7d27695fd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.392135 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a304ddf-c025-4bf8-a526-9c7d27695fd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:58.392439 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a304ddf-c025-4bf8-a526-9c7d27695fd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:58.394085 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a304ddf-c025-4bf8-a526-9c7d27695fd5 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:58.407381 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 264/533] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:58.413917 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a304ddf-c025-4bf8-a526-9c7d27695fd5 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.424033 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a304ddf-c025-4bf8-a526-9c7d27695fd5 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.425974 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-bbdb2920-8800-43c9-a2b4-dcb96e3e7e06 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:58.432918 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 270/534] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:58.434065 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb2920-8800-43c9-a2b4-dcb96e3e7e06 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.440636 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43f246-4ff5-4da7-9097-db87397df9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.441439 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43f246-4ff5-4da7-9097-db87397df9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.442919 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43f246-4ff5-4da7-9097-db87397df9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.443247 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43f246-4ff5-4da7-9097-db87397df9f1 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.453768 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43f246-4ff5-4da7-9097-db87397df9f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:58.456128 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43f246-4ff5-4da7-9097-db87397df9f1 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:58.460227 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb2920-8800-43c9-a2b4-dcb96e3e7e06 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.468876 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01fefd-9e46-46cb-bd41-932de7e8f5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.469587 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01fefd-9e46-46cb-bd41-932de7e8f5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.469955 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01fefd-9e46-46cb-bd41-932de7e8f5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.470220 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01fefd-9e46-46cb-bd41-932de7e8f5a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.470982 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01fefd-9e46-46cb-bd41-932de7e8f5a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:58.471330 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01fefd-9e46-46cb-bd41-932de7e8f5a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:58.471778 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-cc43f246-4ff5-4da7-9097-db87397df9f1 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 14:24:58.473007 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01fefd-9e46-46cb-bd41-932de7e8f5a4 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:58.473686 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 265/535] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/users/cinder => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:58.480279 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43f246-4ff5-4da7-9097-db87397df9f1 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.495527 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43f246-4ff5-4da7-9097-db87397df9f1 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.497715 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 271/536] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:58.502563 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9036db-9668-4ace-91c7-f011d6b16365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.504284 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01fefd-9e46-46cb-bd41-932de7e8f5a4 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.505014 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9036db-9668-4ace-91c7-f011d6b16365 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.506011 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9036db-9668-4ace-91c7-f011d6b16365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.510704 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9036db-9668-4ace-91c7-f011d6b16365 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.511844 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9036db-9668-4ace-91c7-f011d6b16365 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:58.512457 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9036db-9668-4ace-91c7-f011d6b16365 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:58.516324 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9036db-9668-4ace-91c7-f011d6b16365 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:58.521078 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01fefd-9e46-46cb-bd41-932de7e8f5a4 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.531574 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36974499-e963-4537-a477-e9d10aac58ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.532711 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36974499-e963-4537-a477-e9d10aac58ea admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.535039 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36974499-e963-4537-a477-e9d10aac58ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.535534 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36974499-e963-4537-a477-e9d10aac58ea admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.553037 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36974499-e963-4537-a477-e9d10aac58ea admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:58.558336 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36974499-e963-4537-a477-e9d10aac58ea admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:58.561482 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 266/537] 10.222.0.79 () {56 vars in 1158 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:58.574868 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9036db-9668-4ace-91c7-f011d6b16365 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.583085 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-36974499-e963-4537-a477-e9d10aac58ea admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:24:58.586073 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 272/538] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:58.589561 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9036db-9668-4ace-91c7-f011d6b16365 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.591110 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36974499-e963-4537-a477-e9d10aac58ea admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.601707 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4b59a-fd7e-4bcd-a9be-d76e5c0e1347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.602513 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4b59a-fd7e-4bcd-a9be-d76e5c0e1347 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.602834 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4b59a-fd7e-4bcd-a9be-d76e5c0e1347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.603111 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4b59a-fd7e-4bcd-a9be-d76e5c0e1347 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.610535 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36974499-e963-4537-a477-e9d10aac58ea admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.618140 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4b59a-fd7e-4bcd-a9be-d76e5c0e1347 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:58.620630 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4b59a-fd7e-4bcd-a9be-d76e5c0e1347 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:58.621384 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f18b94-0491-47b1-9d07-8600c047bb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.622040 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f18b94-0491-47b1-9d07-8600c047bb73 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.622309 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f18b94-0491-47b1-9d07-8600c047bb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.622573 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f18b94-0491-47b1-9d07-8600c047bb73 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.623440 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f18b94-0491-47b1-9d07-8600c047bb73 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:58.623747 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f18b94-0491-47b1-9d07-8600c047bb73 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:58.627035 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f18b94-0491-47b1-9d07-8600c047bb73 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:58.647119 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 267/539] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:24:58.660498 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4b59a-fd7e-4bcd-a9be-d76e5c0e1347 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.667288 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 273/540] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:58.667768 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f18b94-0491-47b1-9d07-8600c047bb73 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.673172 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4b59a-fd7e-4bcd-a9be-d76e5c0e1347 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.683764 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7baf6-732e-46ec-bbd8-f45f423c695f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.685823 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7baf6-732e-46ec-bbd8-f45f423c695f admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.686103 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7baf6-732e-46ec-bbd8-f45f423c695f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.686374 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7baf6-732e-46ec-bbd8-f45f423c695f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.687583 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f18b94-0491-47b1-9d07-8600c047bb73 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.695913 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482aee61-aee0-4317-9f51-d71f35886754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.696577 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482aee61-aee0-4317-9f51-d71f35886754 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.697235 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482aee61-aee0-4317-9f51-d71f35886754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.697235 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482aee61-aee0-4317-9f51-d71f35886754 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.697957 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482aee61-aee0-4317-9f51-d71f35886754 admin admin] RBAC: Adding query filter params (role.id=1ee8b426ca9a49e5b7fb33be19e8a616, scope.project.id=b433200db4784bfeadca48d24212e823, user.id=73a98d6cf23e4710bfbf71b960f81a9e) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:58.698266 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482aee61-aee0-4317-9f51-d71f35886754 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:58.700151 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482aee61-aee0-4317-9f51-d71f35886754 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:58.700717 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7baf6-732e-46ec-bbd8-f45f423c695f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:58.702881 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7baf6-732e-46ec-bbd8-f45f423c695f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:58.706794 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 274/541] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/role_assignments?user.id=73a98d6cf23e4710bfbf71b960f81a9e&scope.project.id=b433200db4784bfeadca48d24212e823&role.id=1ee8b426ca9a49e5b7fb33be19e8a616 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:58.708157 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8198562-2421-4bfe-8b6c-86f1a3b83c31 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.708445 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8198562-2421-4bfe-8b6c-86f1a3b83c31 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.708722 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8198562-2421-4bfe-8b6c-86f1a3b83c31 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.710351 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 275/542] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:58.716897 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b11991-fad8-4857-a83e-216c4f8d524d None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.717211 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b11991-fad8-4857-a83e-216c4f8d524d None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.717443 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b11991-fad8-4857-a83e-216c4f8d524d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.723126 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-11b7baf6-732e-46ec-bbd8-f45f423c695f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:58.725899 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 268/543] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:58.736815 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7baf6-732e-46ec-bbd8-f45f423c695f admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.741465 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-a4b11991-fad8-4857-a83e-216c4f8d524d None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:58.742860 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a4b11991-fad8-4857-a83e-216c4f8d524d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:58.755800 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 276/544] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:24:58.756647 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7baf6-732e-46ec-bbd8-f45f423c695f admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.767367 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79158a32-da28-4b14-9611-e864137e6d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.768257 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79158a32-da28-4b14-9611-e864137e6d3c admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.768605 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79158a32-da28-4b14-9611-e864137e6d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.768998 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79158a32-da28-4b14-9611-e864137e6d3c admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.769932 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79158a32-da28-4b14-9611-e864137e6d3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:58.770316 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79158a32-da28-4b14-9611-e864137e6d3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:58.772201 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79158a32-da28-4b14-9611-e864137e6d3c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:58.790317 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 269/545] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:58.796819 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b11991-fad8-4857-a83e-216c4f8d524d None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.811274 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b11991-fad8-4857-a83e-216c4f8d524d None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.821051 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471c5b2-5314-4bca-a97a-9f4e9061e633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.821883 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471c5b2-5314-4bca-a97a-9f4e9061e633 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.822161 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471c5b2-5314-4bca-a97a-9f4e9061e633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.822481 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471c5b2-5314-4bca-a97a-9f4e9061e633 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.831693 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471c5b2-5314-4bca-a97a-9f4e9061e633 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:58.833848 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471c5b2-5314-4bca-a97a-9f4e9061e633 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:58.839586 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79158a32-da28-4b14-9611-e864137e6d3c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.851817 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79158a32-da28-4b14-9611-e864137e6d3c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.858203 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27e6a2-3ec6-4cbb-8a59-e9c67d594ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.859117 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27e6a2-3ec6-4cbb-8a59-e9c67d594ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.859430 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27e6a2-3ec6-4cbb-8a59-e9c67d594ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.859715 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27e6a2-3ec6-4cbb-8a59-e9c67d594ee0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.865138 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-1471c5b2-5314-4bca-a97a-9f4e9061e633 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:24:58.866738 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 277/546] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:58.875752 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471c5b2-5314-4bca-a97a-9f4e9061e633 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.881582 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27e6a2-3ec6-4cbb-8a59-e9c67d594ee0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:58.888849 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471c5b2-5314-4bca-a97a-9f4e9061e633 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.889339 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-4f27e6a2-3ec6-4cbb-8a59-e9c67d594ee0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 14:24:58.891146 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 270/547] 10.222.0.79 () {56 vars in 1123 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:58.897853 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27e6a2-3ec6-4cbb-8a59-e9c67d594ee0 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.908157 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090a5c7-0450-47e1-b9da-ad7a3ce45887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.908913 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090a5c7-0450-47e1-b9da-ad7a3ce45887 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.909189 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090a5c7-0450-47e1-b9da-ad7a3ce45887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.909455 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090a5c7-0450-47e1-b9da-ad7a3ce45887 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.910273 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090a5c7-0450-47e1-b9da-ad7a3ce45887 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:58.910763 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090a5c7-0450-47e1-b9da-ad7a3ce45887 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:58.911696 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27e6a2-3ec6-4cbb-8a59-e9c67d594ee0 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.912597 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090a5c7-0450-47e1-b9da-ad7a3ce45887 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:58.916804 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c11af2-9922-436d-aef5-3fa7c88de956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.917751 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c11af2-9922-436d-aef5-3fa7c88de956 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.918206 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c11af2-9922-436d-aef5-3fa7c88de956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.918657 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c11af2-9922-436d-aef5-3fa7c88de956 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.919709 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c11af2-9922-436d-aef5-3fa7c88de956 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:58.920188 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c11af2-9922-436d-aef5-3fa7c88de956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:58.922445 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c11af2-9922-436d-aef5-3fa7c88de956 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:58.932635 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 271/548] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:58.939005 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c11af2-9922-436d-aef5-3fa7c88de956 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.941593 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 278/549] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:58.950240 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c11af2-9922-436d-aef5-3fa7c88de956 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.952780 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090a5c7-0450-47e1-b9da-ad7a3ce45887 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:58.961861 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189d9a5-bf25-42f5-8fe1-dfd720f09752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.962796 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189d9a5-bf25-42f5-8fe1-dfd720f09752 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.963135 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189d9a5-bf25-42f5-8fe1-dfd720f09752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.963471 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189d9a5-bf25-42f5-8fe1-dfd720f09752 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.966630 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090a5c7-0450-47e1-b9da-ad7a3ce45887 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:58.975288 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189d9a5-bf25-42f5-8fe1-dfd720f09752 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:58.975880 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e89010-5243-4e60-8580-4a9fde2b7587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:58.976764 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e89010-5243-4e60-8580-4a9fde2b7587 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:58.977326 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e89010-5243-4e60-8580-4a9fde2b7587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:58.977479 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189d9a5-bf25-42f5-8fe1-dfd720f09752 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:58.977915 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e89010-5243-4e60-8580-4a9fde2b7587 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:58.979018 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e89010-5243-4e60-8580-4a9fde2b7587 admin admin] RBAC: Adding query filter params (role.id=1ee8b426ca9a49e5b7fb33be19e8a616, scope.project.id=b433200db4784bfeadca48d24212e823, user.id=218708788ed447499b00de12cff0f6e5) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:58.979534 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e89010-5243-4e60-8580-4a9fde2b7587 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:58.981566 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e89010-5243-4e60-8580-4a9fde2b7587 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:58.994727 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 279/550] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/role_assignments?user.id=218708788ed447499b00de12cff0f6e5&scope.project.id=b433200db4784bfeadca48d24212e823&role.id=1ee8b426ca9a49e5b7fb33be19e8a616 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:59.002480 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-0189d9a5-bf25-42f5-8fe1-dfd720f09752 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:59.004111 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 272/551] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:59.016098 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e89010-5243-4e60-8580-4a9fde2b7587 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:59.031295 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e89010-5243-4e60-8580-4a9fde2b7587 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:59.039656 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703705cf-1bf7-42e6-aeea-b29f9c74ef64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:59.040450 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703705cf-1bf7-42e6-aeea-b29f9c74ef64 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:59.040729 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703705cf-1bf7-42e6-aeea-b29f9c74ef64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:59.041001 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703705cf-1bf7-42e6-aeea-b29f9c74ef64 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:59.041810 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703705cf-1bf7-42e6-aeea-b29f9c74ef64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:59.042165 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703705cf-1bf7-42e6-aeea-b29f9c74ef64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:59.043871 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703705cf-1bf7-42e6-aeea-b29f9c74ef64 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:59.065091 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 280/552] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:59.071720 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189d9a5-bf25-42f5-8fe1-dfd720f09752 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:59.085256 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189d9a5-bf25-42f5-8fe1-dfd720f09752 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:59.093356 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cf5e0-1491-4705-8b5c-9dd846f22a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:59.094581 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cf5e0-1491-4705-8b5c-9dd846f22a2f admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:59.095123 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cf5e0-1491-4705-8b5c-9dd846f22a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:59.095603 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cf5e0-1491-4705-8b5c-9dd846f22a2f admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:59.105074 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cf5e0-1491-4705-8b5c-9dd846f22a2f admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:59.107713 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cf5e0-1491-4705-8b5c-9dd846f22a2f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:59.123364 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-601cf5e0-1491-4705-8b5c-9dd846f22a2f admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 14:24:59.125346 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 273/553] 10.222.0.79 () {56 vars in 1123 bytes} [Thu Oct 28 14:24:59 2021] GET /identity/v3/users/neutron => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:59.131401 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703705cf-1bf7-42e6-aeea-b29f9c74ef64 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:59.144469 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703705cf-1bf7-42e6-aeea-b29f9c74ef64 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:59.154205 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715dac6-39fa-4f7c-a292-734d359ada48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:59.155321 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715dac6-39fa-4f7c-a292-734d359ada48 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:59.155831 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715dac6-39fa-4f7c-a292-734d359ada48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:59.156288 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715dac6-39fa-4f7c-a292-734d359ada48 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:59.157390 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715dac6-39fa-4f7c-a292-734d359ada48 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:59.158011 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715dac6-39fa-4f7c-a292-734d359ada48 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:59.160259 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715dac6-39fa-4f7c-a292-734d359ada48 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:59.186524 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 281/554] 10.222.0.79 () {56 vars in 1160 bytes} [Thu Oct 28 14:24:59 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:59.192677 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cf5e0-1491-4705-8b5c-9dd846f22a2f admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:59.204685 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cf5e0-1491-4705-8b5c-9dd846f22a2f admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:59.211574 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccae5ec-af60-41ae-92a7-1902cfab68db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:59.212664 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccae5ec-af60-41ae-92a7-1902cfab68db admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:59.213157 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccae5ec-af60-41ae-92a7-1902cfab68db admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:59.213857 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccae5ec-af60-41ae-92a7-1902cfab68db admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:59.215817 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b366c-11a3-4520-b037-4eb4ee89bef6 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:59.216297 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b366c-11a3-4520-b037-4eb4ee89bef6 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:59.216736 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b366c-11a3-4520-b037-4eb4ee89bef6 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:59.219264 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 282/555] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:24:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:24:59.224310 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccae5ec-af60-41ae-92a7-1902cfab68db admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:59.226077 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccae5ec-af60-41ae-92a7-1902cfab68db admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:59.234294 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65038a-94b1-42e3-9040-1b27caed4ea4 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:59.234929 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65038a-94b1-42e3-9040-1b27caed4ea4 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:59.235681 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65038a-94b1-42e3-9040-1b27caed4ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:59.236870 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 274/556] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:24:59 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:24:59.242834 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccae5ec-af60-41ae-92a7-1902cfab68db admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:59.251873 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccae5ec-af60-41ae-92a7-1902cfab68db admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:59.255794 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-bc65038a-94b1-42e3-9040-1b27caed4ea4 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:24:59.256522 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e46795-6ef5-45b5-af67-ab4a5185296f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:59.257359 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e46795-6ef5-45b5-af67-ab4a5185296f admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:59.257632 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e46795-6ef5-45b5-af67-ab4a5185296f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:59.257886 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-bc65038a-94b1-42e3-9040-1b27caed4ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:24:59.258000 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e46795-6ef5-45b5-af67-ab4a5185296f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:59.266420 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 283/557] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:24:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:24:59.270851 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e46795-6ef5-45b5-af67-ab4a5185296f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:59.271641 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e46795-6ef5-45b5-af67-ab4a5185296f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:59.288606 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-b3e46795-6ef5-45b5-af67-ab4a5185296f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:59.290104 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 275/558] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:59.293603 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65038a-94b1-42e3-9040-1b27caed4ea4 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:59.295916 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e46795-6ef5-45b5-af67-ab4a5185296f admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:59.305903 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e46795-6ef5-45b5-af67-ab4a5185296f admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:59.306310 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65038a-94b1-42e3-9040-1b27caed4ea4 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:59.313169 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354eccca-295e-49d7-888c-76700776d7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:59.313328 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835823d-7572-4368-93bb-d5e4aca00142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:59.313966 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835823d-7572-4368-93bb-d5e4aca00142 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:59.314238 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835823d-7572-4368-93bb-d5e4aca00142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:59.314512 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835823d-7572-4368-93bb-d5e4aca00142 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:59.315039 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354eccca-295e-49d7-888c-76700776d7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:59.315293 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835823d-7572-4368-93bb-d5e4aca00142 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:59.315591 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835823d-7572-4368-93bb-d5e4aca00142 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:59.315929 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354eccca-295e-49d7-888c-76700776d7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:59.316379 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354eccca-295e-49d7-888c-76700776d7d6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:59.317354 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835823d-7572-4368-93bb-d5e4aca00142 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:59.328406 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354eccca-295e-49d7-888c-76700776d7d6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:24:59.329978 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 276/559] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:59.335898 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835823d-7572-4368-93bb-d5e4aca00142 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:59.336705 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-354eccca-295e-49d7-888c-76700776d7d6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 14:24:59.342798 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 284/560] 10.222.0.79 () {56 vars in 1123 bytes} [Thu Oct 28 14:24:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:59.345239 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354eccca-295e-49d7-888c-76700776d7d6 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:59.346167 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835823d-7572-4368-93bb-d5e4aca00142 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:59.350998 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a257502-c156-4337-b661-52995503982b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:59.351538 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a257502-c156-4337-b661-52995503982b admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:59.351977 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a257502-c156-4337-b661-52995503982b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:59.352317 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a257502-c156-4337-b661-52995503982b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:59.358006 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354eccca-295e-49d7-888c-76700776d7d6 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:59.359870 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a257502-c156-4337-b661-52995503982b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:59.362464 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a257502-c156-4337-b661-52995503982b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:59.363478 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1e0aa-68e6-4522-bef9-bcdd814a22b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:59.364432 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1e0aa-68e6-4522-bef9-bcdd814a22b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:59.364844 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1e0aa-68e6-4522-bef9-bcdd814a22b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:59.365247 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1e0aa-68e6-4522-bef9-bcdd814a22b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:59.366179 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1e0aa-68e6-4522-bef9-bcdd814a22b5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:59.366637 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1e0aa-68e6-4522-bef9-bcdd814a22b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:59.368679 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1e0aa-68e6-4522-bef9-bcdd814a22b5 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:59.377168 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-7a257502-c156-4337-b661-52995503982b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:24:59.378515 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 277/561] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:24:59.383812 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 285/562] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Oct 28 14:24:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:59.385661 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a257502-c156-4337-b661-52995503982b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:59.388428 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1e0aa-68e6-4522-bef9-bcdd814a22b5 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:59.396645 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a257502-c156-4337-b661-52995503982b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:59.398531 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1e0aa-68e6-4522-bef9-bcdd814a22b5 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:59.401602 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5b753-757f-4618-bd45-f9fc7dca49d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:59.402527 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5b753-757f-4618-bd45-f9fc7dca49d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:59.403019 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5b753-757f-4618-bd45-f9fc7dca49d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:59.403379 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5b753-757f-4618-bd45-f9fc7dca49d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:59.404279 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144fdf2-8b4f-42d1-aca7-6f2d97e5461c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:59.404442 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5b753-757f-4618-bd45-f9fc7dca49d6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:59.404835 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5b753-757f-4618-bd45-f9fc7dca49d6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:59.405539 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144fdf2-8b4f-42d1-aca7-6f2d97e5461c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:59.405976 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144fdf2-8b4f-42d1-aca7-6f2d97e5461c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:59.406372 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144fdf2-8b4f-42d1-aca7-6f2d97e5461c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:59.407388 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5b753-757f-4618-bd45-f9fc7dca49d6 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:59.417956 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3144fdf2-8b4f-42d1-aca7-6f2d97e5461c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:59.419784 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 278/563] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:24:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:59.420656 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3144fdf2-8b4f-42d1-aca7-6f2d97e5461c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:59.426002 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5b753-757f-4618-bd45-f9fc7dca49d6 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:59.436980 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5b753-757f-4618-bd45-f9fc7dca49d6 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:59.441391 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064608bb-d772-44a5-8bcc-09a23cffb380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:59.442104 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064608bb-d772-44a5-8bcc-09a23cffb380 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:59.442446 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064608bb-d772-44a5-8bcc-09a23cffb380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:59.442703 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-3144fdf2-8b4f-42d1-aca7-6f2d97e5461c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:59.442850 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064608bb-d772-44a5-8bcc-09a23cffb380 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:59.443779 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064608bb-d772-44a5-8bcc-09a23cffb380 admin admin] RBAC: Adding query filter params (role.id=1ee8b426ca9a49e5b7fb33be19e8a616, scope.project.id=b433200db4784bfeadca48d24212e823, user.id=a689fc75b37b4557a682f6cad357df6c) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:59.444155 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064608bb-d772-44a5-8bcc-09a23cffb380 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:59.449923 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064608bb-d772-44a5-8bcc-09a23cffb380 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:59.450190 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 286/564] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:59.451615 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144fdf2-8b4f-42d1-aca7-6f2d97e5461c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:59.452947 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 279/565] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:24:59 2021] GET /identity/v3/role_assignments?user.id=a689fc75b37b4557a682f6cad357df6c&scope.project.id=b433200db4784bfeadca48d24212e823&role.id=1ee8b426ca9a49e5b7fb33be19e8a616 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:59.465157 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144fdf2-8b4f-42d1-aca7-6f2d97e5461c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:59.471897 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c523f5d-2090-427e-8cb6-5f626c0447ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:59.472997 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c523f5d-2090-427e-8cb6-5f626c0447ed admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:59.474762 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c523f5d-2090-427e-8cb6-5f626c0447ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:59.475264 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c523f5d-2090-427e-8cb6-5f626c0447ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:59.476332 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c523f5d-2090-427e-8cb6-5f626c0447ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:59.476895 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c523f5d-2090-427e-8cb6-5f626c0447ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:59.478835 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c523f5d-2090-427e-8cb6-5f626c0447ed admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:59.498144 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 287/566] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:24:59.503860 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064608bb-d772-44a5-8bcc-09a23cffb380 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:59.515238 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064608bb-d772-44a5-8bcc-09a23cffb380 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:59.520409 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e65384-9857-4576-a8c0-98d850d0a69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:59.521572 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e65384-9857-4576-a8c0-98d850d0a69f admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:59.522026 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e65384-9857-4576-a8c0-98d850d0a69f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:59.522498 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e65384-9857-4576-a8c0-98d850d0a69f admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:59.532288 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e65384-9857-4576-a8c0-98d850d0a69f admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:59.534787 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e65384-9857-4576-a8c0-98d850d0a69f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:59.549905 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-b1e65384-9857-4576-a8c0-98d850d0a69f admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 14:24:59.555211 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 280/567] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:24:59 2021] GET /identity/v3/users/swift => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:59.559597 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c523f5d-2090-427e-8cb6-5f626c0447ed admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:59.571287 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c523f5d-2090-427e-8cb6-5f626c0447ed admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:59.576699 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22b789-569f-430e-96e5-96714d570e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:59.577677 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22b789-569f-430e-96e5-96714d570e18 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:59.578126 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22b789-569f-430e-96e5-96714d570e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:59.578607 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22b789-569f-430e-96e5-96714d570e18 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:59.579680 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22b789-569f-430e-96e5-96714d570e18 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:59.580154 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22b789-569f-430e-96e5-96714d570e18 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:59.582272 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22b789-569f-430e-96e5-96714d570e18 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:59.607435 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 288/568] 10.222.0.79 () {56 vars in 1156 bytes} [Thu Oct 28 14:24:59 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:59.610618 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e65384-9857-4576-a8c0-98d850d0a69f admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:59.621445 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e65384-9857-4576-a8c0-98d850d0a69f admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:59.630509 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371912da-4bdd-4e3b-a245-01edbf3e8457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:59.631665 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371912da-4bdd-4e3b-a245-01edbf3e8457 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:59.632190 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371912da-4bdd-4e3b-a245-01edbf3e8457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:59.632658 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371912da-4bdd-4e3b-a245-01edbf3e8457 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:59.646913 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371912da-4bdd-4e3b-a245-01edbf3e8457 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:59.649286 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371912da-4bdd-4e3b-a245-01edbf3e8457 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:59.667961 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-371912da-4bdd-4e3b-a245-01edbf3e8457 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:24:59.674568 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 281/569] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:24:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:59.677448 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22b789-569f-430e-96e5-96714d570e18 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:59.688405 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22b789-569f-430e-96e5-96714d570e18 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:59.693270 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7de210-c521-49bf-be79-66cfbe4d3a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:59.694211 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7de210-c521-49bf-be79-66cfbe4d3a45 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:59.694808 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7de210-c521-49bf-be79-66cfbe4d3a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:59.695264 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7de210-c521-49bf-be79-66cfbe4d3a45 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:59.696207 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7de210-c521-49bf-be79-66cfbe4d3a45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:59.696669 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7de210-c521-49bf-be79-66cfbe4d3a45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:59.698665 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7de210-c521-49bf-be79-66cfbe4d3a45 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:59.714787 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 289/570] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:24:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:59.718977 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371912da-4bdd-4e3b-a245-01edbf3e8457 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:59.729298 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371912da-4bdd-4e3b-a245-01edbf3e8457 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:59.733823 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71118cab-dd5a-4d89-9010-d6e90fbf2609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:59.734614 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71118cab-dd5a-4d89-9010-d6e90fbf2609 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:59.734917 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71118cab-dd5a-4d89-9010-d6e90fbf2609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:59.735181 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71118cab-dd5a-4d89-9010-d6e90fbf2609 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:59.742381 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71118cab-dd5a-4d89-9010-d6e90fbf2609 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:59.744521 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71118cab-dd5a-4d89-9010-d6e90fbf2609 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:59.758755 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-71118cab-dd5a-4d89-9010-d6e90fbf2609 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:24:59.765500 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 282/571] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:24:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:24:59.767029 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7de210-c521-49bf-be79-66cfbe4d3a45 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:59.777807 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7de210-c521-49bf-be79-66cfbe4d3a45 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:59.782322 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e9b16-b266-4dfc-81b2-016db97c9f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:59.783064 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e9b16-b266-4dfc-81b2-016db97c9f13 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:59.783341 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e9b16-b266-4dfc-81b2-016db97c9f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:59.783609 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e9b16-b266-4dfc-81b2-016db97c9f13 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:59.784460 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e9b16-b266-4dfc-81b2-016db97c9f13 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:24:59.784763 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e9b16-b266-4dfc-81b2-016db97c9f13 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:59.786705 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e9b16-b266-4dfc-81b2-016db97c9f13 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:59.806016 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 290/572] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:24:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:24:59.809072 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71118cab-dd5a-4d89-9010-d6e90fbf2609 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:24:59.822221 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71118cab-dd5a-4d89-9010-d6e90fbf2609 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:24:59.827873 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1baade-902d-4472-8b02-3944a80a99c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:24:59.828812 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1baade-902d-4472-8b02-3944a80a99c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:24:59.829253 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1baade-902d-4472-8b02-3944a80a99c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:24:59.829630 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1baade-902d-4472-8b02-3944a80a99c6 admin admin] PATH_INFO: `/v3/projects/b433200db4784bfeadca48d24212e823/users/889e7be1dcaf47f599af9c9b7ad33042/roles/1ee8b426ca9a49e5b7fb33be19e8a616` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:24:59.846125 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1baade-902d-4472-8b02-3944a80a99c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b433200db4784bfeadca48d24212e823, user_id=889e7be1dcaf47f599af9c9b7ad33042, role_id=1ee8b426ca9a49e5b7fb33be19e8a616)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:24:59.848827 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1baade-902d-4472-8b02-3944a80a99c6 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:24:59.866529 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 283/573] 10.222.0.79 () {58 vars in 1460 bytes} [Thu Oct 28 14:24:59 2021] PUT /identity/v3/projects/b433200db4784bfeadca48d24212e823/users/889e7be1dcaf47f599af9c9b7ad33042/roles/1ee8b426ca9a49e5b7fb33be19e8a616 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:25:00.666005 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bf98a-569d-4d54-9b3d-186d02961fb9 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:00.666550 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bf98a-569d-4d54-9b3d-186d02961fb9 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:00.666860 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bf98a-569d-4d54-9b3d-186d02961fb9 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:00.668635 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 291/574] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:00.674824 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2705a-0781-45fc-bb9e-efcd3bc3026d None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:00.675699 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2705a-0781-45fc-bb9e-efcd3bc3026d None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:00.676527 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2705a-0781-45fc-bb9e-efcd3bc3026d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:00.697685 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-c0e2705a-0781-45fc-bb9e-efcd3bc3026d None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:00.699240 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-c0e2705a-0781-45fc-bb9e-efcd3bc3026d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:00.779470 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 284/575] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:00.804036 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bf98a-569d-4d54-9b3d-186d02961fb9 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:00.820493 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bf98a-569d-4d54-9b3d-186d02961fb9 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:00.825027 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61e9b9-9fa2-44ae-9318-806f15ca4ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:00.826043 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61e9b9-9fa2-44ae-9318-806f15ca4ddb admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:00.826510 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61e9b9-9fa2-44ae-9318-806f15ca4ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:00.827014 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61e9b9-9fa2-44ae-9318-806f15ca4ddb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:00.846300 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61e9b9-9fa2-44ae-9318-806f15ca4ddb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:25:00.853424 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-3c61e9b9-9fa2-44ae-9318-806f15ca4ddb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:25:00.855165 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 292/576] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:25:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:00.861706 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2705a-0781-45fc-bb9e-efcd3bc3026d None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:00.871172 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2705a-0781-45fc-bb9e-efcd3bc3026d None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:00.875779 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893600ab-ee06-48ab-998c-32d6abc93f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:00.876722 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893600ab-ee06-48ab-998c-32d6abc93f53 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:00.877189 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893600ab-ee06-48ab-998c-32d6abc93f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:00.877673 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893600ab-ee06-48ab-998c-32d6abc93f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:00.878658 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893600ab-ee06-48ab-998c-32d6abc93f53 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:00.879179 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893600ab-ee06-48ab-998c-32d6abc93f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:00.880964 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893600ab-ee06-48ab-998c-32d6abc93f53 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:00.890388 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 285/577] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:25:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:00.896648 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61e9b9-9fa2-44ae-9318-806f15ca4ddb admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:00.910909 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61e9b9-9fa2-44ae-9318-806f15ca4ddb admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:00.915753 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566dec4-1e2f-4893-b1c5-c8be902b855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:00.916944 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566dec4-1e2f-4893-b1c5-c8be902b855a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:00.917414 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566dec4-1e2f-4893-b1c5-c8be902b855a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:00.917919 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566dec4-1e2f-4893-b1c5-c8be902b855a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:00.938184 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566dec4-1e2f-4893-b1c5-c8be902b855a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:00.940399 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566dec4-1e2f-4893-b1c5-c8be902b855a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:00.958948 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-1566dec4-1e2f-4893-b1c5-c8be902b855a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:00.960520 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 293/578] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:00.967128 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893600ab-ee06-48ab-998c-32d6abc93f53 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:00.979760 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893600ab-ee06-48ab-998c-32d6abc93f53 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:00.986894 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c89bad-f236-400d-9fb3-5f2d5faf4511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:00.987817 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c89bad-f236-400d-9fb3-5f2d5faf4511 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:00.988311 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c89bad-f236-400d-9fb3-5f2d5faf4511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:00.988876 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c89bad-f236-400d-9fb3-5f2d5faf4511 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:00.989856 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c89bad-f236-400d-9fb3-5f2d5faf4511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:00.990348 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c89bad-f236-400d-9fb3-5f2d5faf4511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:00.992255 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c89bad-f236-400d-9fb3-5f2d5faf4511 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:01.008009 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 286/579] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:01.013942 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566dec4-1e2f-4893-b1c5-c8be902b855a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:01.025914 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566dec4-1e2f-4893-b1c5-c8be902b855a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:01.030615 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ec694-d151-46bd-9964-1496ed184d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:01.031707 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ec694-d151-46bd-9964-1496ed184d01 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:01.032224 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ec694-d151-46bd-9964-1496ed184d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:01.032702 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ec694-d151-46bd-9964-1496ed184d01 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:01.045374 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ec694-d151-46bd-9964-1496ed184d01 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:01.047706 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ec694-d151-46bd-9964-1496ed184d01 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:01.061674 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-e23ec694-d151-46bd-9964-1496ed184d01 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 14:25:01.063486 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 294/580] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Oct 28 14:25:01 2021] GET /identity/v3/users/nova => generated 82 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:01.070052 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c89bad-f236-400d-9fb3-5f2d5faf4511 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:01.087814 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c89bad-f236-400d-9fb3-5f2d5faf4511 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:01.099921 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e480b-1b52-49eb-ab1c-941b775c9003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:01.100613 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e480b-1b52-49eb-ab1c-941b775c9003 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:01.100894 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e480b-1b52-49eb-ab1c-941b775c9003 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:01.101170 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e480b-1b52-49eb-ab1c-941b775c9003 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:01.102108 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e480b-1b52-49eb-ab1c-941b775c9003 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:01.102420 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e480b-1b52-49eb-ab1c-941b775c9003 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:01.104388 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e480b-1b52-49eb-ab1c-941b775c9003 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:01.138395 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 287/581] 10.222.0.79 () {56 vars in 1154 bytes} [Thu Oct 28 14:25:01 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:01.144264 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ec694-d151-46bd-9964-1496ed184d01 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:01.157157 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ec694-d151-46bd-9964-1496ed184d01 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:01.161835 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15ea8f-37fd-4e82-a500-789efd52e9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:01.162800 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15ea8f-37fd-4e82-a500-789efd52e9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:01.163321 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15ea8f-37fd-4e82-a500-789efd52e9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:01.163799 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15ea8f-37fd-4e82-a500-789efd52e9b5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:01.181559 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15ea8f-37fd-4e82-a500-789efd52e9b5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:01.183275 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15ea8f-37fd-4e82-a500-789efd52e9b5 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:01.201162 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 295/582] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:25:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:25:01.207232 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e480b-1b52-49eb-ab1c-941b775c9003 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:01.220294 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e480b-1b52-49eb-ab1c-941b775c9003 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:01.229711 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac1d7d-3ac0-40b7-974e-9625339a1e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:01.230521 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac1d7d-3ac0-40b7-974e-9625339a1e6f admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:01.230828 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac1d7d-3ac0-40b7-974e-9625339a1e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:01.231101 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac1d7d-3ac0-40b7-974e-9625339a1e6f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:01.247711 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac1d7d-3ac0-40b7-974e-9625339a1e6f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:01.249573 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac1d7d-3ac0-40b7-974e-9625339a1e6f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:01.272028 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-85ac1d7d-3ac0-40b7-974e-9625339a1e6f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:01.273246 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 288/583] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:01.279707 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15ea8f-37fd-4e82-a500-789efd52e9b5 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:01.293027 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15ea8f-37fd-4e82-a500-789efd52e9b5 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:01.297648 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb5967-1175-4ec9-bd56-4f2ed317db1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:01.298309 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb5967-1175-4ec9-bd56-4f2ed317db1e admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:01.298589 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb5967-1175-4ec9-bd56-4f2ed317db1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:01.298890 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb5967-1175-4ec9-bd56-4f2ed317db1e admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:01.299625 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb5967-1175-4ec9-bd56-4f2ed317db1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:01.299928 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb5967-1175-4ec9-bd56-4f2ed317db1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:01.301901 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb5967-1175-4ec9-bd56-4f2ed317db1e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:01.318007 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 296/584] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:01.324868 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac1d7d-3ac0-40b7-974e-9625339a1e6f admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:01.339827 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac1d7d-3ac0-40b7-974e-9625339a1e6f admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:01.348176 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db9d11-9418-4124-85f0-c25ff06eaf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:01.348988 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db9d11-9418-4124-85f0-c25ff06eaf28 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:01.349272 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db9d11-9418-4124-85f0-c25ff06eaf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:01.349551 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db9d11-9418-4124-85f0-c25ff06eaf28 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:01.359808 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db9d11-9418-4124-85f0-c25ff06eaf28 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:01.361793 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db9d11-9418-4124-85f0-c25ff06eaf28 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:01.378241 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-a9db9d11-9418-4124-85f0-c25ff06eaf28 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:25:01.379523 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 289/585] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:25:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:01.386174 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb5967-1175-4ec9-bd56-4f2ed317db1e admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:01.399695 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb5967-1175-4ec9-bd56-4f2ed317db1e admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:01.408218 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee7a59-22d2-4a53-b0dd-a041ea710edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:01.408890 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee7a59-22d2-4a53-b0dd-a041ea710edd admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:01.409170 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee7a59-22d2-4a53-b0dd-a041ea710edd admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:01.409440 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee7a59-22d2-4a53-b0dd-a041ea710edd admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:01.410250 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee7a59-22d2-4a53-b0dd-a041ea710edd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:01.410554 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee7a59-22d2-4a53-b0dd-a041ea710edd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:01.412433 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee7a59-22d2-4a53-b0dd-a041ea710edd admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:01.428309 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 297/586] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:25:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:01.434847 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db9d11-9418-4124-85f0-c25ff06eaf28 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:01.452548 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db9d11-9418-4124-85f0-c25ff06eaf28 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:01.461096 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9b2a4-f58c-41e3-b28a-8a1cf254d4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:01.461835 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9b2a4-f58c-41e3-b28a-8a1cf254d4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:01.462110 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9b2a4-f58c-41e3-b28a-8a1cf254d4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:01.462383 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9b2a4-f58c-41e3-b28a-8a1cf254d4a3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:01.463282 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9b2a4-f58c-41e3-b28a-8a1cf254d4a3 admin admin] RBAC: Adding query filter params (role.id=f7b8954a0fe64dc2b6146c7174498ddb, scope.project.id=b433200db4784bfeadca48d24212e823, user.id=18cd6636ae7847c78be910824410d295) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:01.463598 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9b2a4-f58c-41e3-b28a-8a1cf254d4a3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:01.465525 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9b2a4-f58c-41e3-b28a-8a1cf254d4a3 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:01.475575 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 290/587] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:25:01 2021] GET /identity/v3/role_assignments?user.id=18cd6636ae7847c78be910824410d295&scope.project.id=b433200db4784bfeadca48d24212e823&role.id=f7b8954a0fe64dc2b6146c7174498ddb => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:01.628611 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3837c4-1e93-4651-8085-9539219e0300 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:01.628948 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3837c4-1e93-4651-8085-9539219e0300 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:01.629159 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3837c4-1e93-4651-8085-9539219e0300 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:01.631271 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 298/588] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:01.637804 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d880815-a6a7-4101-a9b2-c1f1d3ec8ffd None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:01.638167 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d880815-a6a7-4101-a9b2-c1f1d3ec8ffd None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:01.638359 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d880815-a6a7-4101-a9b2-c1f1d3ec8ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:01.663807 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-3d880815-a6a7-4101-a9b2-c1f1d3ec8ffd None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:01.665119 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-3d880815-a6a7-4101-a9b2-c1f1d3ec8ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:01.673482 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 291/589] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:01.723934 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3837c4-1e93-4651-8085-9539219e0300 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:01.740518 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3837c4-1e93-4651-8085-9539219e0300 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:01.745332 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c5bd6-7386-41db-a7ff-3a896396a3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:01.746157 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c5bd6-7386-41db-a7ff-3a896396a3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:01.746435 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c5bd6-7386-41db-a7ff-3a896396a3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:01.746726 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c5bd6-7386-41db-a7ff-3a896396a3c8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:01.762393 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c5bd6-7386-41db-a7ff-3a896396a3c8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:01.764298 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c5bd6-7386-41db-a7ff-3a896396a3c8 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:01.792990 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-fc2c5bd6-7386-41db-a7ff-3a896396a3c8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:01.794708 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 299/590] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:01.801591 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d880815-a6a7-4101-a9b2-c1f1d3ec8ffd None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:01.815974 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d880815-a6a7-4101-a9b2-c1f1d3ec8ffd None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:01.831466 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b9e65-ef97-4b8d-932d-31292d3087bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:01.832172 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b9e65-ef97-4b8d-932d-31292d3087bb admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:01.832456 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b9e65-ef97-4b8d-932d-31292d3087bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:01.832735 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b9e65-ef97-4b8d-932d-31292d3087bb admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:01.833493 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b9e65-ef97-4b8d-932d-31292d3087bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:01.833799 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b9e65-ef97-4b8d-932d-31292d3087bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:01.835447 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b9e65-ef97-4b8d-932d-31292d3087bb admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:01.854215 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 292/591] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:01.860018 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c5bd6-7386-41db-a7ff-3a896396a3c8 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:01.872931 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c5bd6-7386-41db-a7ff-3a896396a3c8 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:01.877821 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3590384-6e03-4e49-a9a4-5c9c5720b177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:01.878810 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3590384-6e03-4e49-a9a4-5c9c5720b177 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:01.879283 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3590384-6e03-4e49-a9a4-5c9c5720b177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:01.879788 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3590384-6e03-4e49-a9a4-5c9c5720b177 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:01.880698 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3590384-6e03-4e49-a9a4-5c9c5720b177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:01.882857 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3590384-6e03-4e49-a9a4-5c9c5720b177 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:01.932356 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 300/592] 10.222.0.79 () {60 vars in 1153 bytes} [Thu Oct 28 14:25:01 2021] POST /identity/v3/users => generated 254 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:25:02.175471 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a1cce-14d6-4150-94c4-0d51708eca3e None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:02.175870 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a1cce-14d6-4150-94c4-0d51708eca3e None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:02.176039 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a1cce-14d6-4150-94c4-0d51708eca3e None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:02.178530 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 293/593] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:02.185274 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded1f19-f234-49ff-bd83-bcec58b7d404 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:02.185553 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded1f19-f234-49ff-bd83-bcec58b7d404 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:02.185842 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded1f19-f234-49ff-bd83-bcec58b7d404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:02.215968 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-aded1f19-f234-49ff-bd83-bcec58b7d404 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:02.217202 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-aded1f19-f234-49ff-bd83-bcec58b7d404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:02.225443 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 301/594] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:02.273349 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a1cce-14d6-4150-94c4-0d51708eca3e None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:02.287700 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a1cce-14d6-4150-94c4-0d51708eca3e None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:02.293089 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede2463-e890-4b55-8b7a-cad33dd3efb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:02.293946 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede2463-e890-4b55-8b7a-cad33dd3efb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:02.294221 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede2463-e890-4b55-8b7a-cad33dd3efb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:02.294490 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede2463-e890-4b55-8b7a-cad33dd3efb1 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:02.295280 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede2463-e890-4b55-8b7a-cad33dd3efb1 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:02.296350 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING py.warnings [None req-0ede2463-e890-4b55-8b7a-cad33dd3efb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:25:02.296350 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: warnings.warn(msg) Oct 28 14:25:02.296350 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: Oct 28 14:25:02.297275 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede2463-e890-4b55-8b7a-cad33dd3efb1 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:02.314227 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-0ede2463-e890-4b55-8b7a-cad33dd3efb1 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 14:25:02.315904 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 294/595] 10.222.0.79 () {56 vars in 1150 bytes} [Thu Oct 28 14:25:02 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:02.322365 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded1f19-f234-49ff-bd83-bcec58b7d404 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:02.334136 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded1f19-f234-49ff-bd83-bcec58b7d404 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:02.342975 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3e8a1-01b9-4758-b87a-e3a3797efff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:02.343714 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3e8a1-01b9-4758-b87a-e3a3797efff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:02.343992 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3e8a1-01b9-4758-b87a-e3a3797efff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:02.344265 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3e8a1-01b9-4758-b87a-e3a3797efff9 admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:02.344992 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3e8a1-01b9-4758-b87a-e3a3797efff9 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:02.345290 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3e8a1-01b9-4758-b87a-e3a3797efff9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:02.346395 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING py.warnings [None req-a2f3e8a1-01b9-4758-b87a-e3a3797efff9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:25:02.346395 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: warnings.warn(msg) Oct 28 14:25:02.346395 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: Oct 28 14:25:02.347301 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3e8a1-01b9-4758-b87a-e3a3797efff9 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:02.354264 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 302/596] 10.222.0.79 () {56 vars in 1145 bytes} [Thu Oct 28 14:25:02 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:02.358595 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede2463-e890-4b55-8b7a-cad33dd3efb1 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:02.373526 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede2463-e890-4b55-8b7a-cad33dd3efb1 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:02.382571 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96120611-20ae-4fd9-8218-b45416a8730b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:02.383452 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96120611-20ae-4fd9-8218-b45416a8730b admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:02.383725 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96120611-20ae-4fd9-8218-b45416a8730b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:02.383997 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96120611-20ae-4fd9-8218-b45416a8730b admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:02.384724 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96120611-20ae-4fd9-8218-b45416a8730b admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:02.385029 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96120611-20ae-4fd9-8218-b45416a8730b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:02.386042 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING py.warnings [None req-96120611-20ae-4fd9-8218-b45416a8730b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:25:02.386042 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: warnings.warn(msg) Oct 28 14:25:02.386042 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: Oct 28 14:25:02.386938 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96120611-20ae-4fd9-8218-b45416a8730b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:02.393389 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 295/597] 10.222.0.79 () {56 vars in 1145 bytes} [Thu Oct 28 14:25:02 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:02.467250 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf2548-4234-4f0b-a51a-73669b98ebc9 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:02.467751 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf2548-4234-4f0b-a51a-73669b98ebc9 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:02.468163 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf2548-4234-4f0b-a51a-73669b98ebc9 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:02.470489 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 303/598] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:02.478207 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269bde1-8050-43f3-972f-ef4b79b6d0eb None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:02.478595 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269bde1-8050-43f3-972f-ef4b79b6d0eb None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:02.478982 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269bde1-8050-43f3-972f-ef4b79b6d0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:02.503223 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-5269bde1-8050-43f3-972f-ef4b79b6d0eb None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:02.504621 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-5269bde1-8050-43f3-972f-ef4b79b6d0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:02.517284 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 296/599] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:02.541397 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf2548-4234-4f0b-a51a-73669b98ebc9 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:02.554631 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf2548-4234-4f0b-a51a-73669b98ebc9 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:02.560579 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42dbab-afcc-46b9-8e87-79d9e6524594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:02.561621 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42dbab-afcc-46b9-8e87-79d9e6524594 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:02.562069 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42dbab-afcc-46b9-8e87-79d9e6524594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:02.562479 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42dbab-afcc-46b9-8e87-79d9e6524594 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:02.563332 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f42dbab-afcc-46b9-8e87-79d9e6524594 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:02.564513 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING py.warnings [None req-1f42dbab-afcc-46b9-8e87-79d9e6524594 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:25:02.564513 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: warnings.warn(msg) Oct 28 14:25:02.564513 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: Oct 28 14:25:02.565700 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f42dbab-afcc-46b9-8e87-79d9e6524594 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:02.581100 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-1f42dbab-afcc-46b9-8e87-79d9e6524594 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 14:25:02.583075 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 304/600] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:25:02 2021] GET /identity/v3/services/network => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:02.589554 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269bde1-8050-43f3-972f-ef4b79b6d0eb None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:02.604350 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269bde1-8050-43f3-972f-ef4b79b6d0eb None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:02.615085 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbf1a9-8969-4db2-98d8-52be4a7718e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:02.615779 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbf1a9-8969-4db2-98d8-52be4a7718e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:02.616058 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbf1a9-8969-4db2-98d8-52be4a7718e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:02.616358 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbf1a9-8969-4db2-98d8-52be4a7718e1 admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:02.617074 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbbf1a9-8969-4db2-98d8-52be4a7718e1 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:02.617549 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbbf1a9-8969-4db2-98d8-52be4a7718e1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:02.619244 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbbf1a9-8969-4db2-98d8-52be4a7718e1 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:02.626626 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 297/601] 10.222.0.79 () {56 vars in 1133 bytes} [Thu Oct 28 14:25:02 2021] GET /identity/v3/services?name=network => generated 124 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:02.633209 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42dbab-afcc-46b9-8e87-79d9e6524594 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:02.646275 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42dbab-afcc-46b9-8e87-79d9e6524594 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:02.651832 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cfa5b-bd20-4721-b1ed-dd4dce1a0962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:02.652678 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cfa5b-bd20-4721-b1ed-dd4dce1a0962 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:02.653131 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cfa5b-bd20-4721-b1ed-dd4dce1a0962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:02.653535 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cfa5b-bd20-4721-b1ed-dd4dce1a0962 admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:02.654393 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cfa5b-bd20-4721-b1ed-dd4dce1a0962 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:02.654887 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cfa5b-bd20-4721-b1ed-dd4dce1a0962 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:02.656773 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cfa5b-bd20-4721-b1ed-dd4dce1a0962 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:02.663669 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 305/602] 10.222.0.79 () {56 vars in 1133 bytes} [Thu Oct 28 14:25:02 2021] GET /identity/v3/services?type=network => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:02.868099 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242c459-34f3-49b2-b072-207431cba609 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:02.868603 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242c459-34f3-49b2-b072-207431cba609 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:02.868603 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242c459-34f3-49b2-b072-207431cba609 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:02.870758 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 298/603] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:02.876861 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa5e99-4780-4984-ae18-da81c7fe0315 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:02.877311 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa5e99-4780-4984-ae18-da81c7fe0315 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:02.877384 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa5e99-4780-4984-ae18-da81c7fe0315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:02.895938 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-38fa5e99-4780-4984-ae18-da81c7fe0315 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:02.897147 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-38fa5e99-4780-4984-ae18-da81c7fe0315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:02.905256 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 306/604] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:02.930416 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242c459-34f3-49b2-b072-207431cba609 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:02.948948 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242c459-34f3-49b2-b072-207431cba609 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:02.958790 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b862fd1-3886-42ce-8be7-4d2927e4ee5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:02.959616 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b862fd1-3886-42ce-8be7-4d2927e4ee5e admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:02.959896 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b862fd1-3886-42ce-8be7-4d2927e4ee5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:02.960216 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b862fd1-3886-42ce-8be7-4d2927e4ee5e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:02.974947 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b862fd1-3886-42ce-8be7-4d2927e4ee5e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:25:02.982388 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-5b862fd1-3886-42ce-8be7-4d2927e4ee5e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 14:25:02.984209 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 299/605] 10.222.0.79 () {56 vars in 1123 bytes} [Thu Oct 28 14:25:02 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:02.990527 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa5e99-4780-4984-ae18-da81c7fe0315 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:03.001056 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa5e99-4780-4984-ae18-da81c7fe0315 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:03.005475 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13ff68-6079-482d-9adb-b50b3c275a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:03.006137 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13ff68-6079-482d-9adb-b50b3c275a92 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:03.006410 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13ff68-6079-482d-9adb-b50b3c275a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:03.006691 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13ff68-6079-482d-9adb-b50b3c275a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:03.007453 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13ff68-6079-482d-9adb-b50b3c275a92 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:03.007753 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13ff68-6079-482d-9adb-b50b3c275a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:03.009700 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13ff68-6079-482d-9adb-b50b3c275a92 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:03.022770 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 307/606] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Oct 28 14:25:02 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:03.025965 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b862fd1-3886-42ce-8be7-4d2927e4ee5e admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:03.036044 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b862fd1-3886-42ce-8be7-4d2927e4ee5e admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:03.042355 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54aea0b-80e6-489a-b83c-36c8e0dee8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:03.043444 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54aea0b-80e6-489a-b83c-36c8e0dee8dc admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:03.043964 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54aea0b-80e6-489a-b83c-36c8e0dee8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:03.044429 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54aea0b-80e6-489a-b83c-36c8e0dee8dc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:03.056583 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54aea0b-80e6-489a-b83c-36c8e0dee8dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:03.058811 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54aea0b-80e6-489a-b83c-36c8e0dee8dc admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:03.078178 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-a54aea0b-80e6-489a-b83c-36c8e0dee8dc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:03.080214 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 300/607] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:03.086384 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13ff68-6079-482d-9adb-b50b3c275a92 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:03.100631 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13ff68-6079-482d-9adb-b50b3c275a92 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:03.108286 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfc620-1c23-445e-b4e6-0fa43b9de641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:03.109297 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfc620-1c23-445e-b4e6-0fa43b9de641 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:03.109782 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfc620-1c23-445e-b4e6-0fa43b9de641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:03.110299 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfc620-1c23-445e-b4e6-0fa43b9de641 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:03.111351 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfc620-1c23-445e-b4e6-0fa43b9de641 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:03.111866 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfc620-1c23-445e-b4e6-0fa43b9de641 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:03.113768 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfc620-1c23-445e-b4e6-0fa43b9de641 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:03.127774 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 308/608] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:03.133791 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54aea0b-80e6-489a-b83c-36c8e0dee8dc admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:03.143600 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54aea0b-80e6-489a-b83c-36c8e0dee8dc admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:03.154880 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b17c17-64e4-47fe-9daf-af5be8ca384a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:03.155683 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b17c17-64e4-47fe-9daf-af5be8ca384a admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:03.155959 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b17c17-64e4-47fe-9daf-af5be8ca384a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:03.156227 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b17c17-64e4-47fe-9daf-af5be8ca384a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:03.166090 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b17c17-64e4-47fe-9daf-af5be8ca384a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:03.168158 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b17c17-64e4-47fe-9daf-af5be8ca384a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:03.188725 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-93b17c17-64e4-47fe-9daf-af5be8ca384a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 14:25:03.190162 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 301/609] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:25:03 2021] GET /identity/v3/users/swift => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:03.196796 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfc620-1c23-445e-b4e6-0fa43b9de641 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:03.212589 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfc620-1c23-445e-b4e6-0fa43b9de641 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:03.217605 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091b3f7-1cb5-4455-982e-d4457ac1f654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:03.218590 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091b3f7-1cb5-4455-982e-d4457ac1f654 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:03.219181 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091b3f7-1cb5-4455-982e-d4457ac1f654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:03.219648 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091b3f7-1cb5-4455-982e-d4457ac1f654 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:03.220738 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091b3f7-1cb5-4455-982e-d4457ac1f654 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:03.221266 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091b3f7-1cb5-4455-982e-d4457ac1f654 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:03.223426 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091b3f7-1cb5-4455-982e-d4457ac1f654 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:03.254328 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 309/610] 10.222.0.79 () {56 vars in 1156 bytes} [Thu Oct 28 14:25:03 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:03.261312 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b17c17-64e4-47fe-9daf-af5be8ca384a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:03.278459 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b17c17-64e4-47fe-9daf-af5be8ca384a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:03.292140 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66bb08b-64f4-4cca-93b5-dcb3c133443e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:03.292811 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bb08b-64f4-4cca-93b5-dcb3c133443e admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:03.293090 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bb08b-64f4-4cca-93b5-dcb3c133443e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:03.293362 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bb08b-64f4-4cca-93b5-dcb3c133443e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:03.307145 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66bb08b-64f4-4cca-93b5-dcb3c133443e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:03.308915 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66bb08b-64f4-4cca-93b5-dcb3c133443e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:03.318320 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 302/611] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:25:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:25:03.325248 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091b3f7-1cb5-4455-982e-d4457ac1f654 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:03.341401 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091b3f7-1cb5-4455-982e-d4457ac1f654 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:03.346653 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f9c58-8449-49fc-82f8-886197eb8736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:03.347717 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f9c58-8449-49fc-82f8-886197eb8736 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:03.348138 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f9c58-8449-49fc-82f8-886197eb8736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:03.348594 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f9c58-8449-49fc-82f8-886197eb8736 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:03.366993 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f9c58-8449-49fc-82f8-886197eb8736 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:03.369289 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f9c58-8449-49fc-82f8-886197eb8736 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:03.392638 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-b05f9c58-8449-49fc-82f8-886197eb8736 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:03.401453 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66bb08b-64f4-4cca-93b5-dcb3c133443e admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:03.402058 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 310/612] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:03.414879 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66bb08b-64f4-4cca-93b5-dcb3c133443e admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:03.419738 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbcc18-b48e-47ad-a9e6-0c4e77238608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:03.420610 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbcc18-b48e-47ad-a9e6-0c4e77238608 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:03.421027 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbcc18-b48e-47ad-a9e6-0c4e77238608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:03.421437 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbcc18-b48e-47ad-a9e6-0c4e77238608 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:03.422312 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbcc18-b48e-47ad-a9e6-0c4e77238608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:03.422828 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbcc18-b48e-47ad-a9e6-0c4e77238608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:03.424621 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbcc18-b48e-47ad-a9e6-0c4e77238608 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:03.442802 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 303/613] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:25:03.449066 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f9c58-8449-49fc-82f8-886197eb8736 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:03.459239 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f9c58-8449-49fc-82f8-886197eb8736 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:03.463694 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad305ca-a36c-4f8b-ab92-20f01fa1df12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:03.464473 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad305ca-a36c-4f8b-ab92-20f01fa1df12 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:03.464746 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad305ca-a36c-4f8b-ab92-20f01fa1df12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:03.465008 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad305ca-a36c-4f8b-ab92-20f01fa1df12 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:03.479798 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad305ca-a36c-4f8b-ab92-20f01fa1df12 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:03.481753 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad305ca-a36c-4f8b-ab92-20f01fa1df12 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:03.505857 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-8ad305ca-a36c-4f8b-ab92-20f01fa1df12 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:25:03.507367 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 311/614] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:25:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:03.514029 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbcc18-b48e-47ad-a9e6-0c4e77238608 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:03.527666 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbcc18-b48e-47ad-a9e6-0c4e77238608 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:03.534069 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2e44f-1949-4caf-adb0-d3a0a879ce6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:03.534977 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2e44f-1949-4caf-adb0-d3a0a879ce6e admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:03.535395 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2e44f-1949-4caf-adb0-d3a0a879ce6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:03.535847 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2e44f-1949-4caf-adb0-d3a0a879ce6e admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:03.536805 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2e44f-1949-4caf-adb0-d3a0a879ce6e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:03.537289 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2e44f-1949-4caf-adb0-d3a0a879ce6e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:03.539497 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2e44f-1949-4caf-adb0-d3a0a879ce6e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:03.559749 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 304/615] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:25:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:03.566321 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad305ca-a36c-4f8b-ab92-20f01fa1df12 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:03.585074 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad305ca-a36c-4f8b-ab92-20f01fa1df12 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:03.594617 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e81712-7a5d-4707-9124-07e2310e8258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:03.595285 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e81712-7a5d-4707-9124-07e2310e8258 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:03.595561 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e81712-7a5d-4707-9124-07e2310e8258 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:03.595825 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e81712-7a5d-4707-9124-07e2310e8258 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:03.596663 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e81712-7a5d-4707-9124-07e2310e8258 admin admin] RBAC: Adding query filter params (role.id=1ee8b426ca9a49e5b7fb33be19e8a616, scope.project.id=b433200db4784bfeadca48d24212e823, user.id=889e7be1dcaf47f599af9c9b7ad33042) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:03.596968 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e81712-7a5d-4707-9124-07e2310e8258 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:03.598814 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e81712-7a5d-4707-9124-07e2310e8258 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:03.608491 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 312/616] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:25:03 2021] GET /identity/v3/role_assignments?user.id=889e7be1dcaf47f599af9c9b7ad33042&scope.project.id=b433200db4784bfeadca48d24212e823&role.id=1ee8b426ca9a49e5b7fb33be19e8a616 => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:04.421810 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c3fb3-815b-49ca-b2c2-16aff547c9ba None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:04.422354 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c3fb3-815b-49ca-b2c2-16aff547c9ba None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:04.422354 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c3fb3-815b-49ca-b2c2-16aff547c9ba None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:04.424436 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 305/617] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:04.431243 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a67133-cece-45be-b8a8-5d9f3f11f25b None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:04.431663 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a67133-cece-45be-b8a8-5d9f3f11f25b None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:04.431776 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a67133-cece-45be-b8a8-5d9f3f11f25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:04.449112 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-20a67133-cece-45be-b8a8-5d9f3f11f25b None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:04.450287 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-20a67133-cece-45be-b8a8-5d9f3f11f25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:04.458104 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 313/618] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:04.481329 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c3fb3-815b-49ca-b2c2-16aff547c9ba None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:04.493595 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c3fb3-815b-49ca-b2c2-16aff547c9ba None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:04.497871 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb079e31-8ee4-4196-99a6-4efb3b669579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:04.498653 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb079e31-8ee4-4196-99a6-4efb3b669579 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:04.498953 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb079e31-8ee4-4196-99a6-4efb3b669579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:04.499219 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb079e31-8ee4-4196-99a6-4efb3b669579 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:04.509534 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb079e31-8ee4-4196-99a6-4efb3b669579 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:25:04.516198 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-eb079e31-8ee4-4196-99a6-4efb3b669579 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:25:04.517682 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 306/619] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:25:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:04.524045 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a67133-cece-45be-b8a8-5d9f3f11f25b None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:04.533050 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a67133-cece-45be-b8a8-5d9f3f11f25b None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:04.537454 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f623b-5442-41a0-ad74-01d396145384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:04.538120 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f623b-5442-41a0-ad74-01d396145384 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:04.538393 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f623b-5442-41a0-ad74-01d396145384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:04.538662 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f623b-5442-41a0-ad74-01d396145384 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:04.539714 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f623b-5442-41a0-ad74-01d396145384 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:04.540240 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f623b-5442-41a0-ad74-01d396145384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:04.542543 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f623b-5442-41a0-ad74-01d396145384 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:04.552156 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 314/620] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:25:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:04.558410 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb079e31-8ee4-4196-99a6-4efb3b669579 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:04.568744 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb079e31-8ee4-4196-99a6-4efb3b669579 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:04.573258 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd4dcb-cab9-4379-bd37-c36e463a0bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:04.574048 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd4dcb-cab9-4379-bd37-c36e463a0bdf admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:04.574313 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd4dcb-cab9-4379-bd37-c36e463a0bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:04.574576 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd4dcb-cab9-4379-bd37-c36e463a0bdf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:04.584964 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd4dcb-cab9-4379-bd37-c36e463a0bdf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:04.586976 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd4dcb-cab9-4379-bd37-c36e463a0bdf admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:04.603709 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-52cd4dcb-cab9-4379-bd37-c36e463a0bdf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:04.605260 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 307/621] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:04.611396 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f623b-5442-41a0-ad74-01d396145384 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:04.621346 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f623b-5442-41a0-ad74-01d396145384 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:04.629939 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0e035-3b30-432f-b05b-c4266ef5dbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:04.630608 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0e035-3b30-432f-b05b-c4266ef5dbc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:04.630914 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0e035-3b30-432f-b05b-c4266ef5dbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:04.631181 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0e035-3b30-432f-b05b-c4266ef5dbc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:04.631973 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0e035-3b30-432f-b05b-c4266ef5dbc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:04.632269 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0e035-3b30-432f-b05b-c4266ef5dbc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:04.634051 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0e035-3b30-432f-b05b-c4266ef5dbc5 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:04.651262 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 315/622] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:04.657089 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd4dcb-cab9-4379-bd37-c36e463a0bdf admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:04.669356 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd4dcb-cab9-4379-bd37-c36e463a0bdf admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:04.674514 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f293c58-7f1d-4044-be81-3920b9a44130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:04.675283 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f293c58-7f1d-4044-be81-3920b9a44130 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:04.675603 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f293c58-7f1d-4044-be81-3920b9a44130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:04.675874 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f293c58-7f1d-4044-be81-3920b9a44130 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:04.687112 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f293c58-7f1d-4044-be81-3920b9a44130 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:04.689149 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f293c58-7f1d-4044-be81-3920b9a44130 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:04.708024 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-9f293c58-7f1d-4044-be81-3920b9a44130 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 14:25:04.709437 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 308/623] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Oct 28 14:25:04 2021] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:25:04.715514 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0e035-3b30-432f-b05b-c4266ef5dbc5 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:04.727417 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0e035-3b30-432f-b05b-c4266ef5dbc5 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:04.731983 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99246f3-5338-447e-bbff-9db02718081f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:04.732696 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99246f3-5338-447e-bbff-9db02718081f admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:04.732969 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99246f3-5338-447e-bbff-9db02718081f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:04.733238 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99246f3-5338-447e-bbff-9db02718081f admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:04.734232 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99246f3-5338-447e-bbff-9db02718081f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:04.734533 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99246f3-5338-447e-bbff-9db02718081f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:04.736436 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99246f3-5338-447e-bbff-9db02718081f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:04.754475 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 316/624] 10.222.0.79 () {56 vars in 1154 bytes} [Thu Oct 28 14:25:04 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:04.760636 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f293c58-7f1d-4044-be81-3920b9a44130 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:04.773066 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f293c58-7f1d-4044-be81-3920b9a44130 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:04.780624 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14065512-e13a-4b61-bb8e-dae1c11766ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:04.781500 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14065512-e13a-4b61-bb8e-dae1c11766ad admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:04.781773 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14065512-e13a-4b61-bb8e-dae1c11766ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:04.782040 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14065512-e13a-4b61-bb8e-dae1c11766ad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:04.797724 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14065512-e13a-4b61-bb8e-dae1c11766ad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:04.799647 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14065512-e13a-4b61-bb8e-dae1c11766ad admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:04.822059 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-14065512-e13a-4b61-bb8e-dae1c11766ad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:04.823652 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 309/625] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:04.829840 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99246f3-5338-447e-bbff-9db02718081f admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:04.840047 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99246f3-5338-447e-bbff-9db02718081f admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:04.844586 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05041e7d-6854-48d1-90ce-b7c689b3dc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:04.845286 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05041e7d-6854-48d1-90ce-b7c689b3dc4f admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:04.845558 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05041e7d-6854-48d1-90ce-b7c689b3dc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:04.845870 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05041e7d-6854-48d1-90ce-b7c689b3dc4f admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:04.846611 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05041e7d-6854-48d1-90ce-b7c689b3dc4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:04.846987 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05041e7d-6854-48d1-90ce-b7c689b3dc4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:04.848617 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05041e7d-6854-48d1-90ce-b7c689b3dc4f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:04.861000 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 317/626] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:04.867072 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14065512-e13a-4b61-bb8e-dae1c11766ad admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:04.877251 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14065512-e13a-4b61-bb8e-dae1c11766ad admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:04.881853 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aae4ea-03a3-4bb0-bafa-b204235915d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:04.882702 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aae4ea-03a3-4bb0-bafa-b204235915d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:04.883017 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aae4ea-03a3-4bb0-bafa-b204235915d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:04.883333 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aae4ea-03a3-4bb0-bafa-b204235915d7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:04.890574 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aae4ea-03a3-4bb0-bafa-b204235915d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:04.892669 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aae4ea-03a3-4bb0-bafa-b204235915d7 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:04.914258 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-08aae4ea-03a3-4bb0-bafa-b204235915d7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:25:04.915818 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 310/627] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:25:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:04.922056 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05041e7d-6854-48d1-90ce-b7c689b3dc4f admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:04.937374 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05041e7d-6854-48d1-90ce-b7c689b3dc4f admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:04.943928 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b156876-0c6b-4f74-a1f5-a7d031dbcbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:04.944604 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b156876-0c6b-4f74-a1f5-a7d031dbcbad admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:04.944881 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b156876-0c6b-4f74-a1f5-a7d031dbcbad admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:04.945152 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b156876-0c6b-4f74-a1f5-a7d031dbcbad admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:04.945998 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b156876-0c6b-4f74-a1f5-a7d031dbcbad admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:04.946303 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b156876-0c6b-4f74-a1f5-a7d031dbcbad admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:04.948170 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b156876-0c6b-4f74-a1f5-a7d031dbcbad admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:04.966366 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 318/628] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:25:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:04.972523 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aae4ea-03a3-4bb0-bafa-b204235915d7 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:04.987868 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aae4ea-03a3-4bb0-bafa-b204235915d7 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:04.998814 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282d880-bfdb-4c1a-93cc-3a865b073e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:04.999712 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282d880-bfdb-4c1a-93cc-3a865b073e8c admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:04.999981 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282d880-bfdb-4c1a-93cc-3a865b073e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:05.000254 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282d880-bfdb-4c1a-93cc-3a865b073e8c admin admin] PATH_INFO: `/v3/projects/b433200db4784bfeadca48d24212e823/users/18cd6636ae7847c78be910824410d295/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:05.008057 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282d880-bfdb-4c1a-93cc-3a865b073e8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b433200db4784bfeadca48d24212e823, user_id=18cd6636ae7847c78be910824410d295, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:05.010718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282d880-bfdb-4c1a-93cc-3a865b073e8c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:05.023120 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f2d28-559b-49e1-bb72-abae7911bdfa None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:05.023788 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f2d28-559b-49e1-bb72-abae7911bdfa None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:05.024354 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f2d28-559b-49e1-bb72-abae7911bdfa None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:05.026746 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 319/629] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 14:25:05.031481 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 311/630] 10.222.0.79 () {58 vars in 1460 bytes} [Thu Oct 28 14:25:04 2021] PUT /identity/v3/projects/b433200db4784bfeadca48d24212e823/users/18cd6636ae7847c78be910824410d295/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:25:05.045526 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1409f97-96e7-4235-ad5e-096a5ccec6db None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:05.046176 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1409f97-96e7-4235-ad5e-096a5ccec6db None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:05.046643 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1409f97-96e7-4235-ad5e-096a5ccec6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:05.073175 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-d1409f97-96e7-4235-ad5e-096a5ccec6db None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:05.074790 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-d1409f97-96e7-4235-ad5e-096a5ccec6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:05.164585 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 320/631] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:05.203421 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282d880-bfdb-4c1a-93cc-3a865b073e8c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:05.216623 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282d880-bfdb-4c1a-93cc-3a865b073e8c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:05.222507 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f805dba-fd43-4aeb-a30a-6cc22d74189c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:05.223466 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f805dba-fd43-4aeb-a30a-6cc22d74189c admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:05.223788 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f805dba-fd43-4aeb-a30a-6cc22d74189c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:05.224104 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f805dba-fd43-4aeb-a30a-6cc22d74189c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:05.237658 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f805dba-fd43-4aeb-a30a-6cc22d74189c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:25:05.245048 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-6f805dba-fd43-4aeb-a30a-6cc22d74189c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 14:25:05.246710 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 312/632] 10.222.0.79 () {56 vars in 1123 bytes} [Thu Oct 28 14:25:05 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:05.253557 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1409f97-96e7-4235-ad5e-096a5ccec6db None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:05.263381 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1409f97-96e7-4235-ad5e-096a5ccec6db None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:05.268085 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c60e1c-4efb-48a0-9f6c-e66a78ff9cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:05.268773 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c60e1c-4efb-48a0-9f6c-e66a78ff9cfd admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:05.269050 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c60e1c-4efb-48a0-9f6c-e66a78ff9cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:05.269316 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c60e1c-4efb-48a0-9f6c-e66a78ff9cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:05.270103 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c60e1c-4efb-48a0-9f6c-e66a78ff9cfd admin admin] RBAC: Adding query filter params (name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:05.270402 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c60e1c-4efb-48a0-9f6c-e66a78ff9cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:05.272059 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c60e1c-4efb-48a0-9f6c-e66a78ff9cfd admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:05.285676 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 321/633] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Oct 28 14:25:05 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:05.291938 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f805dba-fd43-4aeb-a30a-6cc22d74189c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:05.302843 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f805dba-fd43-4aeb-a30a-6cc22d74189c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:05.308741 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1f53a-5d8c-4551-98cd-921cd387de41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:05.309888 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1f53a-5d8c-4551-98cd-921cd387de41 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:05.311539 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a6e01-63c0-4432-bdfe-6a518d6c7912 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:05.311860 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a6e01-63c0-4432-bdfe-6a518d6c7912 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:05.312129 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a6e01-63c0-4432-bdfe-6a518d6c7912 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:05.313442 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1f53a-5d8c-4551-98cd-921cd387de41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:05.313961 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1f53a-5d8c-4551-98cd-921cd387de41 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:05.314285 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 322/634] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 14:25:05.321888 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd7ebb-3615-45fb-8e20-eebbc30e07cd None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:05.322336 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd7ebb-3615-45fb-8e20-eebbc30e07cd None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:05.322805 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd7ebb-3615-45fb-8e20-eebbc30e07cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:05.327504 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1f53a-5d8c-4551-98cd-921cd387de41 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:05.329560 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1f53a-5d8c-4551-98cd-921cd387de41 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:05.345235 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-12fd7ebb-3615-45fb-8e20-eebbc30e07cd None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:05.346612 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-12fd7ebb-3615-45fb-8e20-eebbc30e07cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:05.348368 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-eaa1f53a-5d8c-4551-98cd-921cd387de41 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:05.349916 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 313/635] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:05.360251 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1f53a-5d8c-4551-98cd-921cd387de41 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:05.361281 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 323/636] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:25:05.372400 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1f53a-5d8c-4551-98cd-921cd387de41 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:05.377645 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb25368-1fc9-47c1-9927-1dc3bca390f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:05.378616 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb25368-1fc9-47c1-9927-1dc3bca390f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:05.379129 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb25368-1fc9-47c1-9927-1dc3bca390f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:05.379673 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb25368-1fc9-47c1-9927-1dc3bca390f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:05.380636 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb25368-1fc9-47c1-9927-1dc3bca390f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:05.381221 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb25368-1fc9-47c1-9927-1dc3bca390f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:05.383305 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb25368-1fc9-47c1-9927-1dc3bca390f8 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:05.386916 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd7ebb-3615-45fb-8e20-eebbc30e07cd None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:05.397787 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd7ebb-3615-45fb-8e20-eebbc30e07cd None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:05.399207 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 314/637] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:05.406989 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb25368-1fc9-47c1-9927-1dc3bca390f8 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:05.407961 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44908559-d67c-41d2-9bef-b59a6d642cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:05.408639 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44908559-d67c-41d2-9bef-b59a6d642cea admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:05.408911 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44908559-d67c-41d2-9bef-b59a6d642cea admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:05.409178 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44908559-d67c-41d2-9bef-b59a6d642cea admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:05.409930 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44908559-d67c-41d2-9bef-b59a6d642cea admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:05.410966 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING py.warnings [None req-44908559-d67c-41d2-9bef-b59a6d642cea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:25:05.410966 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: warnings.warn(msg) Oct 28 14:25:05.410966 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: Oct 28 14:25:05.411895 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44908559-d67c-41d2-9bef-b59a6d642cea admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:05.420539 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb25368-1fc9-47c1-9927-1dc3bca390f8 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:05.426544 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44453e-68cd-4f5e-a6b7-e4a39a9dd74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:05.427556 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44453e-68cd-4f5e-a6b7-e4a39a9dd74c admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:05.428045 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44453e-68cd-4f5e-a6b7-e4a39a9dd74c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:05.428397 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44453e-68cd-4f5e-a6b7-e4a39a9dd74c admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:05.436403 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 324/638] 10.222.0.79 () {60 vars in 1162 bytes} [Thu Oct 28 14:25:05 2021] POST /identity/v3/services => generated 251 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:25:05.440185 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44453e-68cd-4f5e-a6b7-e4a39a9dd74c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:05.442859 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44453e-68cd-4f5e-a6b7-e4a39a9dd74c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:05.460297 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-ab44453e-68cd-4f5e-a6b7-e4a39a9dd74c admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 14:25:05.462537 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 315/639] 10.222.0.79 () {56 vars in 1138 bytes} [Thu Oct 28 14:25:05 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:05.469927 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44908559-d67c-41d2-9bef-b59a6d642cea admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:05.502475 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44908559-d67c-41d2-9bef-b59a6d642cea admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:05.507901 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ec813-c577-4816-bdef-2c90e3378492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:05.508832 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ec813-c577-4816-bdef-2c90e3378492 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:05.509303 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ec813-c577-4816-bdef-2c90e3378492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:05.509935 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ec813-c577-4816-bdef-2c90e3378492 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:05.511076 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ec813-c577-4816-bdef-2c90e3378492 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:05.511574 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ec813-c577-4816-bdef-2c90e3378492 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:05.513654 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ec813-c577-4816-bdef-2c90e3378492 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:05.533969 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 325/640] 10.222.0.79 () {56 vars in 1170 bytes} [Thu Oct 28 14:25:05 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:05.540913 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44453e-68cd-4f5e-a6b7-e4a39a9dd74c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:05.552625 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44453e-68cd-4f5e-a6b7-e4a39a9dd74c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:05.558278 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af39d3-e050-4a56-842e-568737c403f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:05.559405 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af39d3-e050-4a56-842e-568737c403f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:05.559891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af39d3-e050-4a56-842e-568737c403f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:05.560385 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af39d3-e050-4a56-842e-568737c403f0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:05.570891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af39d3-e050-4a56-842e-568737c403f0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:05.573140 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af39d3-e050-4a56-842e-568737c403f0 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:05.583713 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 316/641] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:25:05 2021] GET /identity/v3/auth/tokens => generated 1171 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:25:05.590789 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ec813-c577-4816-bdef-2c90e3378492 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:05.599339 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfebfb-bd5b-4e7e-8b62-a496f4ee7980 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:05.599669 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfebfb-bd5b-4e7e-8b62-a496f4ee7980 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:05.599886 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfebfb-bd5b-4e7e-8b62-a496f4ee7980 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:05.601949 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 317/642] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 14:25:05.602855 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ec813-c577-4816-bdef-2c90e3378492 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:05.607841 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394536b-37c7-4144-9247-02eaec871aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:05.608004 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265af90-60a3-4be8-9edc-6bd97e5b1213 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:05.608255 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265af90-60a3-4be8-9edc-6bd97e5b1213 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:05.608535 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265af90-60a3-4be8-9edc-6bd97e5b1213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:05.609475 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394536b-37c7-4144-9247-02eaec871aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:05.610127 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394536b-37c7-4144-9247-02eaec871aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:05.610598 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394536b-37c7-4144-9247-02eaec871aa9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:05.623203 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394536b-37c7-4144-9247-02eaec871aa9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:05.625829 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394536b-37c7-4144-9247-02eaec871aa9 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:05.647115 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-0265af90-60a3-4be8-9edc-6bd97e5b1213 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:05.648936 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-0265af90-60a3-4be8-9edc-6bd97e5b1213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:05.666901 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-a394536b-37c7-4144-9247-02eaec871aa9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:05.667281 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 318/643] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:05 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:25:05.668790 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 326/644] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:05.674899 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265af90-60a3-4be8-9edc-6bd97e5b1213 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:05.685751 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265af90-60a3-4be8-9edc-6bd97e5b1213 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:05.690744 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298447a-944d-485c-893c-c208ec9c793c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:05.691552 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298447a-944d-485c-893c-c208ec9c793c admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:05.691830 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298447a-944d-485c-893c-c208ec9c793c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:05.692097 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298447a-944d-485c-893c-c208ec9c793c admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:05.693010 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298447a-944d-485c-893c-c208ec9c793c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:05.693308 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298447a-944d-485c-893c-c208ec9c793c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:05.695128 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298447a-944d-485c-893c-c208ec9c793c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:05.702299 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394536b-37c7-4144-9247-02eaec871aa9 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:05.717527 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394536b-37c7-4144-9247-02eaec871aa9 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:05.726222 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e00148-0f7c-4035-963a-e2edfdadf875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:05.728064 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e00148-0f7c-4035-963a-e2edfdadf875 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:05.728343 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e00148-0f7c-4035-963a-e2edfdadf875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:05.728612 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e00148-0f7c-4035-963a-e2edfdadf875 admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:05.729142 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 319/645] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:05.729933 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e00148-0f7c-4035-963a-e2edfdadf875 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:05.735926 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e00148-0f7c-4035-963a-e2edfdadf875 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:05.742445 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298447a-944d-485c-893c-c208ec9c793c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:05.758339 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298447a-944d-485c-893c-c208ec9c793c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:05.764257 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 327/646] 10.222.0.79 () {60 vars in 1162 bytes} [Thu Oct 28 14:25:05 2021] POST /identity/v3/services => generated 240 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:25:05.776958 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdeb1d-e5d9-4abc-80a5-9d00a0bf7327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:05.777990 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdeb1d-e5d9-4abc-80a5-9d00a0bf7327 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:05.778270 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdeb1d-e5d9-4abc-80a5-9d00a0bf7327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:05.778585 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdeb1d-e5d9-4abc-80a5-9d00a0bf7327 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:05.786897 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cdeb1d-e5d9-4abc-80a5-9d00a0bf7327 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:05.788872 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cdeb1d-e5d9-4abc-80a5-9d00a0bf7327 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:05.804757 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-e2cdeb1d-e5d9-4abc-80a5-9d00a0bf7327 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:25:05.806580 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 320/647] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:25:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:05.813387 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e00148-0f7c-4035-963a-e2edfdadf875 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:05.825005 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e00148-0f7c-4035-963a-e2edfdadf875 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:05.829710 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593baeab-abfd-479f-90cf-c7bb10ba7f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:05.830398 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593baeab-abfd-479f-90cf-c7bb10ba7f2a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:05.830664 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593baeab-abfd-479f-90cf-c7bb10ba7f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:05.830960 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593baeab-abfd-479f-90cf-c7bb10ba7f2a admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:05.831874 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593baeab-abfd-479f-90cf-c7bb10ba7f2a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:05.832179 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593baeab-abfd-479f-90cf-c7bb10ba7f2a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:05.834178 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593baeab-abfd-479f-90cf-c7bb10ba7f2a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:05.849213 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 328/648] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:25:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:05.856566 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdeb1d-e5d9-4abc-80a5-9d00a0bf7327 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:05.867696 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdeb1d-e5d9-4abc-80a5-9d00a0bf7327 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:05.872493 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33fbab-4235-4dfb-8b91-29bb1004e1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:05.873170 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33fbab-4235-4dfb-8b91-29bb1004e1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:05.873443 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33fbab-4235-4dfb-8b91-29bb1004e1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:05.873764 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33fbab-4235-4dfb-8b91-29bb1004e1a4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:05.874664 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33fbab-4235-4dfb-8b91-29bb1004e1a4 admin admin] RBAC: Adding query filter params (role.id=1ee8b426ca9a49e5b7fb33be19e8a616, scope.project.id=b433200db4784bfeadca48d24212e823, user.id=62cc0165aee14b449c8a49233001f631) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:05.874990 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33fbab-4235-4dfb-8b91-29bb1004e1a4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:05.876927 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33fbab-4235-4dfb-8b91-29bb1004e1a4 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:05.884131 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 321/649] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:25:05 2021] GET /identity/v3/role_assignments?user.id=62cc0165aee14b449c8a49233001f631&scope.project.id=b433200db4784bfeadca48d24212e823&role.id=1ee8b426ca9a49e5b7fb33be19e8a616 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:06.716098 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d892f-ea27-4679-98b6-31afab77e95c None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:06.716823 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d892f-ea27-4679-98b6-31afab77e95c None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:06.716823 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d892f-ea27-4679-98b6-31afab77e95c None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:06.718688 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 329/650] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:06.724322 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e8413-ba7d-4599-9d94-00cd073ee5e3 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:06.724848 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e8413-ba7d-4599-9d94-00cd073ee5e3 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:06.724848 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e8413-ba7d-4599-9d94-00cd073ee5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:06.757712 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-aa2e8413-ba7d-4599-9d94-00cd073ee5e3 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:06.759203 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-aa2e8413-ba7d-4599-9d94-00cd073ee5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:06.767333 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 322/651] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:06 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:25:06.792437 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d892f-ea27-4679-98b6-31afab77e95c None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:06.805253 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d892f-ea27-4679-98b6-31afab77e95c None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:06.809993 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82f142-1008-462d-80f7-bb85ab59926a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:06.811050 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82f142-1008-462d-80f7-bb85ab59926a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:06.811531 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82f142-1008-462d-80f7-bb85ab59926a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:06.812039 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82f142-1008-462d-80f7-bb85ab59926a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:06.823813 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82f142-1008-462d-80f7-bb85ab59926a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:25:06.831028 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-ee82f142-1008-462d-80f7-bb85ab59926a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:25:06.838064 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 330/652] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:25:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:06.839757 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e8413-ba7d-4599-9d94-00cd073ee5e3 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:06.849512 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e8413-ba7d-4599-9d94-00cd073ee5e3 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:06.854571 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0059de-5d5e-4c9c-9520-4e58b4362f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:06.855550 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0059de-5d5e-4c9c-9520-4e58b4362f23 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:06.856052 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0059de-5d5e-4c9c-9520-4e58b4362f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:06.856522 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0059de-5d5e-4c9c-9520-4e58b4362f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:06.857509 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0059de-5d5e-4c9c-9520-4e58b4362f23 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:06.858009 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0059de-5d5e-4c9c-9520-4e58b4362f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:06.859998 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0059de-5d5e-4c9c-9520-4e58b4362f23 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:06.874792 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 323/653] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:25:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:06.876846 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82f142-1008-462d-80f7-bb85ab59926a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:06.892208 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82f142-1008-462d-80f7-bb85ab59926a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:06.907752 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fecbffc-4462-445b-97c3-f6c06337986c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:06.908573 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecbffc-4462-445b-97c3-f6c06337986c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:06.908851 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecbffc-4462-445b-97c3-f6c06337986c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:06.909124 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecbffc-4462-445b-97c3-f6c06337986c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:06.940932 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fecbffc-4462-445b-97c3-f6c06337986c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:06.942839 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fecbffc-4462-445b-97c3-f6c06337986c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:06.970090 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-6fecbffc-4462-445b-97c3-f6c06337986c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:06.971571 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 331/654] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:06.977946 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0059de-5d5e-4c9c-9520-4e58b4362f23 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:06.992395 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0059de-5d5e-4c9c-9520-4e58b4362f23 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:07.003880 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e75bb4-ceb5-4049-925d-11aea8421d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:07.004609 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e75bb4-ceb5-4049-925d-11aea8421d82 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:07.004885 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e75bb4-ceb5-4049-925d-11aea8421d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:07.005210 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e75bb4-ceb5-4049-925d-11aea8421d82 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:07.005957 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e75bb4-ceb5-4049-925d-11aea8421d82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:07.006288 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e75bb4-ceb5-4049-925d-11aea8421d82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:07.007992 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e75bb4-ceb5-4049-925d-11aea8421d82 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:07.025023 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 324/655] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:07.031346 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fecbffc-4462-445b-97c3-f6c06337986c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:07.043575 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fecbffc-4462-445b-97c3-f6c06337986c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:07.050701 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23963968-c712-4f38-8629-6d1cecfd0545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:07.051852 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23963968-c712-4f38-8629-6d1cecfd0545 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:07.052125 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23963968-c712-4f38-8629-6d1cecfd0545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:07.052393 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23963968-c712-4f38-8629-6d1cecfd0545 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:07.071857 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23963968-c712-4f38-8629-6d1cecfd0545 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:07.073883 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23963968-c712-4f38-8629-6d1cecfd0545 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:07.090699 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-23963968-c712-4f38-8629-6d1cecfd0545 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 14:25:07.092211 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 332/656] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:25:07 2021] GET /identity/v3/users/swift => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:07.098547 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e75bb4-ceb5-4049-925d-11aea8421d82 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:07.112121 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e75bb4-ceb5-4049-925d-11aea8421d82 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:07.122751 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a2fde-eb10-4284-bea0-cf1b5c971127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:07.123482 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a2fde-eb10-4284-bea0-cf1b5c971127 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:07.123761 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a2fde-eb10-4284-bea0-cf1b5c971127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:07.124030 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a2fde-eb10-4284-bea0-cf1b5c971127 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:07.124943 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a2fde-eb10-4284-bea0-cf1b5c971127 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:07.125243 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a2fde-eb10-4284-bea0-cf1b5c971127 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:07.127160 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a2fde-eb10-4284-bea0-cf1b5c971127 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:07.158989 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 325/657] 10.222.0.79 () {56 vars in 1156 bytes} [Thu Oct 28 14:25:07 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:07.165685 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23963968-c712-4f38-8629-6d1cecfd0545 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:07.180180 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23963968-c712-4f38-8629-6d1cecfd0545 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:07.195331 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266c684-4c18-420e-a9ea-b1cee776396e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:07.195998 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266c684-4c18-420e-a9ea-b1cee776396e admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:07.196279 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266c684-4c18-420e-a9ea-b1cee776396e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:07.196553 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266c684-4c18-420e-a9ea-b1cee776396e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:07.210296 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266c684-4c18-420e-a9ea-b1cee776396e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:07.212154 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266c684-4c18-420e-a9ea-b1cee776396e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:07.224455 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 333/658] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:25:07 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:25:07.231150 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a2fde-eb10-4284-bea0-cf1b5c971127 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:07.244229 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a2fde-eb10-4284-bea0-cf1b5c971127 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:07.258796 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebe80a-8feb-4bcb-a0bb-e5f6d9a06650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:07.259642 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebe80a-8feb-4bcb-a0bb-e5f6d9a06650 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:07.259920 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebe80a-8feb-4bcb-a0bb-e5f6d9a06650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:07.260187 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebe80a-8feb-4bcb-a0bb-e5f6d9a06650 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:07.271604 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebe80a-8feb-4bcb-a0bb-e5f6d9a06650 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:07.273504 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebe80a-8feb-4bcb-a0bb-e5f6d9a06650 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:07.301735 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-afebe80a-8feb-4bcb-a0bb-e5f6d9a06650 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:07.303004 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 326/659] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:07.309692 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266c684-4c18-420e-a9ea-b1cee776396e admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:07.323822 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266c684-4c18-420e-a9ea-b1cee776396e admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:07.336910 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac47976-bebe-4a79-b32f-093bc1fcb81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:07.337599 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac47976-bebe-4a79-b32f-093bc1fcb81f admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:07.337873 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac47976-bebe-4a79-b32f-093bc1fcb81f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:07.338141 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac47976-bebe-4a79-b32f-093bc1fcb81f admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:07.338910 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac47976-bebe-4a79-b32f-093bc1fcb81f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:07.339216 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac47976-bebe-4a79-b32f-093bc1fcb81f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:07.340826 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac47976-bebe-4a79-b32f-093bc1fcb81f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:07.364990 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 334/660] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:07.372378 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebe80a-8feb-4bcb-a0bb-e5f6d9a06650 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:07.388328 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebe80a-8feb-4bcb-a0bb-e5f6d9a06650 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:07.395288 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9fc89-bae3-4110-9c0d-93dd1a4e86e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:07.396139 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9fc89-bae3-4110-9c0d-93dd1a4e86e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:07.396428 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9fc89-bae3-4110-9c0d-93dd1a4e86e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:07.396698 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9fc89-bae3-4110-9c0d-93dd1a4e86e1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:07.408212 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9fc89-bae3-4110-9c0d-93dd1a4e86e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:07.410200 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9fc89-bae3-4110-9c0d-93dd1a4e86e1 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:07.429794 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-36c9fc89-bae3-4110-9c0d-93dd1a4e86e1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:25:07.431353 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 327/661] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:25:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:07.437860 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac47976-bebe-4a79-b32f-093bc1fcb81f admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:07.456105 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac47976-bebe-4a79-b32f-093bc1fcb81f admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:07.466964 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d93745-c019-4a78-9996-c12cd19d81ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:07.467640 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d93745-c019-4a78-9996-c12cd19d81ae admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:07.467915 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d93745-c019-4a78-9996-c12cd19d81ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:07.468191 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d93745-c019-4a78-9996-c12cd19d81ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:07.469002 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d93745-c019-4a78-9996-c12cd19d81ae admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:07.469306 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d93745-c019-4a78-9996-c12cd19d81ae admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:07.471199 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d93745-c019-4a78-9996-c12cd19d81ae admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:07.493430 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 335/662] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:25:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:07.500283 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9fc89-bae3-4110-9c0d-93dd1a4e86e1 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:07.517469 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9fc89-bae3-4110-9c0d-93dd1a4e86e1 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:07.525111 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30d169-7ec2-4b0f-a14d-d66082af9957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:07.525764 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30d169-7ec2-4b0f-a14d-d66082af9957 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:07.526036 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30d169-7ec2-4b0f-a14d-d66082af9957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:07.526301 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30d169-7ec2-4b0f-a14d-d66082af9957 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:07.527241 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30d169-7ec2-4b0f-a14d-d66082af9957 admin admin] RBAC: Adding query filter params (role.id=f7b8954a0fe64dc2b6146c7174498ddb, scope.project.id=b433200db4784bfeadca48d24212e823, user.id=889e7be1dcaf47f599af9c9b7ad33042) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:07.527549 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30d169-7ec2-4b0f-a14d-d66082af9957 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:07.529385 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30d169-7ec2-4b0f-a14d-d66082af9957 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:07.539868 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 328/663] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:25:07 2021] GET /identity/v3/role_assignments?user.id=889e7be1dcaf47f599af9c9b7ad33042&scope.project.id=b433200db4784bfeadca48d24212e823&role.id=f7b8954a0fe64dc2b6146c7174498ddb => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:07.912858 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469eb72b-a986-4e15-9f65-853d227ea560 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:07.913417 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469eb72b-a986-4e15-9f65-853d227ea560 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:07.913417 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469eb72b-a986-4e15-9f65-853d227ea560 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:07.915238 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 336/664] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:07.922138 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb5297-ee41-4f81-a6fe-a805a5eb51d2 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:07.922752 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb5297-ee41-4f81-a6fe-a805a5eb51d2 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:07.922752 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb5297-ee41-4f81-a6fe-a805a5eb51d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:07.947716 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-9bbb5297-ee41-4f81-a6fe-a805a5eb51d2 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:07.948926 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-9bbb5297-ee41-4f81-a6fe-a805a5eb51d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:07.959369 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 329/665] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:07 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:07.983559 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469eb72b-a986-4e15-9f65-853d227ea560 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:07.999276 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469eb72b-a986-4e15-9f65-853d227ea560 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:08.008228 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8915e-0ec5-4aba-bb4e-de2ea9770388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:08.009029 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8915e-0ec5-4aba-bb4e-de2ea9770388 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.009303 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8915e-0ec5-4aba-bb4e-de2ea9770388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.009572 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8915e-0ec5-4aba-bb4e-de2ea9770388 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.024962 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8915e-0ec5-4aba-bb4e-de2ea9770388 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:25:08.031826 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-e6a8915e-0ec5-4aba-bb4e-de2ea9770388 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:25:08.033042 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 337/666] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:25:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:08.039634 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb5297-ee41-4f81-a6fe-a805a5eb51d2 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:08.048837 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb5297-ee41-4f81-a6fe-a805a5eb51d2 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:08.058347 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380c41d-375c-49fb-b273-b3e65d70489a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:08.058982 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380c41d-375c-49fb-b273-b3e65d70489a admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.059253 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380c41d-375c-49fb-b273-b3e65d70489a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.059519 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380c41d-375c-49fb-b273-b3e65d70489a admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.060287 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380c41d-375c-49fb-b273-b3e65d70489a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:08.060588 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380c41d-375c-49fb-b273-b3e65d70489a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:08.062175 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380c41d-375c-49fb-b273-b3e65d70489a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:08.071406 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 330/667] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:25:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:08.077346 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8915e-0ec5-4aba-bb4e-de2ea9770388 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:08.091718 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8915e-0ec5-4aba-bb4e-de2ea9770388 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:08.098212 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d5268-8c83-444f-bbcc-729a93c54572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:08.099043 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d5268-8c83-444f-bbcc-729a93c54572 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.099314 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d5268-8c83-444f-bbcc-729a93c54572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.099582 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d5268-8c83-444f-bbcc-729a93c54572 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.114292 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d5268-8c83-444f-bbcc-729a93c54572 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:08.116166 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d5268-8c83-444f-bbcc-729a93c54572 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:08.137200 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-898d5268-8c83-444f-bbcc-729a93c54572 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:08.138421 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 338/668] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:08.144952 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380c41d-375c-49fb-b273-b3e65d70489a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:08.154994 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380c41d-375c-49fb-b273-b3e65d70489a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:08.162429 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff9459-9a48-43f0-99b4-3e84f08bfb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:08.163113 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff9459-9a48-43f0-99b4-3e84f08bfb7d admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.163390 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff9459-9a48-43f0-99b4-3e84f08bfb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.163659 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff9459-9a48-43f0-99b4-3e84f08bfb7d admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.164461 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff9459-9a48-43f0-99b4-3e84f08bfb7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:08.164764 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff9459-9a48-43f0-99b4-3e84f08bfb7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:08.166345 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff9459-9a48-43f0-99b4-3e84f08bfb7d admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:08.185009 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 331/669] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:08.190872 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d5268-8c83-444f-bbcc-729a93c54572 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:08.200974 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d5268-8c83-444f-bbcc-729a93c54572 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:08.210774 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8c4b2-8e67-42ab-a96f-5c5b66a1658d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:08.211620 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8c4b2-8e67-42ab-a96f-5c5b66a1658d admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.211891 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8c4b2-8e67-42ab-a96f-5c5b66a1658d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.212158 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8c4b2-8e67-42ab-a96f-5c5b66a1658d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.224610 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8c4b2-8e67-42ab-a96f-5c5b66a1658d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:08.226702 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8c4b2-8e67-42ab-a96f-5c5b66a1658d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:08.242840 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-3ed8c4b2-8e67-42ab-a96f-5c5b66a1658d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 14:25:08.244241 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 339/670] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Oct 28 14:25:08 2021] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:08.250296 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff9459-9a48-43f0-99b4-3e84f08bfb7d admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:08.260394 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff9459-9a48-43f0-99b4-3e84f08bfb7d admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:08.270405 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd4b83-801b-4ff9-8a02-0da0917e935d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:08.271118 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd4b83-801b-4ff9-8a02-0da0917e935d admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.271392 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd4b83-801b-4ff9-8a02-0da0917e935d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.271658 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd4b83-801b-4ff9-8a02-0da0917e935d admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.272513 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd4b83-801b-4ff9-8a02-0da0917e935d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:08.272814 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd4b83-801b-4ff9-8a02-0da0917e935d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:08.274702 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd4b83-801b-4ff9-8a02-0da0917e935d admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:08.297709 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 332/671] 10.222.0.79 () {56 vars in 1154 bytes} [Thu Oct 28 14:25:08 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:08.304188 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8c4b2-8e67-42ab-a96f-5c5b66a1658d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:08.319684 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8c4b2-8e67-42ab-a96f-5c5b66a1658d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:08.327879 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c56ab-aef2-44f1-a1fd-a18a4a7f0cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:08.328535 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c56ab-aef2-44f1-a1fd-a18a4a7f0cce admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.328812 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c56ab-aef2-44f1-a1fd-a18a4a7f0cce admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.329078 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c56ab-aef2-44f1-a1fd-a18a4a7f0cce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.337347 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c56ab-aef2-44f1-a1fd-a18a4a7f0cce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:08.339199 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c56ab-aef2-44f1-a1fd-a18a4a7f0cce admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:08.352412 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 340/672] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:25:08 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:25:08.358391 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd4b83-801b-4ff9-8a02-0da0917e935d admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:08.368520 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd4b83-801b-4ff9-8a02-0da0917e935d admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:08.378916 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c785b3-ac73-4357-97b8-6f0644225aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:08.379771 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c785b3-ac73-4357-97b8-6f0644225aaa admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.380069 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c785b3-ac73-4357-97b8-6f0644225aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.380311 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c785b3-ac73-4357-97b8-6f0644225aaa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.392327 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c785b3-ac73-4357-97b8-6f0644225aaa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:08.394197 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c785b3-ac73-4357-97b8-6f0644225aaa admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:08.421697 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-e8c785b3-ac73-4357-97b8-6f0644225aaa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:08.423117 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 333/673] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:08.429482 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c56ab-aef2-44f1-a1fd-a18a4a7f0cce admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:08.438712 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c56ab-aef2-44f1-a1fd-a18a4a7f0cce admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:08.446660 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3785e9-c9df-4155-97f2-b8b813f75791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:08.447347 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3785e9-c9df-4155-97f2-b8b813f75791 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.447623 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3785e9-c9df-4155-97f2-b8b813f75791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.447894 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3785e9-c9df-4155-97f2-b8b813f75791 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.448626 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3785e9-c9df-4155-97f2-b8b813f75791 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:08.448927 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3785e9-c9df-4155-97f2-b8b813f75791 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:08.450501 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3785e9-c9df-4155-97f2-b8b813f75791 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:08.465628 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 341/674] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:08.471433 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c785b3-ac73-4357-97b8-6f0644225aaa admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:08.481339 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c785b3-ac73-4357-97b8-6f0644225aaa admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:08.490217 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135d6a9-4e72-4681-aeaa-63b58caa72ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:08.491098 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135d6a9-4e72-4681-aeaa-63b58caa72ee admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.491367 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135d6a9-4e72-4681-aeaa-63b58caa72ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.491634 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135d6a9-4e72-4681-aeaa-63b58caa72ee admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.500951 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135d6a9-4e72-4681-aeaa-63b58caa72ee admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:08.502968 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135d6a9-4e72-4681-aeaa-63b58caa72ee admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:08.522257 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189e815-340d-49d5-b1d4-33defb6a7f06 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.522591 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189e815-340d-49d5-b1d4-33defb6a7f06 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.522794 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189e815-340d-49d5-b1d4-33defb6a7f06 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.523479 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-0135d6a9-4e72-4681-aeaa-63b58caa72ee admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:25:08.524842 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 334/675] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:25:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:08.525015 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 342/676] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:08.530490 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7be9bf-3e16-4511-8d59-d519c9536ef5 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.530721 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189e815-340d-49d5-b1d4-33defb6a7f06 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:08.530885 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7be9bf-3e16-4511-8d59-d519c9536ef5 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.531148 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7be9bf-3e16-4511-8d59-d519c9536ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.554544 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189e815-340d-49d5-b1d4-33defb6a7f06 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:08.558833 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-aa7be9bf-3e16-4511-8d59-d519c9536ef5 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:08.560010 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-aa7be9bf-3e16-4511-8d59-d519c9536ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:08.568053 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 335/677] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:08 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:25:08.575935 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86750f72-3841-427d-b6ef-43ff1707ce58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:08.576615 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86750f72-3841-427d-b6ef-43ff1707ce58 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.576892 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86750f72-3841-427d-b6ef-43ff1707ce58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.577165 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86750f72-3841-427d-b6ef-43ff1707ce58 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.577973 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86750f72-3841-427d-b6ef-43ff1707ce58 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:08.578280 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86750f72-3841-427d-b6ef-43ff1707ce58 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:08.580171 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86750f72-3841-427d-b6ef-43ff1707ce58 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:08.605391 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 343/678] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:25:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:08.612133 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7be9bf-3e16-4511-8d59-d519c9536ef5 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:08.612448 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86750f72-3841-427d-b6ef-43ff1707ce58 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:08.624802 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7be9bf-3e16-4511-8d59-d519c9536ef5 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:08.628157 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86750f72-3841-427d-b6ef-43ff1707ce58 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:08.629623 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bb269-fcb5-4cd2-978e-ff6e59f10314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:08.630318 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bb269-fcb5-4cd2-978e-ff6e59f10314 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.630643 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bb269-fcb5-4cd2-978e-ff6e59f10314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.630941 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bb269-fcb5-4cd2-978e-ff6e59f10314 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.631865 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bb269-fcb5-4cd2-978e-ff6e59f10314 admin admin] RBAC: Adding query filter params (role.id=f7b8954a0fe64dc2b6146c7174498ddb, scope.project.id=b433200db4784bfeadca48d24212e823, user.id=18cd6636ae7847c78be910824410d295) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:08.632170 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bb269-fcb5-4cd2-978e-ff6e59f10314 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:08.634239 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bb269-fcb5-4cd2-978e-ff6e59f10314 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:08.642217 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 336/679] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:25:08 2021] GET /identity/v3/role_assignments?user.id=18cd6636ae7847c78be910824410d295&scope.project.id=b433200db4784bfeadca48d24212e823&role.id=f7b8954a0fe64dc2b6146c7174498ddb => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:08.644310 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212efbb6-f730-40f3-92ad-6c00e1a6399a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:08.645086 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212efbb6-f730-40f3-92ad-6c00e1a6399a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.645399 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212efbb6-f730-40f3-92ad-6c00e1a6399a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.645713 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212efbb6-f730-40f3-92ad-6c00e1a6399a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.663726 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212efbb6-f730-40f3-92ad-6c00e1a6399a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:25:08.671431 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-212efbb6-f730-40f3-92ad-6c00e1a6399a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 14:25:08.673434 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 344/680] 10.222.0.79 () {56 vars in 1123 bytes} [Thu Oct 28 14:25:08 2021] GET /identity/v3/roles/service => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:08.680296 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bb269-fcb5-4cd2-978e-ff6e59f10314 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:08.691345 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bb269-fcb5-4cd2-978e-ff6e59f10314 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:08.702950 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fd319-9646-4103-83f6-093b324fc226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:08.704003 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fd319-9646-4103-83f6-093b324fc226 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.704460 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fd319-9646-4103-83f6-093b324fc226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.704928 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fd319-9646-4103-83f6-093b324fc226 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.705872 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95fd319-9646-4103-83f6-093b324fc226 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:08.706416 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95fd319-9646-4103-83f6-093b324fc226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:08.708373 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95fd319-9646-4103-83f6-093b324fc226 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:08.723741 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 337/681] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Oct 28 14:25:08 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:08.729993 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212efbb6-f730-40f3-92ad-6c00e1a6399a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:08.744703 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212efbb6-f730-40f3-92ad-6c00e1a6399a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:08.749848 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a221fe-2ae1-434c-a34a-2dcf35ebbfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:08.751062 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a221fe-2ae1-434c-a34a-2dcf35ebbfe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.751564 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a221fe-2ae1-434c-a34a-2dcf35ebbfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.752003 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a221fe-2ae1-434c-a34a-2dcf35ebbfe2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.763176 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1327c44-6a57-4b0d-bac7-d790574ffccf None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.763779 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1327c44-6a57-4b0d-bac7-d790574ffccf None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.764223 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1327c44-6a57-4b0d-bac7-d790574ffccf None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.766551 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 338/682] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:08.771083 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a221fe-2ae1-434c-a34a-2dcf35ebbfe2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:08.774009 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f18d2a-2313-4957-8f84-97f88ef2be53 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.774513 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f18d2a-2313-4957-8f84-97f88ef2be53 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.774968 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f18d2a-2313-4957-8f84-97f88ef2be53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.785400 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a221fe-2ae1-434c-a34a-2dcf35ebbfe2 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:08.798290 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-79f18d2a-2313-4957-8f84-97f88ef2be53 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:08.799571 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-79f18d2a-2313-4957-8f84-97f88ef2be53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:08.814111 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-f9a221fe-2ae1-434c-a34a-2dcf35ebbfe2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:08.814922 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 339/683] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:08 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:08.816209 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 345/684] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:08.822031 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891f547-e71e-420e-bac6-c59c539d51d2 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.822031 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891f547-e71e-420e-bac6-c59c539d51d2 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.822469 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891f547-e71e-420e-bac6-c59c539d51d2 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.823858 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a221fe-2ae1-434c-a34a-2dcf35ebbfe2 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:08.824796 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 340/685] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:08 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:08.833465 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab54f5-2360-4b0d-b82f-91eed4cbf38d None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.833465 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab54f5-2360-4b0d-b82f-91eed4cbf38d None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.833465 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab54f5-2360-4b0d-b82f-91eed4cbf38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.845414 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a221fe-2ae1-434c-a34a-2dcf35ebbfe2 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:08.850848 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87a013-88a4-43f0-b712-e8136c988c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:08.851622 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87a013-88a4-43f0-b712-e8136c988c07 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.851891 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87a013-88a4-43f0-b712-e8136c988c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.852161 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87a013-88a4-43f0-b712-e8136c988c07 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.852917 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87a013-88a4-43f0-b712-e8136c988c07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:08.853224 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87a013-88a4-43f0-b712-e8136c988c07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:08.854824 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-21ab54f5-2360-4b0d-b82f-91eed4cbf38d None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:08.854972 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87a013-88a4-43f0-b712-e8136c988c07 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:08.856474 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-21ab54f5-2360-4b0d-b82f-91eed4cbf38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:08.865266 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 341/686] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:08 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:25:08.874113 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab54f5-2360-4b0d-b82f-91eed4cbf38d None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:08.874314 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 346/687] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:08.875782 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87a013-88a4-43f0-b712-e8136c988c07 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:08.891547 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab54f5-2360-4b0d-b82f-91eed4cbf38d None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:08.891874 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87a013-88a4-43f0-b712-e8136c988c07 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:08.896775 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6b257-52dd-4571-824d-62a315cbb46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:08.897764 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6b257-52dd-4571-824d-62a315cbb46d admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.898188 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6b257-52dd-4571-824d-62a315cbb46d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.898862 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6b257-52dd-4571-824d-62a315cbb46d admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.900447 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f0807-9be0-460d-ac45-b19cef1b8dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:08.901485 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f0807-9be0-460d-ac45-b19cef1b8dff admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.901696 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f0807-9be0-460d-ac45-b19cef1b8dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.901972 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f0807-9be0-460d-ac45-b19cef1b8dff admin admin] PATH_INFO: `/v3/services/network` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.903981 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f0807-9be0-460d-ac45-b19cef1b8dff admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:08.905692 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f0807-9be0-460d-ac45-b19cef1b8dff admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:08.909591 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6b257-52dd-4571-824d-62a315cbb46d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:08.912778 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6b257-52dd-4571-824d-62a315cbb46d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:08.920393 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-b22f0807-9be0-460d-ac45-b19cef1b8dff admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 14:25:08.921599 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 342/688] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:25:08 2021] GET /identity/v3/services/network => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:08.922216 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f0807-9be0-460d-ac45-b19cef1b8dff admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:08.936156 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-baf6b257-52dd-4571-824d-62a315cbb46d admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 14:25:08.938803 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 347/689] 10.222.0.79 () {56 vars in 1138 bytes} [Thu Oct 28 14:25:08 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:08.938803 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6b257-52dd-4571-824d-62a315cbb46d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:08.938971 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f0807-9be0-460d-ac45-b19cef1b8dff admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:08.943057 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6703f-36ba-43a2-873d-766bb9fe4061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:08.943927 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6703f-36ba-43a2-873d-766bb9fe4061 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.944221 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6703f-36ba-43a2-873d-766bb9fe4061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.944670 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6703f-36ba-43a2-873d-766bb9fe4061 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.945420 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6703f-36ba-43a2-873d-766bb9fe4061 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:08.948170 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6703f-36ba-43a2-873d-766bb9fe4061 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:08.954820 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6b257-52dd-4571-824d-62a315cbb46d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:08.963523 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249ae4e-f5ec-42c9-aa10-832d38dc8ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:08.964281 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249ae4e-f5ec-42c9-aa10-832d38dc8ebc admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.964558 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249ae4e-f5ec-42c9-aa10-832d38dc8ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.964827 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249ae4e-f5ec-42c9-aa10-832d38dc8ebc admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.965583 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249ae4e-f5ec-42c9-aa10-832d38dc8ebc admin admin] RBAC: Adding query filter params (name=network) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:08.965878 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249ae4e-f5ec-42c9-aa10-832d38dc8ebc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:08.967518 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249ae4e-f5ec-42c9-aa10-832d38dc8ebc admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:08.967782 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-b9d6703f-36ba-43a2-873d-766bb9fe4061 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 14:25:08.969221 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 343/690] 10.222.0.79 () {56 vars in 1150 bytes} [Thu Oct 28 14:25:08 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:08.970329 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6703f-36ba-43a2-873d-766bb9fe4061 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:08.973308 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 348/691] 10.222.0.79 () {56 vars in 1133 bytes} [Thu Oct 28 14:25:08 2021] GET /identity/v3/services?name=network => generated 124 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:08.979878 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249ae4e-f5ec-42c9-aa10-832d38dc8ebc admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:08.985396 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6703f-36ba-43a2-873d-766bb9fe4061 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:08.990254 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc444590-1fea-4a00-ac35-30f6c56f3ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:08.990457 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249ae4e-f5ec-42c9-aa10-832d38dc8ebc admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:08.990951 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc444590-1fea-4a00-ac35-30f6c56f3ade admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.991551 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc444590-1fea-4a00-ac35-30f6c56f3ade admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.991551 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc444590-1fea-4a00-ac35-30f6c56f3ade admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.992366 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc444590-1fea-4a00-ac35-30f6c56f3ade admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:08.992667 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc444590-1fea-4a00-ac35-30f6c56f3ade admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:08.994515 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc444590-1fea-4a00-ac35-30f6c56f3ade admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:08.996273 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d44a8c-7afd-42a9-bbbd-a1f693a0cf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:08.996931 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d44a8c-7afd-42a9-bbbd-a1f693a0cf52 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:08.997211 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d44a8c-7afd-42a9-bbbd-a1f693a0cf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:08.997484 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d44a8c-7afd-42a9-bbbd-a1f693a0cf52 admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:08.998208 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d44a8c-7afd-42a9-bbbd-a1f693a0cf52 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:08.998515 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d44a8c-7afd-42a9-bbbd-a1f693a0cf52 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:09.000125 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d44a8c-7afd-42a9-bbbd-a1f693a0cf52 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:09.006712 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 349/692] 10.222.0.79 () {56 vars in 1145 bytes} [Thu Oct 28 14:25:08 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:25:09.007519 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d44a8c-7afd-42a9-bbbd-a1f693a0cf52 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:09.014286 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 344/693] 10.222.0.79 () {56 vars in 1170 bytes} [Thu Oct 28 14:25:08 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:09.015179 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc444590-1fea-4a00-ac35-30f6c56f3ade admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:09.017067 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d44a8c-7afd-42a9-bbbd-a1f693a0cf52 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:09.021638 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05104683-4f78-4a0c-aef7-bb9b7a554ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:09.022295 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05104683-4f78-4a0c-aef7-bb9b7a554ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:09.022625 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05104683-4f78-4a0c-aef7-bb9b7a554ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:09.022884 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05104683-4f78-4a0c-aef7-bb9b7a554ae3 admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:09.023644 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05104683-4f78-4a0c-aef7-bb9b7a554ae3 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:09.023945 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05104683-4f78-4a0c-aef7-bb9b7a554ae3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:09.025552 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05104683-4f78-4a0c-aef7-bb9b7a554ae3 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:09.025657 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc444590-1fea-4a00-ac35-30f6c56f3ade admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:09.030102 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efdb44-2b41-467a-b46f-282e82555d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:09.031005 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efdb44-2b41-467a-b46f-282e82555d78 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:09.031113 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 350/694] 10.222.0.79 () {56 vars in 1133 bytes} [Thu Oct 28 14:25:09 2021] GET /identity/v3/services?type=network => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:09.031203 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efdb44-2b41-467a-b46f-282e82555d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:09.031369 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efdb44-2b41-467a-b46f-282e82555d78 admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:09.031597 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05104683-4f78-4a0c-aef7-bb9b7a554ae3 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:09.032154 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efdb44-2b41-467a-b46f-282e82555d78 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:09.032459 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efdb44-2b41-467a-b46f-282e82555d78 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:09.034049 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efdb44-2b41-467a-b46f-282e82555d78 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:09.040078 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 345/695] 10.222.0.79 () {56 vars in 1145 bytes} [Thu Oct 28 14:25:09 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:09.040871 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efdb44-2b41-467a-b46f-282e82555d78 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:09.041060 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05104683-4f78-4a0c-aef7-bb9b7a554ae3 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:09.052961 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efdb44-2b41-467a-b46f-282e82555d78 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:09.055887 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3d97f-fc6f-4911-a255-715ad1bac748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:09.056856 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3d97f-fc6f-4911-a255-715ad1bac748 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:09.057236 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3d97f-fc6f-4911-a255-715ad1bac748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:09.057641 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3d97f-fc6f-4911-a255-715ad1bac748 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:09.058507 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fff04-6180-405b-98a0-8deb3e279033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:09.059366 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fff04-6180-405b-98a0-8deb3e279033 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:09.059843 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fff04-6180-405b-98a0-8deb3e279033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:09.060279 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fff04-6180-405b-98a0-8deb3e279033 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:09.061254 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fff04-6180-405b-98a0-8deb3e279033 admin admin] RBAC: Adding query filter params (interface=public, service_id=ee354ce2594341848ce2ca89df73a0d8, region_id=RegionOne) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:09.061737 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fff04-6180-405b-98a0-8deb3e279033 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:09.062935 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING py.warnings [None req-ae8fff04-6180-405b-98a0-8deb3e279033 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:25:09.062935 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: warnings.warn(msg) Oct 28 14:25:09.062935 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: Oct 28 14:25:09.064128 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fff04-6180-405b-98a0-8deb3e279033 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:09.070664 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3d97f-fc6f-4911-a255-715ad1bac748 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:09.072669 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 346/696] 10.222.0.79 () {56 vars in 1272 bytes} [Thu Oct 28 14:25:09 2021] GET /identity/v3/endpoints?service_id=ee354ce2594341848ce2ca89df73a0d8&interface=public®ion_id=RegionOne => generated 194 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:09.072782 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3d97f-fc6f-4911-a255-715ad1bac748 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:09.073831 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fff04-6180-405b-98a0-8deb3e279033 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:09.086829 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fff04-6180-405b-98a0-8deb3e279033 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:09.091890 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15621066-9863-4810-b780-9b426a587c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:09.092828 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15621066-9863-4810-b780-9b426a587c82 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:09.093282 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15621066-9863-4810-b780-9b426a587c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:09.093790 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15621066-9863-4810-b780-9b426a587c82 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:09.094793 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15621066-9863-4810-b780-9b426a587c82 admin admin] RBAC: Adding query filter params (interface=public, service_id=ee8c8bfe8b254b9686cd741e7236f064, region_id=RegionOne) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:09.095307 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15621066-9863-4810-b780-9b426a587c82 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:09.096992 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-22f3d97f-fc6f-4911-a255-715ad1bac748 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:09.097343 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15621066-9863-4810-b780-9b426a587c82 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:09.098337 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 351/697] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:09.103490 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3d97f-fc6f-4911-a255-715ad1bac748 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:09.108715 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 347/698] 10.222.0.79 () {56 vars in 1272 bytes} [Thu Oct 28 14:25:09 2021] GET /identity/v3/endpoints?service_id=ee8c8bfe8b254b9686cd741e7236f064&interface=public®ion_id=RegionOne => generated 194 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:09.110934 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15621066-9863-4810-b780-9b426a587c82 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:09.121335 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3d97f-fc6f-4911-a255-715ad1bac748 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:09.126065 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15621066-9863-4810-b780-9b426a587c82 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:09.127027 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be5239-eb93-4107-84f1-d235d458c705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:09.127839 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be5239-eb93-4107-84f1-d235d458c705 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:09.128199 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be5239-eb93-4107-84f1-d235d458c705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:09.128530 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be5239-eb93-4107-84f1-d235d458c705 admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:09.129397 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be5239-eb93-4107-84f1-d235d458c705 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:09.131363 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be5239-eb93-4107-84f1-d235d458c705 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:09.132202 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a8f15-3d38-4bb7-9d5d-7448214691ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:09.133202 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a8f15-3d38-4bb7-9d5d-7448214691ad admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:09.133653 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a8f15-3d38-4bb7-9d5d-7448214691ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:09.134148 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a8f15-3d38-4bb7-9d5d-7448214691ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:09.135132 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a8f15-3d38-4bb7-9d5d-7448214691ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:09.135610 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a8f15-3d38-4bb7-9d5d-7448214691ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:09.137457 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a8f15-3d38-4bb7-9d5d-7448214691ad admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:09.142773 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 352/699] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Oct 28 14:25:09 2021] GET /identity/v3/services => generated 772 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:09.144120 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be5239-eb93-4107-84f1-d235d458c705 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:09.163857 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be5239-eb93-4107-84f1-d235d458c705 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:09.166332 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 348/700] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:09.171667 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d16e8-6247-462a-9390-c8d89af84b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:09.173468 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a8f15-3d38-4bb7-9d5d-7448214691ad admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:09.178810 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d16e8-6247-462a-9390-c8d89af84b15 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:09.179513 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d16e8-6247-462a-9390-c8d89af84b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:09.180527 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d16e8-6247-462a-9390-c8d89af84b15 admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:09.183395 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d16e8-6247-462a-9390-c8d89af84b15 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:09.185378 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d16e8-6247-462a-9390-c8d89af84b15 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:09.191772 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a8f15-3d38-4bb7-9d5d-7448214691ad admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:09.196706 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 353/701] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Oct 28 14:25:09 2021] GET /identity/v3/services => generated 772 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:09.207985 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4fb6a-f693-4372-bf97-269408ae1a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:09.209268 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4fb6a-f693-4372-bf97-269408ae1a50 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:09.209841 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4fb6a-f693-4372-bf97-269408ae1a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:09.210334 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4fb6a-f693-4372-bf97-269408ae1a50 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:09.225473 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4fb6a-f693-4372-bf97-269408ae1a50 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:09.228088 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4fb6a-f693-4372-bf97-269408ae1a50 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:09.247846 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-88f4fb6a-f693-4372-bf97-269408ae1a50 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:25:09.249979 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 349/702] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:25:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:25:09.256485 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d16e8-6247-462a-9390-c8d89af84b15 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:09.269462 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d16e8-6247-462a-9390-c8d89af84b15 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:09.275071 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f609a5-f84b-48e5-92e0-49fb78515002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:09.276236 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f609a5-f84b-48e5-92e0-49fb78515002 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:09.276717 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f609a5-f84b-48e5-92e0-49fb78515002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:09.277300 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f609a5-f84b-48e5-92e0-49fb78515002 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:09.278347 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f609a5-f84b-48e5-92e0-49fb78515002 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:09.278936 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f609a5-f84b-48e5-92e0-49fb78515002 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:09.281148 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f609a5-f84b-48e5-92e0-49fb78515002 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:09.305430 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 354/703] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:25:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:09.312720 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4fb6a-f693-4372-bf97-269408ae1a50 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:09.325582 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4fb6a-f693-4372-bf97-269408ae1a50 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:09.331546 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31124e32-b480-48f7-90ed-f584bba923be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:09.332868 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31124e32-b480-48f7-90ed-f584bba923be admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:09.333404 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31124e32-b480-48f7-90ed-f584bba923be admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:09.333906 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31124e32-b480-48f7-90ed-f584bba923be admin admin] PATH_INFO: `/v3/projects/b433200db4784bfeadca48d24212e823/users/62cc0165aee14b449c8a49233001f631/roles/1ee8b426ca9a49e5b7fb33be19e8a616` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:09.356976 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31124e32-b480-48f7-90ed-f584bba923be admin admin] RBAC: Authorizing `identity:create_grant(project_id=b433200db4784bfeadca48d24212e823, user_id=62cc0165aee14b449c8a49233001f631, role_id=1ee8b426ca9a49e5b7fb33be19e8a616)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:09.360134 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31124e32-b480-48f7-90ed-f584bba923be admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:09.390888 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 350/704] 10.222.0.79 () {58 vars in 1460 bytes} [Thu Oct 28 14:25:09 2021] PUT /identity/v3/projects/b433200db4784bfeadca48d24212e823/users/62cc0165aee14b449c8a49233001f631/roles/1ee8b426ca9a49e5b7fb33be19e8a616 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:25:10.613049 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0fe8e-ccdc-4fad-b01c-bbcde7b459bf None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:10.613628 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0fe8e-ccdc-4fad-b01c-bbcde7b459bf None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:10.613628 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0fe8e-ccdc-4fad-b01c-bbcde7b459bf None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:10.615694 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 355/705] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:10.621735 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1401049-2c6a-4fef-8bf2-e4d1df1e7bcd None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:10.622189 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1401049-2c6a-4fef-8bf2-e4d1df1e7bcd None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:10.622267 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1401049-2c6a-4fef-8bf2-e4d1df1e7bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:10.651992 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-f1401049-2c6a-4fef-8bf2-e4d1df1e7bcd None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:10.653189 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-f1401049-2c6a-4fef-8bf2-e4d1df1e7bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:10.729323 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 351/706] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:10 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:10.773146 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0fe8e-ccdc-4fad-b01c-bbcde7b459bf None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:10.789262 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0fe8e-ccdc-4fad-b01c-bbcde7b459bf None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:10.798218 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae2ef8-fcd3-4ec2-8beb-6f13d86a60eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:10.799337 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae2ef8-fcd3-4ec2-8beb-6f13d86a60eb admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:10.799835 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae2ef8-fcd3-4ec2-8beb-6f13d86a60eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:10.800320 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae2ef8-fcd3-4ec2-8beb-6f13d86a60eb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:10.815639 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae2ef8-fcd3-4ec2-8beb-6f13d86a60eb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:25:10.822905 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-51ae2ef8-fcd3-4ec2-8beb-6f13d86a60eb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:25:10.824671 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 356/707] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:25:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:10.830978 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1401049-2c6a-4fef-8bf2-e4d1df1e7bcd None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:10.844240 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1401049-2c6a-4fef-8bf2-e4d1df1e7bcd None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:10.858415 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b9322-700a-4b8e-8b21-dc0febbb6ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:10.859159 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b9322-700a-4b8e-8b21-dc0febbb6ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:10.859432 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b9322-700a-4b8e-8b21-dc0febbb6ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:10.859699 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b9322-700a-4b8e-8b21-dc0febbb6ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:10.860477 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b9322-700a-4b8e-8b21-dc0febbb6ad3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:10.860776 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b9322-700a-4b8e-8b21-dc0febbb6ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:10.862393 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b9322-700a-4b8e-8b21-dc0febbb6ad3 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:10.877768 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 352/708] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:25:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:10.884106 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae2ef8-fcd3-4ec2-8beb-6f13d86a60eb admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:10.906218 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae2ef8-fcd3-4ec2-8beb-6f13d86a60eb admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:10.914254 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397694a5-3022-4a9b-ad30-273633abd475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:10.915335 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397694a5-3022-4a9b-ad30-273633abd475 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:10.915842 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397694a5-3022-4a9b-ad30-273633abd475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:10.916358 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397694a5-3022-4a9b-ad30-273633abd475 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:10.938415 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397694a5-3022-4a9b-ad30-273633abd475 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:10.940640 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397694a5-3022-4a9b-ad30-273633abd475 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:10.968978 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-397694a5-3022-4a9b-ad30-273633abd475 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:10.970523 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 357/709] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:10.977258 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b9322-700a-4b8e-8b21-dc0febbb6ad3 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:11.001362 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b9322-700a-4b8e-8b21-dc0febbb6ad3 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:11.014087 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9744439-0721-4256-82d7-e90b03ed1282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:11.014856 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9744439-0721-4256-82d7-e90b03ed1282 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:11.015130 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9744439-0721-4256-82d7-e90b03ed1282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:11.015397 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9744439-0721-4256-82d7-e90b03ed1282 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:11.016140 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9744439-0721-4256-82d7-e90b03ed1282 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:11.016440 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9744439-0721-4256-82d7-e90b03ed1282 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:11.018031 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9744439-0721-4256-82d7-e90b03ed1282 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:11.037128 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 353/710] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:11.044755 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397694a5-3022-4a9b-ad30-273633abd475 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:11.059771 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397694a5-3022-4a9b-ad30-273633abd475 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:11.070393 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82cb1c-86ae-4fc9-a7a3-90e7ac634dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:11.071395 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82cb1c-86ae-4fc9-a7a3-90e7ac634dbf admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:11.071847 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82cb1c-86ae-4fc9-a7a3-90e7ac634dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:11.072260 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82cb1c-86ae-4fc9-a7a3-90e7ac634dbf admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:11.083837 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82cb1c-86ae-4fc9-a7a3-90e7ac634dbf admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:11.086077 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82cb1c-86ae-4fc9-a7a3-90e7ac634dbf admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:11.103790 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-2c82cb1c-86ae-4fc9-a7a3-90e7ac634dbf admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 14:25:11.105571 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 358/711] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:25:11 2021] GET /identity/v3/users/swift => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:11.111696 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9744439-0721-4256-82d7-e90b03ed1282 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:11.127674 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9744439-0721-4256-82d7-e90b03ed1282 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:11.139347 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc48c92-0314-4b9c-beb9-1feec69a9cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:11.139969 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc48c92-0314-4b9c-beb9-1feec69a9cac admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:11.140246 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc48c92-0314-4b9c-beb9-1feec69a9cac admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:11.140520 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc48c92-0314-4b9c-beb9-1feec69a9cac admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:11.141378 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc48c92-0314-4b9c-beb9-1feec69a9cac admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:11.141680 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc48c92-0314-4b9c-beb9-1feec69a9cac admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:11.143560 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc48c92-0314-4b9c-beb9-1feec69a9cac admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:11.166230 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 354/712] 10.222.0.79 () {56 vars in 1156 bytes} [Thu Oct 28 14:25:11 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:11.172828 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82cb1c-86ae-4fc9-a7a3-90e7ac634dbf admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:11.187661 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82cb1c-86ae-4fc9-a7a3-90e7ac634dbf admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:11.198336 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc86eb-fbe9-4efc-aa45-cb1be50a6dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:11.199346 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc86eb-fbe9-4efc-aa45-cb1be50a6dfb admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:11.199782 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc86eb-fbe9-4efc-aa45-cb1be50a6dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:11.200187 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc86eb-fbe9-4efc-aa45-cb1be50a6dfb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:11.214349 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc86eb-fbe9-4efc-aa45-cb1be50a6dfb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:11.216403 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc86eb-fbe9-4efc-aa45-cb1be50a6dfb admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:11.242497 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-fdcc86eb-fbe9-4efc-aa45-cb1be50a6dfb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:11.244527 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 359/713] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:11.250669 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc48c92-0314-4b9c-beb9-1feec69a9cac admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:11.266510 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc48c92-0314-4b9c-beb9-1feec69a9cac admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:11.279606 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551a065-f5fe-4ebc-8850-dcea5eef129f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:11.280312 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551a065-f5fe-4ebc-8850-dcea5eef129f admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:11.280590 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551a065-f5fe-4ebc-8850-dcea5eef129f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:11.280865 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551a065-f5fe-4ebc-8850-dcea5eef129f admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:11.281618 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551a065-f5fe-4ebc-8850-dcea5eef129f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:11.281925 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551a065-f5fe-4ebc-8850-dcea5eef129f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:11.283565 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551a065-f5fe-4ebc-8850-dcea5eef129f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:11.299769 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 355/714] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:11.306265 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc86eb-fbe9-4efc-aa45-cb1be50a6dfb admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:11.319910 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc86eb-fbe9-4efc-aa45-cb1be50a6dfb admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:11.327382 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4a179-fcfe-44e4-9fb9-47f68e47a36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:11.328235 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4a179-fcfe-44e4-9fb9-47f68e47a36e admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:11.328511 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4a179-fcfe-44e4-9fb9-47f68e47a36e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:11.328777 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4a179-fcfe-44e4-9fb9-47f68e47a36e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:11.337432 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4a179-fcfe-44e4-9fb9-47f68e47a36e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:11.339546 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4a179-fcfe-44e4-9fb9-47f68e47a36e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:11.356243 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-18c4a179-fcfe-44e4-9fb9-47f68e47a36e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:25:11.357834 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 360/715] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:25:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:11.363998 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551a065-f5fe-4ebc-8850-dcea5eef129f admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:11.379603 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551a065-f5fe-4ebc-8850-dcea5eef129f admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:11.391336 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0f5e3-0510-470d-812a-47656e6bc912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:11.391950 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0f5e3-0510-470d-812a-47656e6bc912 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:11.392232 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0f5e3-0510-470d-812a-47656e6bc912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:11.392502 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0f5e3-0510-470d-812a-47656e6bc912 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:11.393304 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0f5e3-0510-470d-812a-47656e6bc912 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:11.393604 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0f5e3-0510-470d-812a-47656e6bc912 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:11.395480 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0f5e3-0510-470d-812a-47656e6bc912 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:11.410435 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 356/716] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:25:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:11.411716 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf157a-c25e-4efc-8bba-d0895f567c99 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:11.412015 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf157a-c25e-4efc-8bba-d0895f567c99 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:11.412294 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf157a-c25e-4efc-8bba-d0895f567c99 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:11.416923 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 361/717] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 14:25:11.417064 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0f5e3-0510-470d-812a-47656e6bc912 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:11.421991 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fc52c-a8fe-4f39-930c-ee0112b9542f None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:11.422504 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fc52c-a8fe-4f39-930c-ee0112b9542f None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:11.422809 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fc52c-a8fe-4f39-930c-ee0112b9542f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:11.435440 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0f5e3-0510-470d-812a-47656e6bc912 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:11.447991 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c16db7-5bf9-474b-b0a4-bbbb37a80365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:11.448954 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c16db7-5bf9-474b-b0a4-bbbb37a80365 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:11.449241 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c16db7-5bf9-474b-b0a4-bbbb37a80365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:11.449514 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c16db7-5bf9-474b-b0a4-bbbb37a80365 admin admin] PATH_INFO: `/v3/projects/b433200db4784bfeadca48d24212e823/users/889e7be1dcaf47f599af9c9b7ad33042/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:11.453712 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c16db7-5bf9-474b-b0a4-bbbb37a80365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b433200db4784bfeadca48d24212e823, user_id=889e7be1dcaf47f599af9c9b7ad33042, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:11.457769 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-4d5fc52c-a8fe-4f39-930c-ee0112b9542f None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:11.458953 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c16db7-5bf9-474b-b0a4-bbbb37a80365 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:11.461465 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-4d5fc52c-a8fe-4f39-930c-ee0112b9542f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:11.478922 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 362/718] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:11 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:25:11.499797 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 357/719] 10.222.0.79 () {58 vars in 1460 bytes} [Thu Oct 28 14:25:11 2021] PUT /identity/v3/projects/b433200db4784bfeadca48d24212e823/users/889e7be1dcaf47f599af9c9b7ad33042/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:25:11.517226 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fc52c-a8fe-4f39-930c-ee0112b9542f None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:11.527868 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fc52c-a8fe-4f39-930c-ee0112b9542f None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:11.589391 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604793f-f8a8-45a8-a4cf-ef65e72a1564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:11.590378 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604793f-f8a8-45a8-a4cf-ef65e72a1564 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:11.590760 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604793f-f8a8-45a8-a4cf-ef65e72a1564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:11.591103 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604793f-f8a8-45a8-a4cf-ef65e72a1564 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:11.591860 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604793f-f8a8-45a8-a4cf-ef65e72a1564 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:11.593987 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604793f-f8a8-45a8-a4cf-ef65e72a1564 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:11.613743 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-5604793f-f8a8-45a8-a4cf-ef65e72a1564 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 14:25:11.615519 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 363/720] 10.222.0.79 () {56 vars in 1153 bytes} [Thu Oct 28 14:25:11 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:11.623180 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c16db7-5bf9-474b-b0a4-bbbb37a80365 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:11.644999 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c16db7-5bf9-474b-b0a4-bbbb37a80365 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:11.659345 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112addcc-d171-4ec7-8c7c-cd5b16649dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:11.660284 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112addcc-d171-4ec7-8c7c-cd5b16649dfe admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:11.660705 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112addcc-d171-4ec7-8c7c-cd5b16649dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:11.661139 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112addcc-d171-4ec7-8c7c-cd5b16649dfe admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:11.662029 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112addcc-d171-4ec7-8c7c-cd5b16649dfe admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:11.662473 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112addcc-d171-4ec7-8c7c-cd5b16649dfe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:11.664321 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112addcc-d171-4ec7-8c7c-cd5b16649dfe admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:11.675214 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 358/721] 10.222.0.79 () {56 vars in 1147 bytes} [Thu Oct 28 14:25:11 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:11.682305 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604793f-f8a8-45a8-a4cf-ef65e72a1564 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:11.692978 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604793f-f8a8-45a8-a4cf-ef65e72a1564 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:11.703106 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30deb04-b4e0-41f9-a885-359518793f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:11.703801 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30deb04-b4e0-41f9-a885-359518793f08 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:11.704079 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30deb04-b4e0-41f9-a885-359518793f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:11.704351 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30deb04-b4e0-41f9-a885-359518793f08 admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:11.705092 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30deb04-b4e0-41f9-a885-359518793f08 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:11.705395 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30deb04-b4e0-41f9-a885-359518793f08 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:11.707072 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30deb04-b4e0-41f9-a885-359518793f08 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:11.719390 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 364/722] 10.222.0.79 () {56 vars in 1147 bytes} [Thu Oct 28 14:25:11 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:11.944188 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f236053-62d3-4be6-8720-049c50e38d7e None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:11.944776 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f236053-62d3-4be6-8720-049c50e38d7e None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:11.945304 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f236053-62d3-4be6-8720-049c50e38d7e None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:11.947353 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 359/723] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:11.954060 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d954c6-656b-4596-9abd-89b870ef8517 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:11.954341 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d954c6-656b-4596-9abd-89b870ef8517 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:11.954620 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d954c6-656b-4596-9abd-89b870ef8517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:11.983085 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-e8d954c6-656b-4596-9abd-89b870ef8517 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:11.984300 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-e8d954c6-656b-4596-9abd-89b870ef8517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:11.998143 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 365/724] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:11 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:25:12.022091 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f236053-62d3-4be6-8720-049c50e38d7e None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:12.039187 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f236053-62d3-4be6-8720-049c50e38d7e None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:12.044218 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706daaad-cb25-4ded-8e8a-4f32f0716270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:12.045410 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706daaad-cb25-4ded-8e8a-4f32f0716270 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:12.045905 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706daaad-cb25-4ded-8e8a-4f32f0716270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:12.046376 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706daaad-cb25-4ded-8e8a-4f32f0716270 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:12.047286 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706daaad-cb25-4ded-8e8a-4f32f0716270 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:12.049125 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706daaad-cb25-4ded-8e8a-4f32f0716270 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:12.064964 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-706daaad-cb25-4ded-8e8a-4f32f0716270 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 14:25:12.066940 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 360/725] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:25:12 2021] GET /identity/v3/services/network => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:12.073408 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d954c6-656b-4596-9abd-89b870ef8517 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:12.088328 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d954c6-656b-4596-9abd-89b870ef8517 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:12.095315 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae7692-8cdd-4778-a860-2e38a78ae732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:12.096077 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae7692-8cdd-4778-a860-2e38a78ae732 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:12.096356 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae7692-8cdd-4778-a860-2e38a78ae732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:12.096630 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae7692-8cdd-4778-a860-2e38a78ae732 admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:12.097467 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae7692-8cdd-4778-a860-2e38a78ae732 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:12.097772 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae7692-8cdd-4778-a860-2e38a78ae732 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:12.099452 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae7692-8cdd-4778-a860-2e38a78ae732 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:12.113124 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 366/726] 10.222.0.79 () {56 vars in 1133 bytes} [Thu Oct 28 14:25:12 2021] GET /identity/v3/services?name=network => generated 124 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:12.119531 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706daaad-cb25-4ded-8e8a-4f32f0716270 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:12.136491 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706daaad-cb25-4ded-8e8a-4f32f0716270 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:12.146765 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eabae9-e195-4480-ae23-624bd372d1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:12.147678 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eabae9-e195-4480-ae23-624bd372d1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:12.148174 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eabae9-e195-4480-ae23-624bd372d1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:12.148728 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eabae9-e195-4480-ae23-624bd372d1b1 admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:12.149646 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eabae9-e195-4480-ae23-624bd372d1b1 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:12.150135 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eabae9-e195-4480-ae23-624bd372d1b1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:12.152055 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eabae9-e195-4480-ae23-624bd372d1b1 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:12.162101 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 361/727] 10.222.0.79 () {56 vars in 1133 bytes} [Thu Oct 28 14:25:12 2021] GET /identity/v3/services?type=network => generated 350 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:12.168575 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae7692-8cdd-4778-a860-2e38a78ae732 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:12.175044 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f38ce-6d51-4a51-9ea0-8549fc9b3050 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:12.175567 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f38ce-6d51-4a51-9ea0-8549fc9b3050 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:12.176392 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f38ce-6d51-4a51-9ea0-8549fc9b3050 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:12.178610 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 362/728] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 14:25:12.184168 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae7692-8cdd-4778-a860-2e38a78ae732 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:12.184536 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a0ef0-1bb1-4295-a80c-b1e42bc6d07f None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:12.184826 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a0ef0-1bb1-4295-a80c-b1e42bc6d07f None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:12.185104 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a0ef0-1bb1-4295-a80c-b1e42bc6d07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:12.194009 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67535a86-6e9f-4cce-8569-c041d0b41c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:12.195815 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67535a86-6e9f-4cce-8569-c041d0b41c4c admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:12.196104 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67535a86-6e9f-4cce-8569-c041d0b41c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:12.196653 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67535a86-6e9f-4cce-8569-c041d0b41c4c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:12.197439 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67535a86-6e9f-4cce-8569-c041d0b41c4c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:12.199388 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING py.warnings [None req-67535a86-6e9f-4cce-8569-c041d0b41c4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:25:12.199388 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: warnings.warn(msg) Oct 28 14:25:12.199388 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: Oct 28 14:25:12.200273 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67535a86-6e9f-4cce-8569-c041d0b41c4c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:12.218152 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-4c5a0ef0-1bb1-4295-a80c-b1e42bc6d07f None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:12.221323 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-4c5a0ef0-1bb1-4295-a80c-b1e42bc6d07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:12.230710 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 363/729] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:12 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:25:12.243811 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 367/730] 10.222.0.79 () {60 vars in 1165 bytes} [Thu Oct 28 14:25:12 2021] POST /identity/v3/endpoints => generated 327 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:25:12.264617 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a0ef0-1bb1-4295-a80c-b1e42bc6d07f None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:12.278766 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a0ef0-1bb1-4295-a80c-b1e42bc6d07f None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:12.302157 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18111ca3-faae-41a0-8cdb-a02743b043c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:12.303094 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18111ca3-faae-41a0-8cdb-a02743b043c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:12.303376 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18111ca3-faae-41a0-8cdb-a02743b043c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:12.303648 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18111ca3-faae-41a0-8cdb-a02743b043c1 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:12.304332 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18111ca3-faae-41a0-8cdb-a02743b043c1 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:12.306228 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18111ca3-faae-41a0-8cdb-a02743b043c1 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:12.321418 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-18111ca3-faae-41a0-8cdb-a02743b043c1 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 14:25:12.322736 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 364/731] 10.222.0.79 () {56 vars in 1150 bytes} [Thu Oct 28 14:25:12 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:12.329678 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67535a86-6e9f-4cce-8569-c041d0b41c4c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:12.341292 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67535a86-6e9f-4cce-8569-c041d0b41c4c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:12.345957 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fbb55-acea-4ba2-b29c-f1d9829b520a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:12.346654 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fbb55-acea-4ba2-b29c-f1d9829b520a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:12.347014 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fbb55-acea-4ba2-b29c-f1d9829b520a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:12.347291 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fbb55-acea-4ba2-b29c-f1d9829b520a admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:12.348093 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fbb55-acea-4ba2-b29c-f1d9829b520a admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:12.348399 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fbb55-acea-4ba2-b29c-f1d9829b520a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:12.350060 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fbb55-acea-4ba2-b29c-f1d9829b520a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:12.356031 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 368/732] 10.222.0.79 () {56 vars in 1145 bytes} [Thu Oct 28 14:25:12 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:12.362383 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18111ca3-faae-41a0-8cdb-a02743b043c1 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:12.373127 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18111ca3-faae-41a0-8cdb-a02743b043c1 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:12.377910 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d91061-f279-47f9-89b5-fabdc9fdc5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:12.378651 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d91061-f279-47f9-89b5-fabdc9fdc5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:12.378964 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d91061-f279-47f9-89b5-fabdc9fdc5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:12.379240 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d91061-f279-47f9-89b5-fabdc9fdc5f7 admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:12.380040 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d91061-f279-47f9-89b5-fabdc9fdc5f7 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:12.380341 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d91061-f279-47f9-89b5-fabdc9fdc5f7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:12.382077 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d91061-f279-47f9-89b5-fabdc9fdc5f7 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:12.388613 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 365/733] 10.222.0.79 () {56 vars in 1145 bytes} [Thu Oct 28 14:25:12 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:12.395092 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fbb55-acea-4ba2-b29c-f1d9829b520a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:12.405804 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fbb55-acea-4ba2-b29c-f1d9829b520a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:12.409982 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46f7f3-4570-43f6-9e54-2e21af6ea69d None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:12.410315 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46f7f3-4570-43f6-9e54-2e21af6ea69d None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:12.410526 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46f7f3-4570-43f6-9e54-2e21af6ea69d None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:12.412922 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 366/734] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 14:25:12.413746 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c330cb0-8de6-467d-b65d-aa2259168176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:12.414463 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c330cb0-8de6-467d-b65d-aa2259168176 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:12.418642 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c330cb0-8de6-467d-b65d-aa2259168176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:12.418642 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c330cb0-8de6-467d-b65d-aa2259168176 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:12.418642 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c330cb0-8de6-467d-b65d-aa2259168176 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:12.418642 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c330cb0-8de6-467d-b65d-aa2259168176 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:12.425636 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd9015-d613-4bcc-8274-60fbc7290a43 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:12.426632 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd9015-d613-4bcc-8274-60fbc7290a43 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:12.427134 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd9015-d613-4bcc-8274-60fbc7290a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:12.441438 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 369/735] 10.222.0.79 () {60 vars in 1165 bytes} [Thu Oct 28 14:25:12 2021] POST /identity/v3/endpoints => generated 346 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:25:12.463931 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-1edd9015-d613-4bcc-8274-60fbc7290a43 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:12.465432 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-1edd9015-d613-4bcc-8274-60fbc7290a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:12.488816 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 367/736] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:12 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:25:12.515394 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c330cb0-8de6-467d-b65d-aa2259168176 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:12.526994 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c330cb0-8de6-467d-b65d-aa2259168176 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:12.532509 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3c172-b957-4b34-b8f0-8d63da499dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:12.533338 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3c172-b957-4b34-b8f0-8d63da499dbe admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:12.533619 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3c172-b957-4b34-b8f0-8d63da499dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:12.533893 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3c172-b957-4b34-b8f0-8d63da499dbe admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:12.547218 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3c172-b957-4b34-b8f0-8d63da499dbe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:25:12.554885 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-eef3c172-b957-4b34-b8f0-8d63da499dbe admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 14:25:12.556617 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 370/737] 10.222.0.79 () {56 vars in 1123 bytes} [Thu Oct 28 14:25:12 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:12.562982 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd9015-d613-4bcc-8274-60fbc7290a43 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:12.572759 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd9015-d613-4bcc-8274-60fbc7290a43 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:12.577552 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75591b-9cf8-4183-a88e-f7c65d1a3bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:12.578251 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75591b-9cf8-4183-a88e-f7c65d1a3bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:12.578534 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75591b-9cf8-4183-a88e-f7c65d1a3bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:12.578845 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75591b-9cf8-4183-a88e-f7c65d1a3bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:12.579629 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75591b-9cf8-4183-a88e-f7c65d1a3bd5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:12.579940 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75591b-9cf8-4183-a88e-f7c65d1a3bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:12.581580 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75591b-9cf8-4183-a88e-f7c65d1a3bd5 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:12.591617 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 368/738] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Oct 28 14:25:12 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:25:12.599844 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3c172-b957-4b34-b8f0-8d63da499dbe admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:12.610873 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3c172-b957-4b34-b8f0-8d63da499dbe admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:12.615642 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593340f2-783d-47d5-a321-ed4d2628fbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:12.616481 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593340f2-783d-47d5-a321-ed4d2628fbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:12.616761 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593340f2-783d-47d5-a321-ed4d2628fbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:12.617074 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593340f2-783d-47d5-a321-ed4d2628fbc0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:12.629173 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593340f2-783d-47d5-a321-ed4d2628fbc0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:12.631089 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593340f2-783d-47d5-a321-ed4d2628fbc0 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:12.650168 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-593340f2-783d-47d5-a321-ed4d2628fbc0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:12.652200 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 371/739] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:12.658558 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75591b-9cf8-4183-a88e-f7c65d1a3bd5 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:12.669213 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75591b-9cf8-4183-a88e-f7c65d1a3bd5 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:12.673856 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fdb28-d470-454b-a142-4dac63ca7466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:12.674541 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fdb28-d470-454b-a142-4dac63ca7466 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:12.674862 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fdb28-d470-454b-a142-4dac63ca7466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:12.675139 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fdb28-d470-454b-a142-4dac63ca7466 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:12.675892 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fdb28-d470-454b-a142-4dac63ca7466 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:12.676562 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fdb28-d470-454b-a142-4dac63ca7466 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:12.678189 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fdb28-d470-454b-a142-4dac63ca7466 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:12.694385 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 369/740] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:25:12.702298 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593340f2-783d-47d5-a321-ed4d2628fbc0 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:12.713286 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593340f2-783d-47d5-a321-ed4d2628fbc0 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:12.717682 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08119747-da8a-4325-8935-a81e0452b473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:12.718509 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08119747-da8a-4325-8935-a81e0452b473 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:12.718855 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08119747-da8a-4325-8935-a81e0452b473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:12.719130 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08119747-da8a-4325-8935-a81e0452b473 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:12.727388 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08119747-da8a-4325-8935-a81e0452b473 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:12.729418 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08119747-da8a-4325-8935-a81e0452b473 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:12.744310 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-08119747-da8a-4325-8935-a81e0452b473 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 14:25:12.745884 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 372/741] 10.222.0.79 () {56 vars in 1138 bytes} [Thu Oct 28 14:25:12 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:12.751926 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fdb28-d470-454b-a142-4dac63ca7466 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:12.762298 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fdb28-d470-454b-a142-4dac63ca7466 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:12.768003 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c26ab-4fcc-4a7e-a8ef-e659e7b48fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:12.768691 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c26ab-4fcc-4a7e-a8ef-e659e7b48fea admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:12.768967 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c26ab-4fcc-4a7e-a8ef-e659e7b48fea admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:12.769296 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c26ab-4fcc-4a7e-a8ef-e659e7b48fea admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:12.770160 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c26ab-4fcc-4a7e-a8ef-e659e7b48fea admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:12.770468 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c26ab-4fcc-4a7e-a8ef-e659e7b48fea admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:12.772372 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c26ab-4fcc-4a7e-a8ef-e659e7b48fea admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:12.793198 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 370/742] 10.222.0.79 () {56 vars in 1170 bytes} [Thu Oct 28 14:25:12 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:12.799444 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08119747-da8a-4325-8935-a81e0452b473 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:12.809789 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08119747-da8a-4325-8935-a81e0452b473 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:12.814290 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c366ce5-390b-4158-bf72-8efc31370f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:12.814976 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c366ce5-390b-4158-bf72-8efc31370f4e admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:12.815256 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c366ce5-390b-4158-bf72-8efc31370f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:12.815524 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c366ce5-390b-4158-bf72-8efc31370f4e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:12.823678 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c366ce5-390b-4158-bf72-8efc31370f4e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:12.825429 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c366ce5-390b-4158-bf72-8efc31370f4e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:12.834578 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 373/743] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:25:12 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:25:12.840931 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c26ab-4fcc-4a7e-a8ef-e659e7b48fea admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:12.850752 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c26ab-4fcc-4a7e-a8ef-e659e7b48fea admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:12.855321 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ce095-be47-4a74-9b4f-f699372658a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:12.856129 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ce095-be47-4a74-9b4f-f699372658a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:12.856406 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ce095-be47-4a74-9b4f-f699372658a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:12.856684 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ce095-be47-4a74-9b4f-f699372658a2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:12.867490 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ce095-be47-4a74-9b4f-f699372658a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:12.869427 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ce095-be47-4a74-9b4f-f699372658a2 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:12.886871 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-3c4ce095-be47-4a74-9b4f-f699372658a2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:12.888385 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 371/744] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:12.894604 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c366ce5-390b-4158-bf72-8efc31370f4e admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:12.908880 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c366ce5-390b-4158-bf72-8efc31370f4e admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:12.913439 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78bd9f-1df7-4de9-940e-e7031399118f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:12.914139 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78bd9f-1df7-4de9-940e-e7031399118f admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:12.914416 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78bd9f-1df7-4de9-940e-e7031399118f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:12.914705 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78bd9f-1df7-4de9-940e-e7031399118f admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:12.915472 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78bd9f-1df7-4de9-940e-e7031399118f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:12.915774 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78bd9f-1df7-4de9-940e-e7031399118f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:12.917353 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78bd9f-1df7-4de9-940e-e7031399118f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:12.935327 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 374/745] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:12.941456 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ce095-be47-4a74-9b4f-f699372658a2 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:12.951329 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ce095-be47-4a74-9b4f-f699372658a2 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:12.955812 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afad87-2184-41c8-a7cd-4cf5544f236b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:12.956612 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afad87-2184-41c8-a7cd-4cf5544f236b admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:12.956892 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afad87-2184-41c8-a7cd-4cf5544f236b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:12.957160 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afad87-2184-41c8-a7cd-4cf5544f236b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:12.964532 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afad87-2184-41c8-a7cd-4cf5544f236b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:12.966494 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afad87-2184-41c8-a7cd-4cf5544f236b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:12.981962 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-55afad87-2184-41c8-a7cd-4cf5544f236b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:25:12.983561 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 372/746] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:25:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:12.989867 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78bd9f-1df7-4de9-940e-e7031399118f admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:13.000064 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78bd9f-1df7-4de9-940e-e7031399118f admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:13.004597 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a71d6d-0077-47e3-b716-3f490670fbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:13.005259 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a71d6d-0077-47e3-b716-3f490670fbcd admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:13.005535 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a71d6d-0077-47e3-b716-3f490670fbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:13.005805 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a71d6d-0077-47e3-b716-3f490670fbcd admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:13.006604 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a71d6d-0077-47e3-b716-3f490670fbcd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:13.006935 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a71d6d-0077-47e3-b716-3f490670fbcd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:13.008809 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a71d6d-0077-47e3-b716-3f490670fbcd admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:13.021968 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 375/747] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:25:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:13.033202 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afad87-2184-41c8-a7cd-4cf5544f236b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:13.049022 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afad87-2184-41c8-a7cd-4cf5544f236b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:13.054368 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a344da9-3d00-4df0-acc9-ab4c679eb3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:13.055171 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a344da9-3d00-4df0-acc9-ab4c679eb3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:13.055451 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a344da9-3d00-4df0-acc9-ab4c679eb3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:13.055725 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a344da9-3d00-4df0-acc9-ab4c679eb3e4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:13.056582 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a344da9-3d00-4df0-acc9-ab4c679eb3e4 admin admin] RBAC: Adding query filter params (role.id=1ee8b426ca9a49e5b7fb33be19e8a616, scope.project.id=b433200db4784bfeadca48d24212e823, user.id=62cc0165aee14b449c8a49233001f631) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:13.056892 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a344da9-3d00-4df0-acc9-ab4c679eb3e4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:13.058927 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a344da9-3d00-4df0-acc9-ab4c679eb3e4 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:13.065755 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 373/748] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:25:13 2021] GET /identity/v3/role_assignments?user.id=62cc0165aee14b449c8a49233001f631&scope.project.id=b433200db4784bfeadca48d24212e823&role.id=1ee8b426ca9a49e5b7fb33be19e8a616 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:14.195259 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24236826-ac52-4679-a4d9-86c555e4c142 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:14.195259 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24236826-ac52-4679-a4d9-86c555e4c142 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:14.195259 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24236826-ac52-4679-a4d9-86c555e4c142 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:14.195259 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 376/749] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:14.205005 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1b368-cbe5-44a3-8fa6-99b859d8e759 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:14.205005 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1b368-cbe5-44a3-8fa6-99b859d8e759 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:14.205005 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1b368-cbe5-44a3-8fa6-99b859d8e759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:14.222469 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-fad1b368-cbe5-44a3-8fa6-99b859d8e759 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:14.224017 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-fad1b368-cbe5-44a3-8fa6-99b859d8e759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:14.232533 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 374/750] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:14 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:14.257161 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24236826-ac52-4679-a4d9-86c555e4c142 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:14.270274 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24236826-ac52-4679-a4d9-86c555e4c142 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:14.275281 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6f6b0-a8ab-4de2-a1f2-6b54e4bd5e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:14.276361 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6f6b0-a8ab-4de2-a1f2-6b54e4bd5e3c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:14.276864 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6f6b0-a8ab-4de2-a1f2-6b54e4bd5e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:14.277354 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6f6b0-a8ab-4de2-a1f2-6b54e4bd5e3c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:14.288578 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6f6b0-a8ab-4de2-a1f2-6b54e4bd5e3c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:25:14.295840 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-e6a6f6b0-a8ab-4de2-a1f2-6b54e4bd5e3c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:25:14.297582 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 377/751] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:25:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:14.304807 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1b368-cbe5-44a3-8fa6-99b859d8e759 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:14.314289 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1b368-cbe5-44a3-8fa6-99b859d8e759 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:14.319191 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c9822-1540-42e4-b135-0552dc14e1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:14.320273 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c9822-1540-42e4-b135-0552dc14e1ec admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:14.320776 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c9822-1540-42e4-b135-0552dc14e1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:14.321300 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c9822-1540-42e4-b135-0552dc14e1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:14.322272 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c9822-1540-42e4-b135-0552dc14e1ec admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:14.322821 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c9822-1540-42e4-b135-0552dc14e1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:14.324646 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c9822-1540-42e4-b135-0552dc14e1ec admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:14.326895 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bee0c-b836-4b9a-bf10-b92a50397765 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:14.327179 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bee0c-b836-4b9a-bf10-b92a50397765 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:14.327450 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bee0c-b836-4b9a-bf10-b92a50397765 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:14.329610 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 378/752] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 14:25:14.335306 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafe6cd-cbdd-43dd-b0bc-ebd57b503e36 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:14.335644 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafe6cd-cbdd-43dd-b0bc-ebd57b503e36 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:14.336033 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 375/753] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:25:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:14.336139 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafe6cd-cbdd-43dd-b0bc-ebd57b503e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:14.345174 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c9822-1540-42e4-b135-0552dc14e1ec admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:14.355248 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-9eafe6cd-cbdd-43dd-b0bc-ebd57b503e36 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:14.356053 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c9822-1540-42e4-b135-0552dc14e1ec admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:14.356451 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-9eafe6cd-cbdd-43dd-b0bc-ebd57b503e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:14.361447 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9e7f3-44d3-4ff9-974d-4b866c228abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:14.362619 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9e7f3-44d3-4ff9-974d-4b866c228abd admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:14.363183 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9e7f3-44d3-4ff9-974d-4b866c228abd admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:14.363653 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9e7f3-44d3-4ff9-974d-4b866c228abd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:14.365291 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 379/754] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:14 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:25:14.375603 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9e7f3-44d3-4ff9-974d-4b866c228abd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:14.377727 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9e7f3-44d3-4ff9-974d-4b866c228abd admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:14.389061 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafe6cd-cbdd-43dd-b0bc-ebd57b503e36 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:14.395394 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-e6c9e7f3-44d3-4ff9-974d-4b866c228abd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:14.397099 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 376/755] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:14.402461 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafe6cd-cbdd-43dd-b0bc-ebd57b503e36 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:14.402839 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f0b9a-0047-467a-b1e3-e500102a7a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:14.403516 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f0b9a-0047-467a-b1e3-e500102a7a65 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:14.403779 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f0b9a-0047-467a-b1e3-e500102a7a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:14.404039 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f0b9a-0047-467a-b1e3-e500102a7a65 admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:14.404429 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9e7f3-44d3-4ff9-974d-4b866c228abd admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:14.404772 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f0b9a-0047-467a-b1e3-e500102a7a65 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:14.406582 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f0b9a-0047-467a-b1e3-e500102a7a65 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:14.415397 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9e7f3-44d3-4ff9-974d-4b866c228abd admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:14.423440 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e6380-3ed0-4b65-b668-e96c0153a733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:14.423925 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 380/756] 10.222.0.79 () {60 vars in 1162 bytes} [Thu Oct 28 14:25:14 2021] POST /identity/v3/services => generated 269 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:25:14.424603 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e6380-3ed0-4b65-b668-e96c0153a733 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:14.425125 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e6380-3ed0-4b65-b668-e96c0153a733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:14.425582 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e6380-3ed0-4b65-b668-e96c0153a733 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:14.426933 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e6380-3ed0-4b65-b668-e96c0153a733 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:14.427470 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e6380-3ed0-4b65-b668-e96c0153a733 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:14.429424 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e6380-3ed0-4b65-b668-e96c0153a733 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:14.444757 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 377/757] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:14.451201 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f0b9a-0047-467a-b1e3-e500102a7a65 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:14.472816 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f0b9a-0047-467a-b1e3-e500102a7a65 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:14.477705 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487826d8-6df2-44ed-ac9a-79bb6f6d45be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:14.478539 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487826d8-6df2-44ed-ac9a-79bb6f6d45be admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:14.478855 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487826d8-6df2-44ed-ac9a-79bb6f6d45be admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:14.479130 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487826d8-6df2-44ed-ac9a-79bb6f6d45be admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:14.487331 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487826d8-6df2-44ed-ac9a-79bb6f6d45be admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:14.489376 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487826d8-6df2-44ed-ac9a-79bb6f6d45be admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:14.504980 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-487826d8-6df2-44ed-ac9a-79bb6f6d45be admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 14:25:14.506627 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 381/758] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:25:14 2021] GET /identity/v3/users/swift => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:14.513811 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e6380-3ed0-4b65-b668-e96c0153a733 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:14.524867 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e6380-3ed0-4b65-b668-e96c0153a733 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:14.529769 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006373ac-2312-4467-a34d-11bc6e68c4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:14.530602 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006373ac-2312-4467-a34d-11bc6e68c4de admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:14.530928 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006373ac-2312-4467-a34d-11bc6e68c4de admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:14.531202 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006373ac-2312-4467-a34d-11bc6e68c4de admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:14.532080 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006373ac-2312-4467-a34d-11bc6e68c4de admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:14.532394 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006373ac-2312-4467-a34d-11bc6e68c4de admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:14.534410 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006373ac-2312-4467-a34d-11bc6e68c4de admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:14.556592 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 378/759] 10.222.0.79 () {56 vars in 1156 bytes} [Thu Oct 28 14:25:14 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:14.563205 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487826d8-6df2-44ed-ac9a-79bb6f6d45be admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:14.573786 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487826d8-6df2-44ed-ac9a-79bb6f6d45be admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:14.578719 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20598199-0492-4f88-9181-096042106aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:14.579448 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20598199-0492-4f88-9181-096042106aae admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:14.579732 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20598199-0492-4f88-9181-096042106aae admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:14.580056 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20598199-0492-4f88-9181-096042106aae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:14.589651 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20598199-0492-4f88-9181-096042106aae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:14.591548 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20598199-0492-4f88-9181-096042106aae admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:14.601970 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 382/760] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:25:14 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:25:14.608767 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006373ac-2312-4467-a34d-11bc6e68c4de admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:14.619484 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006373ac-2312-4467-a34d-11bc6e68c4de admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:14.624434 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3675e-7ce6-4db6-b3da-be13bdd2bd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:14.625298 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3675e-7ce6-4db6-b3da-be13bdd2bd43 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:14.625578 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3675e-7ce6-4db6-b3da-be13bdd2bd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:14.625848 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3675e-7ce6-4db6-b3da-be13bdd2bd43 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:14.637670 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3675e-7ce6-4db6-b3da-be13bdd2bd43 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:14.639673 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3675e-7ce6-4db6-b3da-be13bdd2bd43 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:14.662314 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-a0c3675e-7ce6-4db6-b3da-be13bdd2bd43 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:14.664424 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 379/761] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:14.670938 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20598199-0492-4f88-9181-096042106aae admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:14.682303 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20598199-0492-4f88-9181-096042106aae admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:14.687487 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a0e45-342f-42e6-999d-1f64d14b4097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:14.688158 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a0e45-342f-42e6-999d-1f64d14b4097 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:14.688438 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a0e45-342f-42e6-999d-1f64d14b4097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:14.688713 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a0e45-342f-42e6-999d-1f64d14b4097 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:14.689455 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a0e45-342f-42e6-999d-1f64d14b4097 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:14.689764 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a0e45-342f-42e6-999d-1f64d14b4097 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:14.691465 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a0e45-342f-42e6-999d-1f64d14b4097 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:14.704581 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 383/762] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:14.711005 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3675e-7ce6-4db6-b3da-be13bdd2bd43 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:14.721285 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3675e-7ce6-4db6-b3da-be13bdd2bd43 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:14.726135 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25eb2b-ca8d-4590-9cd7-0751ebe8eba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:14.726992 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25eb2b-ca8d-4590-9cd7-0751ebe8eba2 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:14.727269 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25eb2b-ca8d-4590-9cd7-0751ebe8eba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:14.727529 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25eb2b-ca8d-4590-9cd7-0751ebe8eba2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:14.734727 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25eb2b-ca8d-4590-9cd7-0751ebe8eba2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:14.736664 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25eb2b-ca8d-4590-9cd7-0751ebe8eba2 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:14.749617 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-5d25eb2b-ca8d-4590-9cd7-0751ebe8eba2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:25:14.751183 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 380/763] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:25:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:14.758056 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a0e45-342f-42e6-999d-1f64d14b4097 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:14.769269 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a0e45-342f-42e6-999d-1f64d14b4097 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:14.774528 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b800f-62bd-495b-ba53-f5a84914cedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:14.775633 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b800f-62bd-495b-ba53-f5a84914cedc admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:14.776140 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b800f-62bd-495b-ba53-f5a84914cedc admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:14.776616 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b800f-62bd-495b-ba53-f5a84914cedc admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:14.777660 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b800f-62bd-495b-ba53-f5a84914cedc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:14.778182 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b800f-62bd-495b-ba53-f5a84914cedc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:14.780332 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b800f-62bd-495b-ba53-f5a84914cedc admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:14.796492 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 384/764] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:25:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:14.803790 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25eb2b-ca8d-4590-9cd7-0751ebe8eba2 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:14.814890 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25eb2b-ca8d-4590-9cd7-0751ebe8eba2 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:14.819699 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b02c13-1123-40f2-9ea9-66cbc522acf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:14.820727 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b02c13-1123-40f2-9ea9-66cbc522acf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:14.821228 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b02c13-1123-40f2-9ea9-66cbc522acf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:14.821700 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b02c13-1123-40f2-9ea9-66cbc522acf8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:14.822774 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b02c13-1123-40f2-9ea9-66cbc522acf8 admin admin] RBAC: Adding query filter params (role.id=f7b8954a0fe64dc2b6146c7174498ddb, scope.project.id=b433200db4784bfeadca48d24212e823, user.id=889e7be1dcaf47f599af9c9b7ad33042) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:14.823302 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b02c13-1123-40f2-9ea9-66cbc522acf8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:14.825342 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b02c13-1123-40f2-9ea9-66cbc522acf8 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:14.832096 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 381/765] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:25:14 2021] GET /identity/v3/role_assignments?user.id=889e7be1dcaf47f599af9c9b7ad33042&scope.project.id=b433200db4784bfeadca48d24212e823&role.id=f7b8954a0fe64dc2b6146c7174498ddb => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:25:14.914109 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064e14b-c090-4646-9c4c-2a563288786b None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:14.914454 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064e14b-c090-4646-9c4c-2a563288786b None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:14.914667 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064e14b-c090-4646-9c4c-2a563288786b None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:14.916845 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 385/766] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:14.923485 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8d461-ee9b-4264-9e0b-ae619b6a34de None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:14.924092 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8d461-ee9b-4264-9e0b-ae619b6a34de None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:14.924567 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8d461-ee9b-4264-9e0b-ae619b6a34de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:14.944898 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-01b8d461-ee9b-4264-9e0b-ae619b6a34de None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:14.946188 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-01b8d461-ee9b-4264-9e0b-ae619b6a34de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:14.954513 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 382/767] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:14 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:14.977982 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064e14b-c090-4646-9c4c-2a563288786b None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:14.990929 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064e14b-c090-4646-9c4c-2a563288786b None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:14.995531 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513afcc-5f6c-49ce-a4a2-8b0b3a6392e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:14.996344 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513afcc-5f6c-49ce-a4a2-8b0b3a6392e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:14.996622 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513afcc-5f6c-49ce-a4a2-8b0b3a6392e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:14.996891 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513afcc-5f6c-49ce-a4a2-8b0b3a6392e4 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:14.997673 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513afcc-5f6c-49ce-a4a2-8b0b3a6392e4 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:14.999385 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513afcc-5f6c-49ce-a4a2-8b0b3a6392e4 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:15.011269 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-8513afcc-5f6c-49ce-a4a2-8b0b3a6392e4 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 14:25:15.018316 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 386/768] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Oct 28 14:25:14 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:15.019785 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8d461-ee9b-4264-9e0b-ae619b6a34de None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:15.029425 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8d461-ee9b-4264-9e0b-ae619b6a34de None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:15.034046 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3b1f1-56ae-4fae-ae24-9926dd59c1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:15.034756 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3b1f1-56ae-4fae-ae24-9926dd59c1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:15.035038 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3b1f1-56ae-4fae-ae24-9926dd59c1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:15.035305 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3b1f1-56ae-4fae-ae24-9926dd59c1d7 admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:15.036037 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3b1f1-56ae-4fae-ae24-9926dd59c1d7 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:15.036343 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3b1f1-56ae-4fae-ae24-9926dd59c1d7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:15.037969 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3b1f1-56ae-4fae-ae24-9926dd59c1d7 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:15.043964 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 383/769] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Oct 28 14:25:15 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:15.050506 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513afcc-5f6c-49ce-a4a2-8b0b3a6392e4 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:15.061838 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513afcc-5f6c-49ce-a4a2-8b0b3a6392e4 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:15.066624 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656df24-24dd-4f62-a6d8-94b69bfb52c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:15.067316 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656df24-24dd-4f62-a6d8-94b69bfb52c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:15.067595 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656df24-24dd-4f62-a6d8-94b69bfb52c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:15.067867 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656df24-24dd-4f62-a6d8-94b69bfb52c9 admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:15.068594 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656df24-24dd-4f62-a6d8-94b69bfb52c9 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:15.068899 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656df24-24dd-4f62-a6d8-94b69bfb52c9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:15.070562 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656df24-24dd-4f62-a6d8-94b69bfb52c9 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:15.078804 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 387/770] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Oct 28 14:25:15 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:15.485691 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d550e-f7fb-4cb5-911c-13557f7b8af2 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:15.486226 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d550e-f7fb-4cb5-911c-13557f7b8af2 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:15.486226 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d550e-f7fb-4cb5-911c-13557f7b8af2 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:15.488252 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 384/771] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:15.494472 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06cd2a-1faf-4a43-9944-6c9bc5d4b2cb None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:15.494904 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06cd2a-1faf-4a43-9944-6c9bc5d4b2cb None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:15.495088 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06cd2a-1faf-4a43-9944-6c9bc5d4b2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:15.513402 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-5a06cd2a-1faf-4a43-9944-6c9bc5d4b2cb None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:15.514908 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-5a06cd2a-1faf-4a43-9944-6c9bc5d4b2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:15.523170 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 388/772] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:15 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:25:15.547251 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d550e-f7fb-4cb5-911c-13557f7b8af2 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:15.559990 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d550e-f7fb-4cb5-911c-13557f7b8af2 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:15.564431 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be1960-0837-4131-a334-a4032508d1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:15.565230 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be1960-0837-4131-a334-a4032508d1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:15.565508 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be1960-0837-4131-a334-a4032508d1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:15.565775 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be1960-0837-4131-a334-a4032508d1c2 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:15.576308 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be1960-0837-4131-a334-a4032508d1c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:25:15.583496 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-36be1960-0837-4131-a334-a4032508d1c2 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 14:25:15.584979 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 385/773] 10.222.0.79 () {56 vars in 1141 bytes} [Thu Oct 28 14:25:15 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:15.591483 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06cd2a-1faf-4a43-9944-6c9bc5d4b2cb None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:15.600555 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06cd2a-1faf-4a43-9944-6c9bc5d4b2cb None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:15.605251 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4441788-3851-49f3-ad84-48b4ae148467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:15.605922 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4441788-3851-49f3-ad84-48b4ae148467 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:15.606206 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4441788-3851-49f3-ad84-48b4ae148467 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:15.606468 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4441788-3851-49f3-ad84-48b4ae148467 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:15.607273 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4441788-3851-49f3-ad84-48b4ae148467 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:15.607580 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4441788-3851-49f3-ad84-48b4ae148467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:15.609357 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4441788-3851-49f3-ad84-48b4ae148467 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:15.618162 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 389/774] 10.222.0.79 () {56 vars in 1136 bytes} [Thu Oct 28 14:25:15 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:15.624494 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be1960-0837-4131-a334-a4032508d1c2 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:15.635148 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be1960-0837-4131-a334-a4032508d1c2 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:15.639715 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad09ea-30fe-4319-b814-441efce1bb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:15.640508 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad09ea-30fe-4319-b814-441efce1bb7c admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:15.640788 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad09ea-30fe-4319-b814-441efce1bb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:15.641059 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad09ea-30fe-4319-b814-441efce1bb7c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:15.651992 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad09ea-30fe-4319-b814-441efce1bb7c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:15.653942 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad09ea-30fe-4319-b814-441efce1bb7c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:15.671370 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-b8ad09ea-30fe-4319-b814-441efce1bb7c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:15.672898 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 386/775] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:15.679536 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4441788-3851-49f3-ad84-48b4ae148467 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:15.689278 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4441788-3851-49f3-ad84-48b4ae148467 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:15.693796 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cfcc53-2e8e-47ef-96c3-45307934b2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:15.694449 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfcc53-2e8e-47ef-96c3-45307934b2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:15.694796 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfcc53-2e8e-47ef-96c3-45307934b2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:15.695125 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfcc53-2e8e-47ef-96c3-45307934b2f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:15.695910 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cfcc53-2e8e-47ef-96c3-45307934b2f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:15.696213 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cfcc53-2e8e-47ef-96c3-45307934b2f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:15.697852 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cfcc53-2e8e-47ef-96c3-45307934b2f2 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:15.711280 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 390/776] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:15.717859 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad09ea-30fe-4319-b814-441efce1bb7c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:15.728506 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad09ea-30fe-4319-b814-441efce1bb7c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:15.733202 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb990c9-3246-4d07-8122-0c48e8a4f8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:15.734075 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb990c9-3246-4d07-8122-0c48e8a4f8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:15.734351 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb990c9-3246-4d07-8122-0c48e8a4f8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:15.734663 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb990c9-3246-4d07-8122-0c48e8a4f8a6 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:15.742628 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb990c9-3246-4d07-8122-0c48e8a4f8a6 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:15.744678 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb990c9-3246-4d07-8122-0c48e8a4f8a6 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:15.759263 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-6eb990c9-3246-4d07-8122-0c48e8a4f8a6 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 14:25:15.760459 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 387/777] 10.222.0.79 () {56 vars in 1138 bytes} [Thu Oct 28 14:25:15 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:15.767078 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cfcc53-2e8e-47ef-96c3-45307934b2f2 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:15.777277 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cfcc53-2e8e-47ef-96c3-45307934b2f2 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:15.781955 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a22f35-b684-45f6-a716-ff876f370b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:15.782628 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a22f35-b684-45f6-a716-ff876f370b11 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:15.782987 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a22f35-b684-45f6-a716-ff876f370b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:15.783258 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a22f35-b684-45f6-a716-ff876f370b11 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:15.784167 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a22f35-b684-45f6-a716-ff876f370b11 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:15.784472 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a22f35-b684-45f6-a716-ff876f370b11 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:15.786359 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a22f35-b684-45f6-a716-ff876f370b11 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:15.805698 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 391/778] 10.222.0.79 () {56 vars in 1170 bytes} [Thu Oct 28 14:25:15 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:15.812014 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb990c9-3246-4d07-8122-0c48e8a4f8a6 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:15.822169 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb990c9-3246-4d07-8122-0c48e8a4f8a6 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:15.826923 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5235a-478e-4f4c-ad51-442c2426f719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:15.827573 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5235a-478e-4f4c-ad51-442c2426f719 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:15.827852 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5235a-478e-4f4c-ad51-442c2426f719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:15.828177 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5235a-478e-4f4c-ad51-442c2426f719 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:15.836987 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5235a-478e-4f4c-ad51-442c2426f719 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:15.838830 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5235a-478e-4f4c-ad51-442c2426f719 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:15.848546 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 388/779] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:25:15 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:25:15.854896 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a22f35-b684-45f6-a716-ff876f370b11 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:15.864948 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a22f35-b684-45f6-a716-ff876f370b11 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:15.869850 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a59bfe-358d-4c6e-89bc-428314049927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:15.870652 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a59bfe-358d-4c6e-89bc-428314049927 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:15.870952 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a59bfe-358d-4c6e-89bc-428314049927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:15.871219 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a59bfe-358d-4c6e-89bc-428314049927 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:15.881901 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a59bfe-358d-4c6e-89bc-428314049927 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:15.883878 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a59bfe-358d-4c6e-89bc-428314049927 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:15.906137 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-e7a59bfe-358d-4c6e-89bc-428314049927 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:15.907791 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 392/780] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:15.914206 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5235a-478e-4f4c-ad51-442c2426f719 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:15.929155 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5235a-478e-4f4c-ad51-442c2426f719 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:15.933911 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba2925-375b-4b3b-a849-d5d4b500f30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:15.934579 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba2925-375b-4b3b-a849-d5d4b500f30a admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:15.934891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba2925-375b-4b3b-a849-d5d4b500f30a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:15.935206 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba2925-375b-4b3b-a849-d5d4b500f30a admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:15.935942 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba2925-375b-4b3b-a849-d5d4b500f30a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:15.936245 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba2925-375b-4b3b-a849-d5d4b500f30a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:15.937887 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba2925-375b-4b3b-a849-d5d4b500f30a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:15.950117 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 389/781] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:15.956398 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a59bfe-358d-4c6e-89bc-428314049927 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:15.971149 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a59bfe-358d-4c6e-89bc-428314049927 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:15.979348 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebf0a8-c4ee-4f2f-8a92-7dd509b76cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:15.981441 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebf0a8-c4ee-4f2f-8a92-7dd509b76cbd admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:15.981734 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebf0a8-c4ee-4f2f-8a92-7dd509b76cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:15.982009 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebf0a8-c4ee-4f2f-8a92-7dd509b76cbd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:15.990915 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebf0a8-c4ee-4f2f-8a92-7dd509b76cbd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:15.993089 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebf0a8-c4ee-4f2f-8a92-7dd509b76cbd admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:16.007007 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-e9ebf0a8-c4ee-4f2f-8a92-7dd509b76cbd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:25:16.008534 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 393/782] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:25:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:16.015243 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba2925-375b-4b3b-a849-d5d4b500f30a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:16.026577 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba2925-375b-4b3b-a849-d5d4b500f30a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:16.031300 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48881c3b-09b7-49b5-8040-52b44eb3c3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:16.032005 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48881c3b-09b7-49b5-8040-52b44eb3c3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:16.032285 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48881c3b-09b7-49b5-8040-52b44eb3c3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:16.032608 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48881c3b-09b7-49b5-8040-52b44eb3c3c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:16.033415 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48881c3b-09b7-49b5-8040-52b44eb3c3c1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:16.033815 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48881c3b-09b7-49b5-8040-52b44eb3c3c1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:16.035845 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48881c3b-09b7-49b5-8040-52b44eb3c3c1 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:16.050285 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 390/783] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:25:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:16.057654 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebf0a8-c4ee-4f2f-8a92-7dd509b76cbd admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:16.069051 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebf0a8-c4ee-4f2f-8a92-7dd509b76cbd admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:16.074212 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1371b8e-29bb-4197-ac70-4d0aeed0b0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:16.075253 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1371b8e-29bb-4197-ac70-4d0aeed0b0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:16.075708 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1371b8e-29bb-4197-ac70-4d0aeed0b0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:16.076196 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1371b8e-29bb-4197-ac70-4d0aeed0b0b4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:16.077305 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1371b8e-29bb-4197-ac70-4d0aeed0b0b4 admin admin] RBAC: Adding query filter params (role.id=9108081ba69a4a18b558b93fe7521387, scope.project.id=b433200db4784bfeadca48d24212e823, user.id=62cc0165aee14b449c8a49233001f631) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:16.077801 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1371b8e-29bb-4197-ac70-4d0aeed0b0b4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:16.079994 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1371b8e-29bb-4197-ac70-4d0aeed0b0b4 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:16.086654 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 394/784] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:25:16 2021] GET /identity/v3/role_assignments?user.id=62cc0165aee14b449c8a49233001f631&scope.project.id=b433200db4784bfeadca48d24212e823&role.id=9108081ba69a4a18b558b93fe7521387 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:16.791023 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d95f9-522c-4106-8a27-3438ee59889f None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:16.791559 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d95f9-522c-4106-8a27-3438ee59889f None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:16.791559 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d95f9-522c-4106-8a27-3438ee59889f None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:16.793571 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 391/785] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:16.799846 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76caeae-e9be-4f33-9df0-41015bd5bbc5 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:16.800284 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76caeae-e9be-4f33-9df0-41015bd5bbc5 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:16.800359 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76caeae-e9be-4f33-9df0-41015bd5bbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:16.818659 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-a76caeae-e9be-4f33-9df0-41015bd5bbc5 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:16.819864 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a76caeae-e9be-4f33-9df0-41015bd5bbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:16.827960 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 395/786] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:16 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:16.851721 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d95f9-522c-4106-8a27-3438ee59889f None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:16.864183 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d95f9-522c-4106-8a27-3438ee59889f None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:16.868625 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1b24d-304e-4cf0-a7ab-f98c5c92db04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:16.869545 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1b24d-304e-4cf0-a7ab-f98c5c92db04 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:16.869823 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1b24d-304e-4cf0-a7ab-f98c5c92db04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:16.870092 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1b24d-304e-4cf0-a7ab-f98c5c92db04 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:16.870782 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1b24d-304e-4cf0-a7ab-f98c5c92db04 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:16.872374 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1b24d-304e-4cf0-a7ab-f98c5c92db04 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:16.883765 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-1ae1b24d-304e-4cf0-a7ab-f98c5c92db04 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 14:25:16.885440 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 392/787] 10.222.0.79 () {56 vars in 1153 bytes} [Thu Oct 28 14:25:16 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:16.891975 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76caeae-e9be-4f33-9df0-41015bd5bbc5 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:16.901713 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76caeae-e9be-4f33-9df0-41015bd5bbc5 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:16.906542 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4156a-8051-427d-8e9b-4ca4e65b148f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:16.907422 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4156a-8051-427d-8e9b-4ca4e65b148f admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:16.907839 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4156a-8051-427d-8e9b-4ca4e65b148f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:16.908241 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4156a-8051-427d-8e9b-4ca4e65b148f admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:16.909104 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4156a-8051-427d-8e9b-4ca4e65b148f admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:16.909540 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4156a-8051-427d-8e9b-4ca4e65b148f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:16.911320 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4156a-8051-427d-8e9b-4ca4e65b148f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:16.916953 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 396/788] 10.222.0.79 () {56 vars in 1147 bytes} [Thu Oct 28 14:25:16 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:16.923427 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1b24d-304e-4cf0-a7ab-f98c5c92db04 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:16.934170 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1b24d-304e-4cf0-a7ab-f98c5c92db04 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:16.938930 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6a568-07af-4e5e-b4d9-729f32782457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:16.939771 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6a568-07af-4e5e-b4d9-729f32782457 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:16.940193 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6a568-07af-4e5e-b4d9-729f32782457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:16.940600 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6a568-07af-4e5e-b4d9-729f32782457 admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:16.941467 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6a568-07af-4e5e-b4d9-729f32782457 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:16.941920 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6a568-07af-4e5e-b4d9-729f32782457 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:16.943669 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6a568-07af-4e5e-b4d9-729f32782457 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:16.949558 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 393/789] 10.222.0.79 () {56 vars in 1147 bytes} [Thu Oct 28 14:25:16 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:16.956045 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4156a-8051-427d-8e9b-4ca4e65b148f admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:16.966370 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4156a-8051-427d-8e9b-4ca4e65b148f admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:16.970916 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbde2f4-349a-4d82-8537-d5acf426ea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:16.971581 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbde2f4-349a-4d82-8537-d5acf426ea39 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:16.971860 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbde2f4-349a-4d82-8537-d5acf426ea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:16.972133 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbde2f4-349a-4d82-8537-d5acf426ea39 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:16.972943 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbde2f4-349a-4d82-8537-d5acf426ea39 admin admin] RBAC: Adding query filter params (interface=public, service_id=8ab45468b3d0488aa238c0639f7cfa46, region_id=RegionOne) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:16.973252 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbde2f4-349a-4d82-8537-d5acf426ea39 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:16.974269 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING py.warnings [None req-9cbde2f4-349a-4d82-8537-d5acf426ea39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:25:16.974269 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: warnings.warn(msg) Oct 28 14:25:16.974269 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: Oct 28 14:25:16.975168 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbde2f4-349a-4d82-8537-d5acf426ea39 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:16.983652 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 397/790] 10.222.0.79 () {56 vars in 1272 bytes} [Thu Oct 28 14:25:16 2021] GET /identity/v3/endpoints?service_id=8ab45468b3d0488aa238c0639f7cfa46&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:16.989582 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6a568-07af-4e5e-b4d9-729f32782457 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:17.004229 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6a568-07af-4e5e-b4d9-729f32782457 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:17.009270 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42245b-bd01-474d-b2de-73c1631a2333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:17.010296 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42245b-bd01-474d-b2de-73c1631a2333 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:17.010819 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42245b-bd01-474d-b2de-73c1631a2333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:17.011299 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42245b-bd01-474d-b2de-73c1631a2333 admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:17.012320 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42245b-bd01-474d-b2de-73c1631a2333 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:17.014173 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42245b-bd01-474d-b2de-73c1631a2333 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:17.020456 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 394/791] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Oct 28 14:25:16 2021] GET /identity/v3/services => generated 1029 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:25:17.269355 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acede002-da2e-4d74-884f-63f09168a35f None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:17.269669 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acede002-da2e-4d74-884f-63f09168a35f None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:17.270055 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acede002-da2e-4d74-884f-63f09168a35f None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:17.272176 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 398/792] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:17.278887 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196c3a7-1d35-4036-bbf1-bbe19596db8a None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:17.279453 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196c3a7-1d35-4036-bbf1-bbe19596db8a None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:17.279929 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196c3a7-1d35-4036-bbf1-bbe19596db8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:17.298240 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-7196c3a7-1d35-4036-bbf1-bbe19596db8a None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:17.299770 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-7196c3a7-1d35-4036-bbf1-bbe19596db8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:17.311275 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 395/793] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:17 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:17.338269 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acede002-da2e-4d74-884f-63f09168a35f None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:17.351464 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acede002-da2e-4d74-884f-63f09168a35f None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:17.356232 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d58d4-02d1-4f03-8dd2-70859addc37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:17.357268 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d58d4-02d1-4f03-8dd2-70859addc37d admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:17.357745 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d58d4-02d1-4f03-8dd2-70859addc37d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:17.358211 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d58d4-02d1-4f03-8dd2-70859addc37d admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:17.359123 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d58d4-02d1-4f03-8dd2-70859addc37d admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:17.360916 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d58d4-02d1-4f03-8dd2-70859addc37d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:17.372824 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-d97d58d4-02d1-4f03-8dd2-70859addc37d admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 14:25:17.374601 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 399/794] 10.222.0.79 () {56 vars in 1147 bytes} [Thu Oct 28 14:25:17 2021] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:17.382701 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196c3a7-1d35-4036-bbf1-bbe19596db8a None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:17.388374 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c6e01-2942-4b51-91d5-2aafb2799939 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:17.388659 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c6e01-2942-4b51-91d5-2aafb2799939 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:17.388934 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c6e01-2942-4b51-91d5-2aafb2799939 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:17.391599 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196c3a7-1d35-4036-bbf1-bbe19596db8a None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:17.392036 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 400/795] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 14:25:17.396439 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0c7bb-dda8-4930-81f1-79bc62e7dced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:17.396703 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f2147-94e4-49a2-b622-85138a7fc7ed None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:17.396998 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f2147-94e4-49a2-b622-85138a7fc7ed None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:17.397272 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f2147-94e4-49a2-b622-85138a7fc7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:17.397518 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0c7bb-dda8-4930-81f1-79bc62e7dced admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:17.397888 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0c7bb-dda8-4930-81f1-79bc62e7dced admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:17.398340 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0c7bb-dda8-4930-81f1-79bc62e7dced admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:17.399319 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0c7bb-dda8-4930-81f1-79bc62e7dced admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:17.399812 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0c7bb-dda8-4930-81f1-79bc62e7dced admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:17.401997 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0c7bb-dda8-4930-81f1-79bc62e7dced admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:17.407684 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 396/796] 10.222.0.79 () {56 vars in 1143 bytes} [Thu Oct 28 14:25:17 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:17.414825 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0c7bb-dda8-4930-81f1-79bc62e7dced admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:17.418332 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-bd3f2147-94e4-49a2-b622-85138a7fc7ed None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:17.419563 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-bd3f2147-94e4-49a2-b622-85138a7fc7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:17.425321 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0c7bb-dda8-4930-81f1-79bc62e7dced admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:17.430640 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f25591-f78b-4340-8d5e-dfc2de788bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:17.431508 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f25591-f78b-4340-8d5e-dfc2de788bbb admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:17.431933 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f25591-f78b-4340-8d5e-dfc2de788bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:17.432299 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f25591-f78b-4340-8d5e-dfc2de788bbb admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:17.433116 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f25591-f78b-4340-8d5e-dfc2de788bbb admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:17.433536 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f25591-f78b-4340-8d5e-dfc2de788bbb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:17.434799 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 401/797] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:17 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:25:17.435340 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f25591-f78b-4340-8d5e-dfc2de788bbb admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:17.440619 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 397/798] 10.222.0.79 () {56 vars in 1143 bytes} [Thu Oct 28 14:25:17 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:25:17.454453 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f2147-94e4-49a2-b622-85138a7fc7ed None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:17.464720 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f2147-94e4-49a2-b622-85138a7fc7ed None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:17.469581 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b048cc-1e5e-4df4-bf2a-f2efe630945d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:17.470274 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b048cc-1e5e-4df4-bf2a-f2efe630945d admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:17.470556 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b048cc-1e5e-4df4-bf2a-f2efe630945d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:17.471002 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b048cc-1e5e-4df4-bf2a-f2efe630945d admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:17.471781 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b048cc-1e5e-4df4-bf2a-f2efe630945d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:17.473433 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b048cc-1e5e-4df4-bf2a-f2efe630945d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:17.494902 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 402/799] 10.222.0.79 () {60 vars in 1162 bytes} [Thu Oct 28 14:25:17 2021] POST /identity/v3/services => generated 251 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:25:18.415304 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd38a0-4176-441e-bb02-1bb83b12460c None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:18.416008 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd38a0-4176-441e-bb02-1bb83b12460c None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:18.416008 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd38a0-4176-441e-bb02-1bb83b12460c None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:18.417932 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 398/800] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:18.424085 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b027cc-719e-465e-add8-a02270b44e92 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:18.424608 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b027cc-719e-465e-add8-a02270b44e92 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:18.424608 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b027cc-719e-465e-add8-a02270b44e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:18.443085 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-a0b027cc-719e-465e-add8-a02270b44e92 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:18.444278 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a0b027cc-719e-465e-add8-a02270b44e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:18.461131 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 403/801] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:18 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:25:18.486939 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd38a0-4176-441e-bb02-1bb83b12460c None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:18.499468 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd38a0-4176-441e-bb02-1bb83b12460c None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:18.503885 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d009339-3ea3-4aa5-a51d-0a52fdccb5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:18.504693 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d009339-3ea3-4aa5-a51d-0a52fdccb5ff admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:18.504971 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d009339-3ea3-4aa5-a51d-0a52fdccb5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:18.505243 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d009339-3ea3-4aa5-a51d-0a52fdccb5ff admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:18.515950 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d009339-3ea3-4aa5-a51d-0a52fdccb5ff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:25:18.523214 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-5d009339-3ea3-4aa5-a51d-0a52fdccb5ff admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 14:25:18.524719 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 399/802] 10.222.0.79 () {56 vars in 1141 bytes} [Thu Oct 28 14:25:18 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:18.531221 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b027cc-719e-465e-add8-a02270b44e92 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:18.540300 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b027cc-719e-465e-add8-a02270b44e92 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:18.544869 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32006735-5581-44fb-8e60-4fd0eaeb8c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:18.545536 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32006735-5581-44fb-8e60-4fd0eaeb8c16 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:18.545814 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32006735-5581-44fb-8e60-4fd0eaeb8c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:18.546085 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32006735-5581-44fb-8e60-4fd0eaeb8c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:18.546880 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32006735-5581-44fb-8e60-4fd0eaeb8c16 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:18.547180 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32006735-5581-44fb-8e60-4fd0eaeb8c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:18.548764 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32006735-5581-44fb-8e60-4fd0eaeb8c16 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:18.557713 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 404/803] 10.222.0.79 () {56 vars in 1136 bytes} [Thu Oct 28 14:25:18 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:18.564012 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d009339-3ea3-4aa5-a51d-0a52fdccb5ff admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:18.576396 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d009339-3ea3-4aa5-a51d-0a52fdccb5ff admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:18.581281 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6164a8-c89b-4444-b76c-43b204768e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:18.582421 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6164a8-c89b-4444-b76c-43b204768e6b admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:18.582928 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6164a8-c89b-4444-b76c-43b204768e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:18.583407 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6164a8-c89b-4444-b76c-43b204768e6b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:18.594430 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6164a8-c89b-4444-b76c-43b204768e6b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:18.596573 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6164a8-c89b-4444-b76c-43b204768e6b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:18.613734 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-6b6164a8-c89b-4444-b76c-43b204768e6b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:18.615530 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 400/804] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:18.622031 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32006735-5581-44fb-8e60-4fd0eaeb8c16 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:18.632241 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32006735-5581-44fb-8e60-4fd0eaeb8c16 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:18.637023 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced31655-d464-4688-8658-1d3d746cfa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:18.637943 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced31655-d464-4688-8658-1d3d746cfa63 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:18.638432 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced31655-d464-4688-8658-1d3d746cfa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:18.638931 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced31655-d464-4688-8658-1d3d746cfa63 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:18.639871 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced31655-d464-4688-8658-1d3d746cfa63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:18.640402 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced31655-d464-4688-8658-1d3d746cfa63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:18.642303 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced31655-d464-4688-8658-1d3d746cfa63 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:18.657312 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 405/805] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:18.664230 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6164a8-c89b-4444-b76c-43b204768e6b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:18.674845 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6164a8-c89b-4444-b76c-43b204768e6b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:18.680195 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779227b9-99d9-45f4-a0d6-f08d2f2bae49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:18.681384 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779227b9-99d9-45f4-a0d6-f08d2f2bae49 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:18.681861 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779227b9-99d9-45f4-a0d6-f08d2f2bae49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:18.682328 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779227b9-99d9-45f4-a0d6-f08d2f2bae49 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:18.690339 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779227b9-99d9-45f4-a0d6-f08d2f2bae49 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:18.692699 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779227b9-99d9-45f4-a0d6-f08d2f2bae49 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:18.707418 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-779227b9-99d9-45f4-a0d6-f08d2f2bae49 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 14:25:18.709177 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 401/806] 10.222.0.79 () {56 vars in 1138 bytes} [Thu Oct 28 14:25:18 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:18.715757 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced31655-d464-4688-8658-1d3d746cfa63 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:18.726293 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced31655-d464-4688-8658-1d3d746cfa63 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:18.731025 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa27bc-aacf-4ea7-8bda-be2bc05d386e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:18.731704 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa27bc-aacf-4ea7-8bda-be2bc05d386e admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:18.731980 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa27bc-aacf-4ea7-8bda-be2bc05d386e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:18.732252 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa27bc-aacf-4ea7-8bda-be2bc05d386e admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:18.733121 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa27bc-aacf-4ea7-8bda-be2bc05d386e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:18.733422 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa27bc-aacf-4ea7-8bda-be2bc05d386e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:18.735352 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa27bc-aacf-4ea7-8bda-be2bc05d386e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:18.755821 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 406/807] 10.222.0.79 () {56 vars in 1170 bytes} [Thu Oct 28 14:25:18 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:18.762182 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779227b9-99d9-45f4-a0d6-f08d2f2bae49 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:18.772932 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779227b9-99d9-45f4-a0d6-f08d2f2bae49 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:18.778012 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c590b8-a4d1-4e4f-9985-5b71a09f1e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:18.779119 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c590b8-a4d1-4e4f-9985-5b71a09f1e59 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:18.779596 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c590b8-a4d1-4e4f-9985-5b71a09f1e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:18.780059 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c590b8-a4d1-4e4f-9985-5b71a09f1e59 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:18.791505 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c590b8-a4d1-4e4f-9985-5b71a09f1e59 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:18.793631 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c590b8-a4d1-4e4f-9985-5b71a09f1e59 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:18.811577 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-90c590b8-a4d1-4e4f-9985-5b71a09f1e59 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:18.813468 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 402/808] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:18.820088 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa27bc-aacf-4ea7-8bda-be2bc05d386e admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:18.830309 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa27bc-aacf-4ea7-8bda-be2bc05d386e admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:18.835245 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2751c5-51cf-4642-9e3c-30bf0c9b73e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:18.836206 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2751c5-51cf-4642-9e3c-30bf0c9b73e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:18.836683 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2751c5-51cf-4642-9e3c-30bf0c9b73e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:18.837209 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2751c5-51cf-4642-9e3c-30bf0c9b73e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:18.838208 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2751c5-51cf-4642-9e3c-30bf0c9b73e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:18.838749 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2751c5-51cf-4642-9e3c-30bf0c9b73e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:18.840583 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2751c5-51cf-4642-9e3c-30bf0c9b73e4 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:18.853305 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 407/809] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:18.859900 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c590b8-a4d1-4e4f-9985-5b71a09f1e59 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:18.870473 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c590b8-a4d1-4e4f-9985-5b71a09f1e59 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:18.875632 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99288d-4b69-4669-b3f0-4c0882ca94d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:18.876718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99288d-4b69-4669-b3f0-4c0882ca94d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:18.877194 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99288d-4b69-4669-b3f0-4c0882ca94d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:18.877703 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99288d-4b69-4669-b3f0-4c0882ca94d6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:18.885591 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99288d-4b69-4669-b3f0-4c0882ca94d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:18.887898 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99288d-4b69-4669-b3f0-4c0882ca94d6 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:18.907157 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-6e99288d-4b69-4669-b3f0-4c0882ca94d6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:25:18.908926 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 403/810] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:25:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:18.915571 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2751c5-51cf-4642-9e3c-30bf0c9b73e4 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:18.931939 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2751c5-51cf-4642-9e3c-30bf0c9b73e4 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:18.937088 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730834c-8acc-4158-ac00-2cbb42c4e3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:18.937995 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730834c-8acc-4158-ac00-2cbb42c4e3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:18.938514 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730834c-8acc-4158-ac00-2cbb42c4e3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:18.939013 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730834c-8acc-4158-ac00-2cbb42c4e3f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:18.940086 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730834c-8acc-4158-ac00-2cbb42c4e3f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:18.940588 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730834c-8acc-4158-ac00-2cbb42c4e3f7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:18.942835 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730834c-8acc-4158-ac00-2cbb42c4e3f7 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:18.956084 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 408/811] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:25:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:18.963019 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99288d-4b69-4669-b3f0-4c0882ca94d6 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:18.974981 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99288d-4b69-4669-b3f0-4c0882ca94d6 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:18.979974 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c33d9-a8e8-427c-a8aa-c66b0a463749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:18.981115 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c33d9-a8e8-427c-a8aa-c66b0a463749 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:18.981590 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c33d9-a8e8-427c-a8aa-c66b0a463749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:18.982101 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c33d9-a8e8-427c-a8aa-c66b0a463749 admin admin] PATH_INFO: `/v3/projects/b433200db4784bfeadca48d24212e823/users/62cc0165aee14b449c8a49233001f631/roles/9108081ba69a4a18b558b93fe7521387` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:18.984592 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c33d9-a8e8-427c-a8aa-c66b0a463749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b433200db4784bfeadca48d24212e823, user_id=62cc0165aee14b449c8a49233001f631, role_id=9108081ba69a4a18b558b93fe7521387)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:18.987578 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c33d9-a8e8-427c-a8aa-c66b0a463749 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:19.003863 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 404/812] 10.222.0.79 () {58 vars in 1460 bytes} [Thu Oct 28 14:25:18 2021] PUT /identity/v3/projects/b433200db4784bfeadca48d24212e823/users/62cc0165aee14b449c8a49233001f631/roles/9108081ba69a4a18b558b93fe7521387 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:25:19.396741 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3857e-9791-4b2c-aa23-9b4132849b70 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:19.396920 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3857e-9791-4b2c-aa23-9b4132849b70 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:19.397207 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3857e-9791-4b2c-aa23-9b4132849b70 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:19.399396 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 409/813] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:19.405698 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc7134-7714-4ed7-9695-9d5609ede50f None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:19.405989 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc7134-7714-4ed7-9695-9d5609ede50f None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:19.406262 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc7134-7714-4ed7-9695-9d5609ede50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:19.424038 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-fdfc7134-7714-4ed7-9695-9d5609ede50f None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:19.425293 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-fdfc7134-7714-4ed7-9695-9d5609ede50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:19.487159 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 405/814] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:19 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:19.510958 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3857e-9791-4b2c-aa23-9b4132849b70 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:19.523645 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3857e-9791-4b2c-aa23-9b4132849b70 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:19.528033 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e424f70-961e-49a0-b8a9-b912eaadda4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:19.528850 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e424f70-961e-49a0-b8a9-b912eaadda4d admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:19.529129 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e424f70-961e-49a0-b8a9-b912eaadda4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:19.529403 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e424f70-961e-49a0-b8a9-b912eaadda4d admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:19.530072 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e424f70-961e-49a0-b8a9-b912eaadda4d admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:19.531703 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e424f70-961e-49a0-b8a9-b912eaadda4d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:19.543297 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-1e424f70-961e-49a0-b8a9-b912eaadda4d admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 14:25:19.544792 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 410/815] 10.222.0.79 () {56 vars in 1153 bytes} [Thu Oct 28 14:25:19 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:19.551864 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc7134-7714-4ed7-9695-9d5609ede50f None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:19.561061 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc7134-7714-4ed7-9695-9d5609ede50f None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:19.565638 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75d8e5-fb33-4fa4-bc7f-ae731250f3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:19.566300 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75d8e5-fb33-4fa4-bc7f-ae731250f3db admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:19.566579 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75d8e5-fb33-4fa4-bc7f-ae731250f3db admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:19.566880 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75d8e5-fb33-4fa4-bc7f-ae731250f3db admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:19.567604 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75d8e5-fb33-4fa4-bc7f-ae731250f3db admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:19.567907 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75d8e5-fb33-4fa4-bc7f-ae731250f3db admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:19.569504 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75d8e5-fb33-4fa4-bc7f-ae731250f3db admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:19.574638 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 406/816] 10.222.0.79 () {56 vars in 1147 bytes} [Thu Oct 28 14:25:19 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:19.580762 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e424f70-961e-49a0-b8a9-b912eaadda4d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:19.590982 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e424f70-961e-49a0-b8a9-b912eaadda4d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:19.595960 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e47c04-5685-4435-a164-e9ac56a4d028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:19.596900 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e47c04-5685-4435-a164-e9ac56a4d028 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:19.597379 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e47c04-5685-4435-a164-e9ac56a4d028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:19.597911 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e47c04-5685-4435-a164-e9ac56a4d028 admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:19.598883 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e47c04-5685-4435-a164-e9ac56a4d028 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:19.599451 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e47c04-5685-4435-a164-e9ac56a4d028 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:19.601494 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e47c04-5685-4435-a164-e9ac56a4d028 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:19.607093 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 411/817] 10.222.0.79 () {56 vars in 1147 bytes} [Thu Oct 28 14:25:19 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:19.613571 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75d8e5-fb33-4fa4-bc7f-ae731250f3db admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:19.626038 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75d8e5-fb33-4fa4-bc7f-ae731250f3db admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:19.631243 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f97b8-7827-41dc-93d4-d6851f2c6d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:19.632716 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f97b8-7827-41dc-93d4-d6851f2c6d62 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:19.633307 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f97b8-7827-41dc-93d4-d6851f2c6d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:19.633786 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f97b8-7827-41dc-93d4-d6851f2c6d62 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:19.634903 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f97b8-7827-41dc-93d4-d6851f2c6d62 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:19.636252 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING py.warnings [None req-8a1f97b8-7827-41dc-93d4-d6851f2c6d62 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:25:19.636252 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: warnings.warn(msg) Oct 28 14:25:19.636252 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: Oct 28 14:25:19.637565 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f97b8-7827-41dc-93d4-d6851f2c6d62 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:19.664287 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 407/818] 10.222.0.79 () {60 vars in 1165 bytes} [Thu Oct 28 14:25:19 2021] POST /identity/v3/endpoints => generated 347 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:25:19.788156 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446b969-9d86-4451-863e-d21b3fb30dab None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:19.788635 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446b969-9d86-4451-863e-d21b3fb30dab None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:19.788818 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446b969-9d86-4451-863e-d21b3fb30dab None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:19.790901 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 412/819] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:19.797425 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744415d-3726-4f4a-93ae-49d3515e2813 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:19.797732 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744415d-3726-4f4a-93ae-49d3515e2813 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:19.798098 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744415d-3726-4f4a-93ae-49d3515e2813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:19.817628 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-e744415d-3726-4f4a-93ae-49d3515e2813 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:19.818883 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e744415d-3726-4f4a-93ae-49d3515e2813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:19.837280 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 408/820] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:19 2021] POST /identity/v3/auth/tokens => generated 2003 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:19.856055 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab107d83-550c-4c4b-a27d-3f802334de44 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:19.856395 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab107d83-550c-4c4b-a27d-3f802334de44 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:19.856604 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab107d83-550c-4c4b-a27d-3f802334de44 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:19.858710 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 413/821] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:19.861200 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744415d-3726-4f4a-93ae-49d3515e2813 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:19.864991 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d714d2-8a30-4a5a-b56c-065610423980 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:19.865269 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d714d2-8a30-4a5a-b56c-065610423980 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:19.865679 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d714d2-8a30-4a5a-b56c-065610423980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:19.870777 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744415d-3726-4f4a-93ae-49d3515e2813 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:19.876817 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a8e07-f758-4a7c-a9fb-bb3b8a85916b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:19.877509 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a8e07-f758-4a7c-a9fb-bb3b8a85916b admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:19.877783 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a8e07-f758-4a7c-a9fb-bb3b8a85916b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:19.878046 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a8e07-f758-4a7c-a9fb-bb3b8a85916b admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:19.878862 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a8e07-f758-4a7c-a9fb-bb3b8a85916b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:19.879955 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING py.warnings [None req-400a8e07-f758-4a7c-a9fb-bb3b8a85916b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:25:19.879955 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: warnings.warn(msg) Oct 28 14:25:19.879955 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: Oct 28 14:25:19.881513 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a8e07-f758-4a7c-a9fb-bb3b8a85916b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:19.886393 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-30d714d2-8a30-4a5a-b56c-065610423980 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:19.887698 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-30d714d2-8a30-4a5a-b56c-065610423980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:19.900137 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 414/822] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:19 2021] POST /identity/v3/auth/tokens => generated 2003 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:25:19.904084 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 409/823] 10.222.0.79 () {60 vars in 1162 bytes} [Thu Oct 28 14:25:19 2021] POST /identity/v3/services => generated 241 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:25:19.924080 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d714d2-8a30-4a5a-b56c-065610423980 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:19.934650 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d714d2-8a30-4a5a-b56c-065610423980 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:19.950952 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe03f6-1bf9-4a52-aa11-bef166711b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:19.951769 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe03f6-1bf9-4a52-aa11-bef166711b26 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:19.952041 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe03f6-1bf9-4a52-aa11-bef166711b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:19.952307 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe03f6-1bf9-4a52-aa11-bef166711b26 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:19.952979 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe03f6-1bf9-4a52-aa11-bef166711b26 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:19.954603 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe03f6-1bf9-4a52-aa11-bef166711b26 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:19.966555 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-50fe03f6-1bf9-4a52-aa11-bef166711b26 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 14:25:19.968168 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 415/824] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Oct 28 14:25:19 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:19.975136 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a8e07-f758-4a7c-a9fb-bb3b8a85916b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:19.986902 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a8e07-f758-4a7c-a9fb-bb3b8a85916b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:19.991379 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9787637-5163-42a9-81c6-9b2ea1b15c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:19.992122 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9787637-5163-42a9-81c6-9b2ea1b15c29 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:19.992398 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9787637-5163-42a9-81c6-9b2ea1b15c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:19.992669 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9787637-5163-42a9-81c6-9b2ea1b15c29 admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:19.993415 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9787637-5163-42a9-81c6-9b2ea1b15c29 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:19.993713 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9787637-5163-42a9-81c6-9b2ea1b15c29 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:19.995554 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9787637-5163-42a9-81c6-9b2ea1b15c29 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:20.001397 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 410/825] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Oct 28 14:25:19 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:20.008040 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe03f6-1bf9-4a52-aa11-bef166711b26 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:20.018477 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe03f6-1bf9-4a52-aa11-bef166711b26 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:20.023466 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094cbce7-3d9a-45e2-ba1e-01941610bff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:20.024152 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094cbce7-3d9a-45e2-ba1e-01941610bff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:20.024478 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094cbce7-3d9a-45e2-ba1e-01941610bff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:20.024760 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094cbce7-3d9a-45e2-ba1e-01941610bff9 admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:20.025661 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094cbce7-3d9a-45e2-ba1e-01941610bff9 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:20.025959 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094cbce7-3d9a-45e2-ba1e-01941610bff9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:20.027640 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094cbce7-3d9a-45e2-ba1e-01941610bff9 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:20.033688 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 416/826] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Oct 28 14:25:20 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:20.040465 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9787637-5163-42a9-81c6-9b2ea1b15c29 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:20.051990 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9787637-5163-42a9-81c6-9b2ea1b15c29 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:20.057168 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da6a75-4cf1-4007-981c-c2ecade23763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:20.058226 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da6a75-4cf1-4007-981c-c2ecade23763 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:20.058747 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da6a75-4cf1-4007-981c-c2ecade23763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:20.059208 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da6a75-4cf1-4007-981c-c2ecade23763 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:20.060260 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da6a75-4cf1-4007-981c-c2ecade23763 admin admin] RBAC: Adding query filter params (interface=public, service_id=f2dd861d7a8540ab992a289251de28a1, region_id=RegionOne) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:20.060788 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da6a75-4cf1-4007-981c-c2ecade23763 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:20.062605 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da6a75-4cf1-4007-981c-c2ecade23763 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:20.069213 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 411/827] 10.222.0.79 () {56 vars in 1272 bytes} [Thu Oct 28 14:25:20 2021] GET /identity/v3/endpoints?service_id=f2dd861d7a8540ab992a289251de28a1&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:20.076047 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094cbce7-3d9a-45e2-ba1e-01941610bff9 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:20.088889 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094cbce7-3d9a-45e2-ba1e-01941610bff9 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:20.094044 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f85509-0eca-4f78-8385-ea8f1a514594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:20.095103 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f85509-0eca-4f78-8385-ea8f1a514594 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:20.095602 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f85509-0eca-4f78-8385-ea8f1a514594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:20.096072 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f85509-0eca-4f78-8385-ea8f1a514594 admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:20.097021 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f85509-0eca-4f78-8385-ea8f1a514594 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:20.098993 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f85509-0eca-4f78-8385-ea8f1a514594 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:20.106645 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 417/828] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Oct 28 14:25:20 2021] GET /identity/v3/services => generated 1497 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:25:21.343584 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c3c66-5ea0-417c-aab7-2ccd2ffcfcf1 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:21.344175 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c3c66-5ea0-417c-aab7-2ccd2ffcfcf1 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:21.344175 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c3c66-5ea0-417c-aab7-2ccd2ffcfcf1 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:21.346219 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 412/829] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:21.352328 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9facce6-3cfc-45d3-ad4a-187c86ddca7e None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:21.352747 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9facce6-3cfc-45d3-ad4a-187c86ddca7e None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:21.352939 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9facce6-3cfc-45d3-ad4a-187c86ddca7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:21.370620 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-a9facce6-3cfc-45d3-ad4a-187c86ddca7e None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:21.371861 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a9facce6-3cfc-45d3-ad4a-187c86ddca7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:21.383763 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 418/830] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:21 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:21.405347 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c3c66-5ea0-417c-aab7-2ccd2ffcfcf1 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:21.417959 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c3c66-5ea0-417c-aab7-2ccd2ffcfcf1 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:21.422353 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca1291-15b3-41ee-9604-366f7d1c7632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:21.423194 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca1291-15b3-41ee-9604-366f7d1c7632 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:21.423472 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca1291-15b3-41ee-9604-366f7d1c7632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:21.423746 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca1291-15b3-41ee-9604-366f7d1c7632 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:21.435869 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca1291-15b3-41ee-9604-366f7d1c7632 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:25:21.443543 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-9aca1291-15b3-41ee-9604-366f7d1c7632 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 14:25:21.445376 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 413/831] 10.222.0.79 () {56 vars in 1141 bytes} [Thu Oct 28 14:25:21 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:21.451894 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9facce6-3cfc-45d3-ad4a-187c86ddca7e None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:21.461218 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9facce6-3cfc-45d3-ad4a-187c86ddca7e None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:21.465915 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8037660-bab3-409a-95fc-45764afadd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:21.466588 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8037660-bab3-409a-95fc-45764afadd9b admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:21.466900 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8037660-bab3-409a-95fc-45764afadd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:21.467175 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8037660-bab3-409a-95fc-45764afadd9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:21.467931 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8037660-bab3-409a-95fc-45764afadd9b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:21.468233 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8037660-bab3-409a-95fc-45764afadd9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:21.469816 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8037660-bab3-409a-95fc-45764afadd9b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:21.479044 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 419/832] 10.222.0.79 () {56 vars in 1136 bytes} [Thu Oct 28 14:25:21 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:21.487002 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca1291-15b3-41ee-9604-366f7d1c7632 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:21.498103 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca1291-15b3-41ee-9604-366f7d1c7632 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:21.502809 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62b97f-45d4-42df-bcf6-79b168aa8c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:21.503612 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62b97f-45d4-42df-bcf6-79b168aa8c53 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:21.503926 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62b97f-45d4-42df-bcf6-79b168aa8c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:21.504262 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62b97f-45d4-42df-bcf6-79b168aa8c53 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:21.515697 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62b97f-45d4-42df-bcf6-79b168aa8c53 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:21.517556 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62b97f-45d4-42df-bcf6-79b168aa8c53 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:21.534916 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-7c62b97f-45d4-42df-bcf6-79b168aa8c53 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:21.541580 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 414/833] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:21.542972 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8037660-bab3-409a-95fc-45764afadd9b admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:21.553190 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8037660-bab3-409a-95fc-45764afadd9b admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:21.558139 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124c009-2b2d-4639-9ae7-b87630f294fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:21.558835 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124c009-2b2d-4639-9ae7-b87630f294fe admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:21.559160 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124c009-2b2d-4639-9ae7-b87630f294fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:21.559478 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124c009-2b2d-4639-9ae7-b87630f294fe admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:21.560221 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124c009-2b2d-4639-9ae7-b87630f294fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:21.560526 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124c009-2b2d-4639-9ae7-b87630f294fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:21.562165 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124c009-2b2d-4639-9ae7-b87630f294fe admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:21.578809 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 420/834] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:21.580858 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62b97f-45d4-42df-bcf6-79b168aa8c53 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:21.590995 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62b97f-45d4-42df-bcf6-79b168aa8c53 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:21.595802 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735e912-2aca-4e44-a71f-020fd1e479b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:21.596608 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e912-2aca-4e44-a71f-020fd1e479b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:21.596891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e912-2aca-4e44-a71f-020fd1e479b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:21.597485 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e912-2aca-4e44-a71f-020fd1e479b4 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:21.605482 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735e912-2aca-4e44-a71f-020fd1e479b4 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:21.607602 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735e912-2aca-4e44-a71f-020fd1e479b4 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:21.622420 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-1735e912-2aca-4e44-a71f-020fd1e479b4 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 14:25:21.623947 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 415/835] 10.222.0.79 () {56 vars in 1138 bytes} [Thu Oct 28 14:25:21 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:25:21.630253 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124c009-2b2d-4639-9ae7-b87630f294fe admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:21.640431 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124c009-2b2d-4639-9ae7-b87630f294fe admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:21.645790 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae270b-36a3-4ab2-92af-eee94ded9d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:21.646844 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae270b-36a3-4ab2-92af-eee94ded9d24 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:21.647127 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae270b-36a3-4ab2-92af-eee94ded9d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:21.647401 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae270b-36a3-4ab2-92af-eee94ded9d24 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:21.648521 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae270b-36a3-4ab2-92af-eee94ded9d24 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:21.648911 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae270b-36a3-4ab2-92af-eee94ded9d24 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:21.651037 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae270b-36a3-4ab2-92af-eee94ded9d24 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:21.674592 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 421/836] 10.222.0.79 () {56 vars in 1170 bytes} [Thu Oct 28 14:25:21 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:21.676373 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735e912-2aca-4e44-a71f-020fd1e479b4 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:21.686794 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735e912-2aca-4e44-a71f-020fd1e479b4 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:21.691769 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcc6fc-386b-44f7-81b9-38335debd256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:21.692688 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcc6fc-386b-44f7-81b9-38335debd256 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:21.693197 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcc6fc-386b-44f7-81b9-38335debd256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:21.693687 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcc6fc-386b-44f7-81b9-38335debd256 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:21.702466 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dcc6fc-386b-44f7-81b9-38335debd256 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:21.704550 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dcc6fc-386b-44f7-81b9-38335debd256 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:21.714287 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 416/837] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:25:21 2021] GET /identity/v3/auth/tokens => generated 2105 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:25:21.720555 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae270b-36a3-4ab2-92af-eee94ded9d24 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:21.734572 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae270b-36a3-4ab2-92af-eee94ded9d24 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:21.739271 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e5460-0a3a-404d-a054-569e2e2c5b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:21.740081 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e5460-0a3a-404d-a054-569e2e2c5b83 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:21.740360 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e5460-0a3a-404d-a054-569e2e2c5b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:21.740632 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e5460-0a3a-404d-a054-569e2e2c5b83 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:21.751582 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e5460-0a3a-404d-a054-569e2e2c5b83 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:21.753410 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e5460-0a3a-404d-a054-569e2e2c5b83 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:21.770180 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-983e5460-0a3a-404d-a054-569e2e2c5b83 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:21.771728 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 422/838] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:21.777879 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcc6fc-386b-44f7-81b9-38335debd256 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:21.789690 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcc6fc-386b-44f7-81b9-38335debd256 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:21.795900 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d1cd0-747a-41e8-8d6d-cf184cef9254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:21.796579 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d1cd0-747a-41e8-8d6d-cf184cef9254 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:21.796864 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d1cd0-747a-41e8-8d6d-cf184cef9254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:21.797140 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d1cd0-747a-41e8-8d6d-cf184cef9254 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:21.797884 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d1cd0-747a-41e8-8d6d-cf184cef9254 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:21.798190 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d1cd0-747a-41e8-8d6d-cf184cef9254 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:21.799869 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d1cd0-747a-41e8-8d6d-cf184cef9254 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:21.813514 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 417/839] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:21.820272 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e5460-0a3a-404d-a054-569e2e2c5b83 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:21.831043 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e5460-0a3a-404d-a054-569e2e2c5b83 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:21.836060 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5183e77-c2dd-43a7-85d4-09000b35d2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:21.837186 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5183e77-c2dd-43a7-85d4-09000b35d2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:21.837682 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5183e77-c2dd-43a7-85d4-09000b35d2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:21.838213 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5183e77-c2dd-43a7-85d4-09000b35d2c9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:21.846305 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5183e77-c2dd-43a7-85d4-09000b35d2c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:21.848598 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5183e77-c2dd-43a7-85d4-09000b35d2c9 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:21.862787 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-a5183e77-c2dd-43a7-85d4-09000b35d2c9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:25:21.869957 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 423/840] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:25:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:21.871580 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d1cd0-747a-41e8-8d6d-cf184cef9254 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:21.881916 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d1cd0-747a-41e8-8d6d-cf184cef9254 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:21.887369 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97722c79-ae8a-404a-b223-2b76a9b47f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:21.888345 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97722c79-ae8a-404a-b223-2b76a9b47f97 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:21.888831 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97722c79-ae8a-404a-b223-2b76a9b47f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:21.889317 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97722c79-ae8a-404a-b223-2b76a9b47f97 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:21.890348 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97722c79-ae8a-404a-b223-2b76a9b47f97 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:21.890948 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97722c79-ae8a-404a-b223-2b76a9b47f97 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:21.893063 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97722c79-ae8a-404a-b223-2b76a9b47f97 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:21.911640 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 418/841] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:25:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:21.915332 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5183e77-c2dd-43a7-85d4-09000b35d2c9 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:21.929152 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5183e77-c2dd-43a7-85d4-09000b35d2c9 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:21.934826 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11458e-97aa-486f-af20-8fe11d007940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:21.935944 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11458e-97aa-486f-af20-8fe11d007940 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:21.936439 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11458e-97aa-486f-af20-8fe11d007940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:21.936947 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11458e-97aa-486f-af20-8fe11d007940 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:21.938030 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11458e-97aa-486f-af20-8fe11d007940 admin admin] RBAC: Adding query filter params (role.id=9108081ba69a4a18b558b93fe7521387, scope.project.id=b433200db4784bfeadca48d24212e823, user.id=62cc0165aee14b449c8a49233001f631) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:21.938587 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11458e-97aa-486f-af20-8fe11d007940 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:21.940740 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11458e-97aa-486f-af20-8fe11d007940 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:21.951869 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 424/842] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:25:21 2021] GET /identity/v3/role_assignments?user.id=62cc0165aee14b449c8a49233001f631&scope.project.id=b433200db4784bfeadca48d24212e823&role.id=9108081ba69a4a18b558b93fe7521387 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:22.068316 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880e503-a60b-4d7e-a18c-b72e3494078d None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:22.068664 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880e503-a60b-4d7e-a18c-b72e3494078d None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:22.068877 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880e503-a60b-4d7e-a18c-b72e3494078d None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:22.071078 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 419/843] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:22.077469 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e727909-2fba-4547-81e8-1055321d4ac5 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:22.078007 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e727909-2fba-4547-81e8-1055321d4ac5 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:22.078467 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e727909-2fba-4547-81e8-1055321d4ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:22.097915 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-0e727909-2fba-4547-81e8-1055321d4ac5 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:22.099188 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-0e727909-2fba-4547-81e8-1055321d4ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:22.108166 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 425/844] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:22 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:22.132571 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880e503-a60b-4d7e-a18c-b72e3494078d None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:22.147066 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880e503-a60b-4d7e-a18c-b72e3494078d None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:22.152811 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86baa313-f4ce-4558-9575-83ebec3268f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:22.154100 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baa313-f4ce-4558-9575-83ebec3268f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:22.154629 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baa313-f4ce-4558-9575-83ebec3268f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:22.155170 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baa313-f4ce-4558-9575-83ebec3268f2 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:22.156108 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86baa313-f4ce-4558-9575-83ebec3268f2 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:22.158021 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86baa313-f4ce-4558-9575-83ebec3268f2 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:22.170501 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-86baa313-f4ce-4558-9575-83ebec3268f2 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 14:25:22.172582 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 420/845] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:25:22 2021] GET /identity/v3/services/compute => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:22.180132 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e727909-2fba-4547-81e8-1055321d4ac5 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:22.191946 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e727909-2fba-4547-81e8-1055321d4ac5 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:22.197076 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85f8cc-23c2-4b4e-9c92-fc4550c39dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:22.197989 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85f8cc-23c2-4b4e-9c92-fc4550c39dab admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:22.198513 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85f8cc-23c2-4b4e-9c92-fc4550c39dab admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:22.199029 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85f8cc-23c2-4b4e-9c92-fc4550c39dab admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:22.199962 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85f8cc-23c2-4b4e-9c92-fc4550c39dab admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:22.200460 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85f8cc-23c2-4b4e-9c92-fc4550c39dab admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:22.202232 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85f8cc-23c2-4b4e-9c92-fc4550c39dab admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:22.207892 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 426/846] 10.222.0.79 () {56 vars in 1133 bytes} [Thu Oct 28 14:25:22 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:22.214789 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86baa313-f4ce-4558-9575-83ebec3268f2 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:22.225324 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86baa313-f4ce-4558-9575-83ebec3268f2 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:22.231613 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80678c3-3847-4b20-95ee-235e78739f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:22.232287 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80678c3-3847-4b20-95ee-235e78739f68 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:22.232569 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80678c3-3847-4b20-95ee-235e78739f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:22.232842 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80678c3-3847-4b20-95ee-235e78739f68 admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:22.233572 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80678c3-3847-4b20-95ee-235e78739f68 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:22.233877 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80678c3-3847-4b20-95ee-235e78739f68 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:22.235514 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80678c3-3847-4b20-95ee-235e78739f68 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:22.240563 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 421/847] 10.222.0.79 () {56 vars in 1133 bytes} [Thu Oct 28 14:25:22 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:22.265068 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d68c3-e058-4e71-8c93-9c5d9cef20cd None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:22.265360 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d68c3-e058-4e71-8c93-9c5d9cef20cd None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:22.265620 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d68c3-e058-4e71-8c93-9c5d9cef20cd None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:22.267778 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 427/848] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:22.274500 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569ad32-d4a5-4ec6-88f2-ed3924dfacd3 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:22.274805 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569ad32-d4a5-4ec6-88f2-ed3924dfacd3 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:22.275085 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569ad32-d4a5-4ec6-88f2-ed3924dfacd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:22.294530 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-3569ad32-d4a5-4ec6-88f2-ed3924dfacd3 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:22.295785 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-3569ad32-d4a5-4ec6-88f2-ed3924dfacd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:22.304991 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 422/849] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:22 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:22.329845 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d68c3-e058-4e71-8c93-9c5d9cef20cd None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:22.343378 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d68c3-e058-4e71-8c93-9c5d9cef20cd None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:22.348556 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d5e0f-b6c2-4a51-86f1-d3d27966eb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:22.349410 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d5e0f-b6c2-4a51-86f1-d3d27966eb38 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:22.349691 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d5e0f-b6c2-4a51-86f1-d3d27966eb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:22.349964 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d5e0f-b6c2-4a51-86f1-d3d27966eb38 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:22.350673 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d5e0f-b6c2-4a51-86f1-d3d27966eb38 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:22.352536 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d5e0f-b6c2-4a51-86f1-d3d27966eb38 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:22.365404 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-9e9d5e0f-b6c2-4a51-86f1-d3d27966eb38 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 14:25:22.367244 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 428/850] 10.222.0.79 () {56 vars in 1147 bytes} [Thu Oct 28 14:25:22 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:22.374665 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569ad32-d4a5-4ec6-88f2-ed3924dfacd3 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:22.385104 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569ad32-d4a5-4ec6-88f2-ed3924dfacd3 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:22.390360 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c19af-e635-4e7f-8cde-cace03f0888e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:22.391197 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c19af-e635-4e7f-8cde-cace03f0888e admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:22.391594 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c19af-e635-4e7f-8cde-cace03f0888e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:22.391937 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c19af-e635-4e7f-8cde-cace03f0888e admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:22.392780 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c19af-e635-4e7f-8cde-cace03f0888e admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:22.393162 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c19af-e635-4e7f-8cde-cace03f0888e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:22.394936 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c19af-e635-4e7f-8cde-cace03f0888e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:22.400925 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 423/851] 10.222.0.79 () {56 vars in 1143 bytes} [Thu Oct 28 14:25:22 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:22.407614 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d5e0f-b6c2-4a51-86f1-d3d27966eb38 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:22.418582 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d5e0f-b6c2-4a51-86f1-d3d27966eb38 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:22.423806 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30544e-91ce-4bd5-b82e-6306081b3085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:22.424617 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30544e-91ce-4bd5-b82e-6306081b3085 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:22.424897 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30544e-91ce-4bd5-b82e-6306081b3085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:22.425223 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30544e-91ce-4bd5-b82e-6306081b3085 admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:22.426384 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30544e-91ce-4bd5-b82e-6306081b3085 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:22.426720 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30544e-91ce-4bd5-b82e-6306081b3085 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:22.428402 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30544e-91ce-4bd5-b82e-6306081b3085 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:22.434612 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 429/852] 10.222.0.79 () {56 vars in 1143 bytes} [Thu Oct 28 14:25:22 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:22.441508 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c19af-e635-4e7f-8cde-cace03f0888e admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:22.452694 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c19af-e635-4e7f-8cde-cace03f0888e admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:22.457740 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f0669-4745-4d5e-883d-67d28092c3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:22.458428 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f0669-4745-4d5e-883d-67d28092c3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:22.458797 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f0669-4745-4d5e-883d-67d28092c3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:22.459121 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f0669-4745-4d5e-883d-67d28092c3f1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:22.459988 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f0669-4745-4d5e-883d-67d28092c3f1 admin admin] RBAC: Adding query filter params (interface=public, service_id=9e7ab3b0c02041d7a9fb0a5c0d5a5a23, region_id=RegionOne) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:22.460298 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f0669-4745-4d5e-883d-67d28092c3f1 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:22.462145 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f0669-4745-4d5e-883d-67d28092c3f1 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:22.468630 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 424/853] 10.222.0.79 () {56 vars in 1272 bytes} [Thu Oct 28 14:25:22 2021] GET /identity/v3/endpoints?service_id=9e7ab3b0c02041d7a9fb0a5c0d5a5a23&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:25:22.475030 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30544e-91ce-4bd5-b82e-6306081b3085 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:22.485223 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30544e-91ce-4bd5-b82e-6306081b3085 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:22.490088 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41ea20-ed6d-4e87-9ae2-84e482f3150b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:22.490792 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41ea20-ed6d-4e87-9ae2-84e482f3150b admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:22.491071 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41ea20-ed6d-4e87-9ae2-84e482f3150b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:22.491344 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41ea20-ed6d-4e87-9ae2-84e482f3150b admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:22.492077 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41ea20-ed6d-4e87-9ae2-84e482f3150b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:22.493666 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41ea20-ed6d-4e87-9ae2-84e482f3150b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:22.500141 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 430/854] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Oct 28 14:25:22 2021] GET /identity/v3/services => generated 1497 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:25:22.519656 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea9044-be8a-401f-8b2b-9bf94a1d02d0 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:22.519994 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea9044-be8a-401f-8b2b-9bf94a1d02d0 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:22.520206 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea9044-be8a-401f-8b2b-9bf94a1d02d0 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:22.522416 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 425/855] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:22.529575 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94160d7f-14d0-47ed-8741-ac83a1035905 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:22.529871 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94160d7f-14d0-47ed-8741-ac83a1035905 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:22.530119 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94160d7f-14d0-47ed-8741-ac83a1035905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:22.550305 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-94160d7f-14d0-47ed-8741-ac83a1035905 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:22.551962 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-94160d7f-14d0-47ed-8741-ac83a1035905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:22.560307 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 431/856] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:22 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:22.585479 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea9044-be8a-401f-8b2b-9bf94a1d02d0 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:22.602080 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea9044-be8a-401f-8b2b-9bf94a1d02d0 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:22.606670 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03913358-be30-41fa-b689-7fe7eca15aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:22.607615 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03913358-be30-41fa-b689-7fe7eca15aab admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:22.607973 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03913358-be30-41fa-b689-7fe7eca15aab admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:22.608315 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03913358-be30-41fa-b689-7fe7eca15aab admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:22.609078 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03913358-be30-41fa-b689-7fe7eca15aab admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:22.610794 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03913358-be30-41fa-b689-7fe7eca15aab admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:22.623547 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-03913358-be30-41fa-b689-7fe7eca15aab admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 14:25:22.624831 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 426/857] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Oct 28 14:25:22 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:25:22.631745 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94160d7f-14d0-47ed-8741-ac83a1035905 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:22.641461 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94160d7f-14d0-47ed-8741-ac83a1035905 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:22.646240 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1aef40-cacf-4252-8e12-1e988c56c37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:22.647031 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1aef40-cacf-4252-8e12-1e988c56c37d admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:22.647317 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1aef40-cacf-4252-8e12-1e988c56c37d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:22.647593 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1aef40-cacf-4252-8e12-1e988c56c37d admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:22.648777 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1aef40-cacf-4252-8e12-1e988c56c37d admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:22.649203 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1aef40-cacf-4252-8e12-1e988c56c37d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:22.651086 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1aef40-cacf-4252-8e12-1e988c56c37d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:22.657067 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 432/858] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Oct 28 14:25:22 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:22.663598 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03913358-be30-41fa-b689-7fe7eca15aab admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:22.673883 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03913358-be30-41fa-b689-7fe7eca15aab admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:22.678951 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774043da-f797-4a0a-8cb1-d8b5c1778ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:22.679805 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774043da-f797-4a0a-8cb1-d8b5c1778ede admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:22.680089 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774043da-f797-4a0a-8cb1-d8b5c1778ede admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:22.680365 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774043da-f797-4a0a-8cb1-d8b5c1778ede admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:22.681122 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774043da-f797-4a0a-8cb1-d8b5c1778ede admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:22.681419 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774043da-f797-4a0a-8cb1-d8b5c1778ede admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:22.683094 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774043da-f797-4a0a-8cb1-d8b5c1778ede admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:22.689048 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 427/859] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Oct 28 14:25:22 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:22.695699 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1aef40-cacf-4252-8e12-1e988c56c37d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:22.706331 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1aef40-cacf-4252-8e12-1e988c56c37d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:22.711381 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008c49f-48a8-4935-9a96-ee3a37e87881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:22.712112 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008c49f-48a8-4935-9a96-ee3a37e87881 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:22.712402 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008c49f-48a8-4935-9a96-ee3a37e87881 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:22.712672 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008c49f-48a8-4935-9a96-ee3a37e87881 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:22.713505 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008c49f-48a8-4935-9a96-ee3a37e87881 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:22.715299 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008c49f-48a8-4935-9a96-ee3a37e87881 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:22.736988 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 433/860] 10.222.0.79 () {60 vars in 1165 bytes} [Thu Oct 28 14:25:22 2021] POST /identity/v3/endpoints => generated 346 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:25:24.364188 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a91c9-54d5-4219-890a-96f8e6fd1a99 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:24.364860 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a91c9-54d5-4219-890a-96f8e6fd1a99 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:24.364860 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a91c9-54d5-4219-890a-96f8e6fd1a99 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:24.366805 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 428/861] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:24.372836 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68273f99-cfb4-4372-a564-ba43ceca0c6c None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:24.373315 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68273f99-cfb4-4372-a564-ba43ceca0c6c None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:24.373471 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68273f99-cfb4-4372-a564-ba43ceca0c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:24.391024 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-68273f99-cfb4-4372-a564-ba43ceca0c6c None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:24.392206 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-68273f99-cfb4-4372-a564-ba43ceca0c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:24.408790 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 434/862] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:24 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:24.432875 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a91c9-54d5-4219-890a-96f8e6fd1a99 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:24.445834 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a91c9-54d5-4219-890a-96f8e6fd1a99 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:24.450447 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5b9e1-1d85-40db-b59e-428df4702659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:24.451388 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5b9e1-1d85-40db-b59e-428df4702659 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:24.451667 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5b9e1-1d85-40db-b59e-428df4702659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:24.451943 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5b9e1-1d85-40db-b59e-428df4702659 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:24.452625 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5b9e1-1d85-40db-b59e-428df4702659 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:24.454271 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5b9e1-1d85-40db-b59e-428df4702659 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:24.465866 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-71e5b9e1-1d85-40db-b59e-428df4702659 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 14:25:24.467444 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 429/863] 10.222.0.79 () {56 vars in 1126 bytes} [Thu Oct 28 14:25:24 2021] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:25:24.474125 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68273f99-cfb4-4372-a564-ba43ceca0c6c None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:24.483587 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68273f99-cfb4-4372-a564-ba43ceca0c6c None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:24.492481 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffe0b6-b6d6-4aea-8199-dac9cd360d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:24.493174 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffe0b6-b6d6-4aea-8199-dac9cd360d6c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:24.493448 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffe0b6-b6d6-4aea-8199-dac9cd360d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:24.493716 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffe0b6-b6d6-4aea-8199-dac9cd360d6c admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:24.494451 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffe0b6-b6d6-4aea-8199-dac9cd360d6c admin admin] RBAC: Adding query filter params (name=image) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:24.494788 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffe0b6-b6d6-4aea-8199-dac9cd360d6c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:24.496391 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffe0b6-b6d6-4aea-8199-dac9cd360d6c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:24.503286 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 435/864] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:24 2021] GET /identity/v3/services?name=image => generated 122 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:24.509376 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5b9e1-1d85-40db-b59e-428df4702659 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:24.520115 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5b9e1-1d85-40db-b59e-428df4702659 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:24.524828 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c78c87-ccb0-4a16-bd96-7256bd9d60ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:24.525489 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c78c87-ccb0-4a16-bd96-7256bd9d60ef admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:24.525765 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c78c87-ccb0-4a16-bd96-7256bd9d60ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:24.526037 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c78c87-ccb0-4a16-bd96-7256bd9d60ef admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:24.526798 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c78c87-ccb0-4a16-bd96-7256bd9d60ef admin admin] RBAC: Adding query filter params (type=image) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:24.527105 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c78c87-ccb0-4a16-bd96-7256bd9d60ef admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:24.528695 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c78c87-ccb0-4a16-bd96-7256bd9d60ef admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:24.534122 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 430/865] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:24 2021] GET /identity/v3/services?type=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:24.578923 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de162b-00ff-4598-a166-df6fcd992de8 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:24.579328 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de162b-00ff-4598-a166-df6fcd992de8 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:24.579672 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de162b-00ff-4598-a166-df6fcd992de8 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:24.581920 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 436/866] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:24.588558 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979f7e8-3ec4-45c7-b594-683a7a47153a None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:24.588822 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979f7e8-3ec4-45c7-b594-683a7a47153a None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:24.589099 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979f7e8-3ec4-45c7-b594-683a7a47153a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:24.608153 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-a979f7e8-3ec4-45c7-b594-683a7a47153a None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:24.609400 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-a979f7e8-3ec4-45c7-b594-683a7a47153a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:24.622989 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 431/867] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:24 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:24.644188 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de162b-00ff-4598-a166-df6fcd992de8 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:24.658295 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de162b-00ff-4598-a166-df6fcd992de8 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:24.663029 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb30fe-b646-4e3e-b975-56a9a63dd52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:24.663776 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb30fe-b646-4e3e-b975-56a9a63dd52d admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:24.664052 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb30fe-b646-4e3e-b975-56a9a63dd52d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:24.664372 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb30fe-b646-4e3e-b975-56a9a63dd52d admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:24.665081 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb30fe-b646-4e3e-b975-56a9a63dd52d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:24.666732 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb30fe-b646-4e3e-b975-56a9a63dd52d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:24.690952 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 437/868] 10.222.0.79 () {60 vars in 1162 bytes} [Thu Oct 28 14:25:24 2021] POST /identity/v3/services => generated 242 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:25:24.839619 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ad804-950b-477c-a358-9e8dcceebf5e None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:24.839958 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ad804-950b-477c-a358-9e8dcceebf5e None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:24.840233 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ad804-950b-477c-a358-9e8dcceebf5e None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:24.842442 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 432/869] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:24.848947 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2fbdc-960b-4780-aeef-08ef606e1979 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:24.849416 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2fbdc-960b-4780-aeef-08ef606e1979 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:24.849789 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2fbdc-960b-4780-aeef-08ef606e1979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:24.869448 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-97d2fbdc-960b-4780-aeef-08ef606e1979 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:24.871012 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-97d2fbdc-960b-4780-aeef-08ef606e1979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:24.889468 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 438/870] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:24 2021] POST /identity/v3/auth/tokens => generated 2387 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:24.914432 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ad804-950b-477c-a358-9e8dcceebf5e None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:24.929048 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ad804-950b-477c-a358-9e8dcceebf5e None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:24.934456 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193c266-52f3-45d8-a237-d114125822bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:24.935331 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193c266-52f3-45d8-a237-d114125822bd admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:24.935615 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193c266-52f3-45d8-a237-d114125822bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:24.935890 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193c266-52f3-45d8-a237-d114125822bd admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:24.936575 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193c266-52f3-45d8-a237-d114125822bd admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:24.938210 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193c266-52f3-45d8-a237-d114125822bd admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:24.952164 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-3193c266-52f3-45d8-a237-d114125822bd admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 14:25:24.953927 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 433/871] 10.222.0.79 () {56 vars in 1147 bytes} [Thu Oct 28 14:25:24 2021] GET /identity/v3/services/object-store => generated 93 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:24.961191 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2fbdc-960b-4780-aeef-08ef606e1979 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:24.971510 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2fbdc-960b-4780-aeef-08ef606e1979 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:24.976636 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3ec8c-6079-44bd-9925-c6f25df899d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:24.977392 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3ec8c-6079-44bd-9925-c6f25df899d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:24.977638 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3ec8c-6079-44bd-9925-c6f25df899d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:24.977918 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3ec8c-6079-44bd-9925-c6f25df899d6 admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:24.978765 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3ec8c-6079-44bd-9925-c6f25df899d6 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:24.979078 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3ec8c-6079-44bd-9925-c6f25df899d6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:24.980760 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3ec8c-6079-44bd-9925-c6f25df899d6 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:24.987108 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 439/872] 10.222.0.79 () {56 vars in 1143 bytes} [Thu Oct 28 14:25:24 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:25:24.993640 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193c266-52f3-45d8-a237-d114125822bd admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:25.004028 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193c266-52f3-45d8-a237-d114125822bd admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:25.008856 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f379f31-5107-4187-acbb-6baf64e798d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:25.009574 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f379f31-5107-4187-acbb-6baf64e798d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:25.009856 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f379f31-5107-4187-acbb-6baf64e798d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:25.010179 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f379f31-5107-4187-acbb-6baf64e798d5 admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:25.010977 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f379f31-5107-4187-acbb-6baf64e798d5 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:25.011286 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f379f31-5107-4187-acbb-6baf64e798d5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:25.012946 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f379f31-5107-4187-acbb-6baf64e798d5 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:25.018656 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 434/873] 10.222.0.79 () {56 vars in 1143 bytes} [Thu Oct 28 14:25:24 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:25:25.025089 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3ec8c-6079-44bd-9925-c6f25df899d6 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:25.036599 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3ec8c-6079-44bd-9925-c6f25df899d6 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:25.041667 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08bfb32-a4f6-400c-878c-aa07a84269df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:25.042571 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bfb32-a4f6-400c-878c-aa07a84269df admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:25.043081 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bfb32-a4f6-400c-878c-aa07a84269df admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:25.043529 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bfb32-a4f6-400c-878c-aa07a84269df admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:25.044483 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08bfb32-a4f6-400c-878c-aa07a84269df admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:25.046292 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08bfb32-a4f6-400c-878c-aa07a84269df admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:25.067436 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 440/874] 10.222.0.79 () {60 vars in 1165 bytes} [Thu Oct 28 14:25:25 2021] POST /identity/v3/endpoints => generated 349 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:25:25.097582 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f856f8f-06e4-42ff-92c7-a7affffe6998 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:25.098208 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f856f8f-06e4-42ff-92c7-a7affffe6998 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:25.098782 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f856f8f-06e4-42ff-92c7-a7affffe6998 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:25.101330 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 435/875] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:25 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:25.107531 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e6c03-6f16-40a4-aa2c-7a2696840429 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:25.107818 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e6c03-6f16-40a4-aa2c-7a2696840429 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:25.108087 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e6c03-6f16-40a4-aa2c-7a2696840429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:25.127235 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-341e6c03-6f16-40a4-aa2c-7a2696840429 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:25.128461 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-341e6c03-6f16-40a4-aa2c-7a2696840429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:25.147698 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 441/876] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:25 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:25.172917 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f856f8f-06e4-42ff-92c7-a7affffe6998 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:25.189944 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f856f8f-06e4-42ff-92c7-a7affffe6998 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:25.195176 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c25179-0593-4c69-83ba-9fd4cfa9bf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:25.196225 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c25179-0593-4c69-83ba-9fd4cfa9bf35 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:25.196717 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c25179-0593-4c69-83ba-9fd4cfa9bf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:25.197163 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c25179-0593-4c69-83ba-9fd4cfa9bf35 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:25.198139 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c25179-0593-4c69-83ba-9fd4cfa9bf35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:25.200355 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c25179-0593-4c69-83ba-9fd4cfa9bf35 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:25.202094 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.common [None req-09c25179-0593-4c69-83ba-9fd4cfa9bf35 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 28 14:25:25.223725 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.sql.core [None req-09c25179-0593-4c69-83ba-9fd4cfa9bf35 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 28 14:25:25.223725 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 14:25:25.223725 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [parameters: {'id': 'b316557124a9409b9a939fa76e777647', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 28 14:25:25.223725 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79414) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 14:25:25.241228 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-09c25179-0593-4c69-83ba-9fd4cfa9bf35 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b316557124a9409b9a939fa76e777647.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b316557124a9409b9a939fa76e777647. Oct 28 14:25:25.243490 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 436/877] 10.222.0.79 () {60 vars in 1161 bytes} [Thu Oct 28 14:25:25 2021] POST /identity/v3/projects => generated 262 bytes in 71 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:25.250649 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e6c03-6f16-40a4-aa2c-7a2696840429 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:25.260977 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e6c03-6f16-40a4-aa2c-7a2696840429 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:25.266116 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951d39b-004d-4497-a0da-9a93c661e34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:25.267205 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951d39b-004d-4497-a0da-9a93c661e34e admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:25.267691 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951d39b-004d-4497-a0da-9a93c661e34e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:25.268183 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951d39b-004d-4497-a0da-9a93c661e34e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:25.276406 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951d39b-004d-4497-a0da-9a93c661e34e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:25.278735 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951d39b-004d-4497-a0da-9a93c661e34e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:25.292942 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-f951d39b-004d-4497-a0da-9a93c661e34e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:25:25.294728 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 442/878] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:25:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:25.302024 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c25179-0593-4c69-83ba-9fd4cfa9bf35 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:25.313132 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c25179-0593-4c69-83ba-9fd4cfa9bf35 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:25.318056 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040117c-5281-4d78-945c-d924cf2071de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:25.318957 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040117c-5281-4d78-945c-d924cf2071de admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:25.319409 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040117c-5281-4d78-945c-d924cf2071de admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:25.319967 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040117c-5281-4d78-945c-d924cf2071de admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:25.320744 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040117c-5281-4d78-945c-d924cf2071de admin admin] RBAC: Adding query filter params (name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:25.321051 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040117c-5281-4d78-945c-d924cf2071de admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:25.323202 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040117c-5281-4d78-945c-d924cf2071de admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:25.345636 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 437/879] 10.222.0.79 () {56 vars in 1133 bytes} [Thu Oct 28 14:25:25 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:26.907982 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0556bf3-d60c-45dc-927d-a5232e9ae597 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:26.908442 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0556bf3-d60c-45dc-927d-a5232e9ae597 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:26.908518 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0556bf3-d60c-45dc-927d-a5232e9ae597 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:26.910302 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 443/880] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:26.916670 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb16a56-b231-48d3-984d-ddd7cb9b02cd None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:26.917116 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb16a56-b231-48d3-984d-ddd7cb9b02cd None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:26.917290 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb16a56-b231-48d3-984d-ddd7cb9b02cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:26.941990 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-dcb16a56-b231-48d3-984d-ddd7cb9b02cd None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:26.943664 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-dcb16a56-b231-48d3-984d-ddd7cb9b02cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:26.953140 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 438/881] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:26 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:26.977526 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0556bf3-d60c-45dc-927d-a5232e9ae597 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:26.990614 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0556bf3-d60c-45dc-927d-a5232e9ae597 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:26.995211 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e72e86-22f0-43bc-a965-6061d23ed849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:26.995870 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e72e86-22f0-43bc-a965-6061d23ed849 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:26.996154 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e72e86-22f0-43bc-a965-6061d23ed849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:26.996437 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e72e86-22f0-43bc-a965-6061d23ed849 admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:26.997184 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e72e86-22f0-43bc-a965-6061d23ed849 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:26.998801 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e72e86-22f0-43bc-a965-6061d23ed849 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:27.019092 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 444/882] 10.222.0.79 () {60 vars in 1162 bytes} [Thu Oct 28 14:25:26 2021] POST /identity/v3/services => generated 242 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:25:27.100722 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfb54a-99fb-48c6-8c9b-12b007fbdcf4 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:27.101504 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfb54a-99fb-48c6-8c9b-12b007fbdcf4 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:27.101989 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfb54a-99fb-48c6-8c9b-12b007fbdcf4 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:27.104124 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 439/883] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:27.111120 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f754c-a27d-49af-9186-f04c6f60e220 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:27.111761 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f754c-a27d-49af-9186-f04c6f60e220 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:27.112254 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f754c-a27d-49af-9186-f04c6f60e220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:27.130977 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-bc0f754c-a27d-49af-9186-f04c6f60e220 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:27.132640 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-bc0f754c-a27d-49af-9186-f04c6f60e220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:27.155148 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 445/884] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:27 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:27.176801 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfb54a-99fb-48c6-8c9b-12b007fbdcf4 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:27.190305 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfb54a-99fb-48c6-8c9b-12b007fbdcf4 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:27.195463 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56e5b0-3243-4ed4-95de-11c844a25997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:27.196679 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56e5b0-3243-4ed4-95de-11c844a25997 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:27.197181 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56e5b0-3243-4ed4-95de-11c844a25997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:27.197661 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56e5b0-3243-4ed4-95de-11c844a25997 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:27.198562 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56e5b0-3243-4ed4-95de-11c844a25997 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:27.200461 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56e5b0-3243-4ed4-95de-11c844a25997 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:27.212812 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-be56e5b0-3243-4ed4-95de-11c844a25997 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 14:25:27.218911 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 440/885] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:25:27 2021] GET /identity/v3/services/compute => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:27.222829 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f754c-a27d-49af-9186-f04c6f60e220 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:27.233388 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f754c-a27d-49af-9186-f04c6f60e220 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:27.239384 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f33162-d76c-4071-9599-9648736cb88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:27.240433 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f33162-d76c-4071-9599-9648736cb88c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:27.240913 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f33162-d76c-4071-9599-9648736cb88c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:27.241415 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f33162-d76c-4071-9599-9648736cb88c admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:27.242460 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f33162-d76c-4071-9599-9648736cb88c admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:27.242998 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f33162-d76c-4071-9599-9648736cb88c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:27.244847 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f33162-d76c-4071-9599-9648736cb88c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:27.254768 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 446/886] 10.222.0.79 () {56 vars in 1133 bytes} [Thu Oct 28 14:25:27 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:27.257660 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56e5b0-3243-4ed4-95de-11c844a25997 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:27.268425 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56e5b0-3243-4ed4-95de-11c844a25997 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:27.273108 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616eee5-096a-4dbe-ada8-cdd6be36dbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:27.273832 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616eee5-096a-4dbe-ada8-cdd6be36dbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:27.274114 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616eee5-096a-4dbe-ada8-cdd6be36dbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:27.274386 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616eee5-096a-4dbe-ada8-cdd6be36dbf7 admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:27.275148 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616eee5-096a-4dbe-ada8-cdd6be36dbf7 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:27.275452 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616eee5-096a-4dbe-ada8-cdd6be36dbf7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:27.277050 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616eee5-096a-4dbe-ada8-cdd6be36dbf7 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:27.282652 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 441/887] 10.222.0.79 () {56 vars in 1133 bytes} [Thu Oct 28 14:25:27 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:27.290062 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f33162-d76c-4071-9599-9648736cb88c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:27.301149 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f33162-d76c-4071-9599-9648736cb88c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:27.305865 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74dac7-0887-43cd-ba11-8e33efff672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:27.306535 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74dac7-0887-43cd-ba11-8e33efff672c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:27.306881 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74dac7-0887-43cd-ba11-8e33efff672c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:27.307156 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74dac7-0887-43cd-ba11-8e33efff672c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:27.307966 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74dac7-0887-43cd-ba11-8e33efff672c admin admin] RBAC: Adding query filter params (interface=public, service_id=f8c7c8d062a14de1be7efec6afaf9775, region_id=RegionOne) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:27.308279 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74dac7-0887-43cd-ba11-8e33efff672c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:27.309882 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74dac7-0887-43cd-ba11-8e33efff672c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:27.320887 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 447/888] 10.222.0.79 () {56 vars in 1272 bytes} [Thu Oct 28 14:25:27 2021] GET /identity/v3/endpoints?service_id=f8c7c8d062a14de1be7efec6afaf9775&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:27.322298 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616eee5-096a-4dbe-ada8-cdd6be36dbf7 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:27.332402 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616eee5-096a-4dbe-ada8-cdd6be36dbf7 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:27.337062 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da574af-3b1f-4986-92ab-059cc6177f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:27.337732 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da574af-3b1f-4986-92ab-059cc6177f88 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:27.338014 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da574af-3b1f-4986-92ab-059cc6177f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:27.338290 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da574af-3b1f-4986-92ab-059cc6177f88 admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:27.339022 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da574af-3b1f-4986-92ab-059cc6177f88 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:27.340640 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da574af-3b1f-4986-92ab-059cc6177f88 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:27.354839 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 442/889] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Oct 28 14:25:27 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:25:27.360732 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ccde8-bf1e-4ce4-b4f5-775cb8e4c8bd None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:27.361046 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ccde8-bf1e-4ce4-b4f5-775cb8e4c8bd None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:27.361287 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ccde8-bf1e-4ce4-b4f5-775cb8e4c8bd None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:27.363219 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 448/890] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:27.370085 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdaa69f-558b-48e0-875d-341fe68610b7 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:27.370456 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdaa69f-558b-48e0-875d-341fe68610b7 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:27.370844 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdaa69f-558b-48e0-875d-341fe68610b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:27.396614 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-ccdaa69f-558b-48e0-875d-341fe68610b7 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:27.397903 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-ccdaa69f-558b-48e0-875d-341fe68610b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:27.406589 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 443/891] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:27 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:27.430779 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ccde8-bf1e-4ce4-b4f5-775cb8e4c8bd None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:27.443743 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ccde8-bf1e-4ce4-b4f5-775cb8e4c8bd None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:27.449128 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96743e-3f2b-4014-9b8d-65686e6732e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:27.450004 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96743e-3f2b-4014-9b8d-65686e6732e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:27.450273 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96743e-3f2b-4014-9b8d-65686e6732e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:27.450583 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96743e-3f2b-4014-9b8d-65686e6732e9 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:27.451291 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96743e-3f2b-4014-9b8d-65686e6732e9 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:27.453020 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96743e-3f2b-4014-9b8d-65686e6732e9 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:27.465460 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-2f96743e-3f2b-4014-9b8d-65686e6732e9 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 14:25:27.467166 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 449/892] 10.222.0.79 () {56 vars in 1147 bytes} [Thu Oct 28 14:25:27 2021] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:27.474111 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdaa69f-558b-48e0-875d-341fe68610b7 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:27.483778 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdaa69f-558b-48e0-875d-341fe68610b7 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:27.488529 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2e54b-bba5-4e36-95f3-4511cba1813f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:27.489260 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2e54b-bba5-4e36-95f3-4511cba1813f admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:27.489534 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2e54b-bba5-4e36-95f3-4511cba1813f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:27.489799 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2e54b-bba5-4e36-95f3-4511cba1813f admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:27.490584 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2e54b-bba5-4e36-95f3-4511cba1813f admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:27.490931 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2e54b-bba5-4e36-95f3-4511cba1813f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:27.492758 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2e54b-bba5-4e36-95f3-4511cba1813f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:27.499098 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 444/893] 10.222.0.79 () {56 vars in 1143 bytes} [Thu Oct 28 14:25:27 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:27.505834 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96743e-3f2b-4014-9b8d-65686e6732e9 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:27.516483 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96743e-3f2b-4014-9b8d-65686e6732e9 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:27.521380 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af285b84-9e4f-407a-8d06-1f8e264dd81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:27.522114 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af285b84-9e4f-407a-8d06-1f8e264dd81d admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:27.522392 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af285b84-9e4f-407a-8d06-1f8e264dd81d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:27.522749 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af285b84-9e4f-407a-8d06-1f8e264dd81d admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:27.523484 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af285b84-9e4f-407a-8d06-1f8e264dd81d admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:27.523786 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af285b84-9e4f-407a-8d06-1f8e264dd81d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:27.525700 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af285b84-9e4f-407a-8d06-1f8e264dd81d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:27.532705 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 450/894] 10.222.0.79 () {56 vars in 1143 bytes} [Thu Oct 28 14:25:27 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:27.539049 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2e54b-bba5-4e36-95f3-4511cba1813f admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:27.550241 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2e54b-bba5-4e36-95f3-4511cba1813f admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:27.555769 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b378d56-f479-43d4-8cb6-61708f4cc672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:27.556605 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b378d56-f479-43d4-8cb6-61708f4cc672 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:27.556925 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b378d56-f479-43d4-8cb6-61708f4cc672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:27.557207 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b378d56-f479-43d4-8cb6-61708f4cc672 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:27.558294 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b378d56-f479-43d4-8cb6-61708f4cc672 admin admin] RBAC: Adding query filter params (interface=admin, service_id=9e7ab3b0c02041d7a9fb0a5c0d5a5a23, region_id=RegionOne) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:27.558487 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b378d56-f479-43d4-8cb6-61708f4cc672 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:27.560241 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b378d56-f479-43d4-8cb6-61708f4cc672 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:27.566850 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 445/895] 10.222.0.79 () {56 vars in 1270 bytes} [Thu Oct 28 14:25:27 2021] GET /identity/v3/endpoints?service_id=9e7ab3b0c02041d7a9fb0a5c0d5a5a23&interface=admin®ion_id=RegionOne => generated 193 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:27.573701 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af285b84-9e4f-407a-8d06-1f8e264dd81d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:27.584208 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af285b84-9e4f-407a-8d06-1f8e264dd81d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:27.589744 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dec0ca-8a07-40d2-9bdd-8d86f1e92a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:27.590470 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dec0ca-8a07-40d2-9bdd-8d86f1e92a4c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:27.590784 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dec0ca-8a07-40d2-9bdd-8d86f1e92a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:27.591056 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dec0ca-8a07-40d2-9bdd-8d86f1e92a4c admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:27.591805 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dec0ca-8a07-40d2-9bdd-8d86f1e92a4c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:27.593462 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dec0ca-8a07-40d2-9bdd-8d86f1e92a4c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:27.601170 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 451/896] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Oct 28 14:25:27 2021] GET /identity/v3/services => generated 1957 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:25:27.700442 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce123dc-4ca8-4bf4-a707-8353bf25f984 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:27.700619 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce123dc-4ca8-4bf4-a707-8353bf25f984 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:27.700869 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce123dc-4ca8-4bf4-a707-8353bf25f984 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:27.703031 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 446/897] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:27.709962 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697f9ab-d978-48c5-aa68-2806eaf92ea0 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:27.710696 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697f9ab-d978-48c5-aa68-2806eaf92ea0 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:27.711330 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697f9ab-d978-48c5-aa68-2806eaf92ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:27.731799 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-3697f9ab-d978-48c5-aa68-2806eaf92ea0 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:27.733509 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-3697f9ab-d978-48c5-aa68-2806eaf92ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:27.746848 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 452/898] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:27 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:25:27.770563 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce123dc-4ca8-4bf4-a707-8353bf25f984 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:27.784311 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce123dc-4ca8-4bf4-a707-8353bf25f984 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:27.789616 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14bda93-db0f-422a-b42f-71e93308742c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:27.790697 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14bda93-db0f-422a-b42f-71e93308742c admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:27.791274 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14bda93-db0f-422a-b42f-71e93308742c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:27.791751 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14bda93-db0f-422a-b42f-71e93308742c admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:27.792751 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14bda93-db0f-422a-b42f-71e93308742c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:27.794946 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14bda93-db0f-422a-b42f-71e93308742c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:27.810167 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.sql.core [None req-e14bda93-db0f-422a-b42f-71e93308742c admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 28 14:25:27.810167 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 28 14:25:27.810167 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [parameters: {'user_id': '714cda4a6a8d498d9fdb13896a68dff4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 28 14:25:27.810167 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79414) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 14:25:27.817517 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-e14bda93-db0f-422a-b42f-71e93308742c admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 28 14:25:27.822812 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 447/899] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:25:27 2021] POST /identity/v3/users => generated 160 bytes in 49 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:27.826812 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697f9ab-d978-48c5-aa68-2806eaf92ea0 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:27.836909 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697f9ab-d978-48c5-aa68-2806eaf92ea0 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:27.841763 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266e198-3997-42ab-abeb-275aae2cddb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:27.842637 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266e198-3997-42ab-abeb-275aae2cddb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:27.843048 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266e198-3997-42ab-abeb-275aae2cddb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:27.843434 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266e198-3997-42ab-abeb-275aae2cddb9 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:27.850993 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266e198-3997-42ab-abeb-275aae2cddb9 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:27.853132 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266e198-3997-42ab-abeb-275aae2cddb9 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:27.867354 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-0266e198-3997-42ab-abeb-275aae2cddb9 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 14:25:27.869827 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 453/900] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:25:27 2021] GET /identity/v3/users/cinder => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:25:27.875614 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14bda93-db0f-422a-b42f-71e93308742c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:27.886775 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14bda93-db0f-422a-b42f-71e93308742c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:27.891649 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64c6ab-0072-4b3d-a097-5595a5379b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:27.892324 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64c6ab-0072-4b3d-a097-5595a5379b02 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:27.892599 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64c6ab-0072-4b3d-a097-5595a5379b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:27.892922 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64c6ab-0072-4b3d-a097-5595a5379b02 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:27.893742 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64c6ab-0072-4b3d-a097-5595a5379b02 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:27.894114 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64c6ab-0072-4b3d-a097-5595a5379b02 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:27.896310 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64c6ab-0072-4b3d-a097-5595a5379b02 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:27.942879 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 448/901] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Oct 28 14:25:27 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:29.396652 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05187aea-a575-4509-b16d-983e1499cb48 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:29.397180 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05187aea-a575-4509-b16d-983e1499cb48 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:29.397467 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05187aea-a575-4509-b16d-983e1499cb48 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:29.400256 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 454/902] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:29 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:29.408210 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d458c82-f9ae-4c43-a67a-fe34a0715cf0 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:29.408683 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d458c82-f9ae-4c43-a67a-fe34a0715cf0 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:29.408787 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d458c82-f9ae-4c43-a67a-fe34a0715cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:29.429995 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-5d458c82-f9ae-4c43-a67a-fe34a0715cf0 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:29.431537 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-5d458c82-f9ae-4c43-a67a-fe34a0715cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:29.440115 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 449/903] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:29 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:29.464116 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05187aea-a575-4509-b16d-983e1499cb48 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:29.476425 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05187aea-a575-4509-b16d-983e1499cb48 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:29.480696 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb9ad4-d7f3-45e3-8d3a-a42ce8a83506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:29.481488 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb9ad4-d7f3-45e3-8d3a-a42ce8a83506 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:29.481762 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb9ad4-d7f3-45e3-8d3a-a42ce8a83506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:29.482029 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb9ad4-d7f3-45e3-8d3a-a42ce8a83506 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:29.482721 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb9ad4-d7f3-45e3-8d3a-a42ce8a83506 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:29.484299 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb9ad4-d7f3-45e3-8d3a-a42ce8a83506 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:29.495012 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-c9cb9ad4-d7f3-45e3-8d3a-a42ce8a83506 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 14:25:29.497670 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 455/904] 10.222.0.79 () {56 vars in 1126 bytes} [Thu Oct 28 14:25:29 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:29.502927 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d458c82-f9ae-4c43-a67a-fe34a0715cf0 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:29.511946 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d458c82-f9ae-4c43-a67a-fe34a0715cf0 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:29.516359 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cb392-b95a-402f-8c71-3c73506f701b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:29.517018 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cb392-b95a-402f-8c71-3c73506f701b admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:29.517295 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cb392-b95a-402f-8c71-3c73506f701b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:29.517565 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cb392-b95a-402f-8c71-3c73506f701b admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:29.518286 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10cb392-b95a-402f-8c71-3c73506f701b admin admin] RBAC: Adding query filter params (name=image) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:29.518589 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10cb392-b95a-402f-8c71-3c73506f701b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:29.520201 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10cb392-b95a-402f-8c71-3c73506f701b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:29.530287 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 450/905] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:29 2021] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:29.531495 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb9ad4-d7f3-45e3-8d3a-a42ce8a83506 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:29.541471 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb9ad4-d7f3-45e3-8d3a-a42ce8a83506 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:29.548046 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41acd9c-e704-4a53-860d-42d4363146f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:29.548046 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41acd9c-e704-4a53-860d-42d4363146f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:29.548046 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41acd9c-e704-4a53-860d-42d4363146f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:29.548046 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41acd9c-e704-4a53-860d-42d4363146f2 admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:29.548862 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41acd9c-e704-4a53-860d-42d4363146f2 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:29.549250 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41acd9c-e704-4a53-860d-42d4363146f2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:29.551362 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41acd9c-e704-4a53-860d-42d4363146f2 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:29.557735 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 456/906] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:29 2021] GET /identity/v3/services?type=image => generated 350 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:29.564437 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cb392-b95a-402f-8c71-3c73506f701b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:29.575452 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cb392-b95a-402f-8c71-3c73506f701b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:29.581444 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ef0c9-7388-407e-96fa-cf618636033c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:29.582126 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ef0c9-7388-407e-96fa-cf618636033c admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:29.582377 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ef0c9-7388-407e-96fa-cf618636033c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:29.582668 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ef0c9-7388-407e-96fa-cf618636033c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:29.583534 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ef0c9-7388-407e-96fa-cf618636033c admin admin] RBAC: Adding query filter params (interface=public, service_id=28784acd89834185a649de3694d6307d, region_id=RegionOne) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:29.583840 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ef0c9-7388-407e-96fa-cf618636033c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:29.585530 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ef0c9-7388-407e-96fa-cf618636033c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:29.591796 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 451/907] 10.222.0.79 () {56 vars in 1272 bytes} [Thu Oct 28 14:25:29 2021] GET /identity/v3/endpoints?service_id=28784acd89834185a649de3694d6307d&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:29.597926 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41acd9c-e704-4a53-860d-42d4363146f2 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:29.608008 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41acd9c-e704-4a53-860d-42d4363146f2 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:29.612917 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918faf6-1abf-4d17-9701-afb28a242a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:29.613569 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918faf6-1abf-4d17-9701-afb28a242a0d admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:29.613805 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918faf6-1abf-4d17-9701-afb28a242a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:29.614101 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918faf6-1abf-4d17-9701-afb28a242a0d admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:29.614827 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918faf6-1abf-4d17-9701-afb28a242a0d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:29.616436 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918faf6-1abf-4d17-9701-afb28a242a0d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:29.623264 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 457/908] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Oct 28 14:25:29 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:25:29.703065 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d71cd6-4fca-4744-9aac-5371865b78d1 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:29.703441 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d71cd6-4fca-4744-9aac-5371865b78d1 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:29.703674 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d71cd6-4fca-4744-9aac-5371865b78d1 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:29.705569 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 452/909] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:29.712490 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa522e-2508-4cec-8bd3-37630e5188f6 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:29.712820 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa522e-2508-4cec-8bd3-37630e5188f6 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:29.713039 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa522e-2508-4cec-8bd3-37630e5188f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:29.732400 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-05aa522e-2508-4cec-8bd3-37630e5188f6 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:29.733626 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-05aa522e-2508-4cec-8bd3-37630e5188f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:29.742549 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 458/910] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:29 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:29.766895 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d71cd6-4fca-4744-9aac-5371865b78d1 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:29.782379 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d71cd6-4fca-4744-9aac-5371865b78d1 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:29.788063 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2686bc-f772-4a9b-9547-49baa783ea4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:29.788953 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2686bc-f772-4a9b-9547-49baa783ea4a admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:29.789221 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2686bc-f772-4a9b-9547-49baa783ea4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:29.789512 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2686bc-f772-4a9b-9547-49baa783ea4a admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:29.790197 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2686bc-f772-4a9b-9547-49baa783ea4a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:29.791894 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2686bc-f772-4a9b-9547-49baa783ea4a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:29.804334 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-bb2686bc-f772-4a9b-9547-49baa783ea4a admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 14:25:29.805898 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 453/911] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:25:29 2021] GET /identity/v3/services/compute => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:29.812875 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa522e-2508-4cec-8bd3-37630e5188f6 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:29.823548 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa522e-2508-4cec-8bd3-37630e5188f6 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:29.829029 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed462ff7-fae4-4c5c-b111-33af43736bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:29.829857 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed462ff7-fae4-4c5c-b111-33af43736bfc admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:29.830212 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed462ff7-fae4-4c5c-b111-33af43736bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:29.830554 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed462ff7-fae4-4c5c-b111-33af43736bfc admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:29.831406 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed462ff7-fae4-4c5c-b111-33af43736bfc admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:29.831776 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed462ff7-fae4-4c5c-b111-33af43736bfc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:29.833448 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed462ff7-fae4-4c5c-b111-33af43736bfc admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:29.839307 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 459/912] 10.222.0.79 () {56 vars in 1133 bytes} [Thu Oct 28 14:25:29 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:29.846034 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2686bc-f772-4a9b-9547-49baa783ea4a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:29.856462 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2686bc-f772-4a9b-9547-49baa783ea4a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:29.861063 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37a859-f37f-4c50-a899-76362ff867a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:29.861732 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37a859-f37f-4c50-a899-76362ff867a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:29.862010 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37a859-f37f-4c50-a899-76362ff867a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:29.862282 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37a859-f37f-4c50-a899-76362ff867a9 admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:29.863088 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37a859-f37f-4c50-a899-76362ff867a9 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:29.863388 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37a859-f37f-4c50-a899-76362ff867a9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:29.864983 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37a859-f37f-4c50-a899-76362ff867a9 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:29.870172 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 454/913] 10.222.0.79 () {56 vars in 1133 bytes} [Thu Oct 28 14:25:29 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:29.876925 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed462ff7-fae4-4c5c-b111-33af43736bfc admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:29.887051 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed462ff7-fae4-4c5c-b111-33af43736bfc admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:29.891448 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aeb62f-d512-4a89-b94e-f3b40622ff90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:29.892094 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aeb62f-d512-4a89-b94e-f3b40622ff90 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:29.892366 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aeb62f-d512-4a89-b94e-f3b40622ff90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:29.892630 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aeb62f-d512-4a89-b94e-f3b40622ff90 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:29.893383 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aeb62f-d512-4a89-b94e-f3b40622ff90 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:29.895005 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aeb62f-d512-4a89-b94e-f3b40622ff90 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:29.921254 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 460/914] 10.222.0.79 () {60 vars in 1165 bytes} [Thu Oct 28 14:25:29 2021] POST /identity/v3/endpoints => generated 334 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:25:29.933094 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49231ed-b5a0-4dab-a6ed-739a04ac77fa None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:29.933386 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49231ed-b5a0-4dab-a6ed-739a04ac77fa None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:29.933641 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49231ed-b5a0-4dab-a6ed-739a04ac77fa None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:29.935582 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 455/915] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:29.942574 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd435549-6888-4e30-a564-ea5c8f1eaf4c None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:29.942941 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd435549-6888-4e30-a564-ea5c8f1eaf4c None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:29.943261 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd435549-6888-4e30-a564-ea5c8f1eaf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:29.963650 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-fd435549-6888-4e30-a564-ea5c8f1eaf4c None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:29.964815 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-fd435549-6888-4e30-a564-ea5c8f1eaf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:29.984976 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 461/916] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:29 2021] POST /identity/v3/auth/tokens => generated 2828 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:25:30.009909 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49231ed-b5a0-4dab-a6ed-739a04ac77fa None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:30.024978 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49231ed-b5a0-4dab-a6ed-739a04ac77fa None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:30.030027 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4395a-462a-494a-a869-d299abdbda3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:30.030973 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4395a-462a-494a-a869-d299abdbda3b admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:30.031310 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4395a-462a-494a-a869-d299abdbda3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:30.031654 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4395a-462a-494a-a869-d299abdbda3b admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:30.032394 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4395a-462a-494a-a869-d299abdbda3b admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:30.034080 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4395a-462a-494a-a869-d299abdbda3b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:30.046165 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-e4e4395a-462a-494a-a869-d299abdbda3b admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 14:25:30.047678 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 456/917] 10.222.0.79 () {56 vars in 1147 bytes} [Thu Oct 28 14:25:30 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:30.055160 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd435549-6888-4e30-a564-ea5c8f1eaf4c None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:30.065248 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd435549-6888-4e30-a564-ea5c8f1eaf4c None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:30.070600 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655bf90-0e52-43b4-bb38-2e31ccf46bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:30.071457 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655bf90-0e52-43b4-bb38-2e31ccf46bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:30.071808 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655bf90-0e52-43b4-bb38-2e31ccf46bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:30.072152 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655bf90-0e52-43b4-bb38-2e31ccf46bb5 admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:30.072975 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655bf90-0e52-43b4-bb38-2e31ccf46bb5 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:30.073372 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655bf90-0e52-43b4-bb38-2e31ccf46bb5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:30.075119 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655bf90-0e52-43b4-bb38-2e31ccf46bb5 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:30.081227 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 462/918] 10.222.0.79 () {56 vars in 1143 bytes} [Thu Oct 28 14:25:30 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:30.088247 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4395a-462a-494a-a869-d299abdbda3b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:30.099272 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4395a-462a-494a-a869-d299abdbda3b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:30.104549 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073afa74-9d38-433a-8d3d-7af6f0dbbcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:30.105230 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073afa74-9d38-433a-8d3d-7af6f0dbbcfd admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:30.105506 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073afa74-9d38-433a-8d3d-7af6f0dbbcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:30.105777 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073afa74-9d38-433a-8d3d-7af6f0dbbcfd admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:30.106518 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073afa74-9d38-433a-8d3d-7af6f0dbbcfd admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:30.106849 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073afa74-9d38-433a-8d3d-7af6f0dbbcfd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:30.108454 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073afa74-9d38-433a-8d3d-7af6f0dbbcfd admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:30.114231 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 457/919] 10.222.0.79 () {56 vars in 1143 bytes} [Thu Oct 28 14:25:30 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:30.120882 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655bf90-0e52-43b4-bb38-2e31ccf46bb5 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:30.131168 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655bf90-0e52-43b4-bb38-2e31ccf46bb5 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:30.139158 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6230dd-4455-4017-ae35-f23a4628ca66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:30.139158 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6230dd-4455-4017-ae35-f23a4628ca66 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:30.139158 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6230dd-4455-4017-ae35-f23a4628ca66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:30.139158 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6230dd-4455-4017-ae35-f23a4628ca66 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:30.140249 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6230dd-4455-4017-ae35-f23a4628ca66 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:30.142072 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6230dd-4455-4017-ae35-f23a4628ca66 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:30.158025 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 463/920] 10.222.0.79 () {60 vars in 1165 bytes} [Thu Oct 28 14:25:30 2021] POST /identity/v3/endpoints => generated 325 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:25:31.907212 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e673655-b014-417f-826b-cd2d10f607c1 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:31.907669 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e673655-b014-417f-826b-cd2d10f607c1 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:31.907747 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e673655-b014-417f-826b-cd2d10f607c1 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:31.909549 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 458/921] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:31.915685 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd82e7-c238-4b94-9804-630b8de0e37f None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:31.916146 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd82e7-c238-4b94-9804-630b8de0e37f None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:31.916221 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd82e7-c238-4b94-9804-630b8de0e37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:31.936588 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-a4dd82e7-c238-4b94-9804-630b8de0e37f None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:31.937774 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a4dd82e7-c238-4b94-9804-630b8de0e37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:31.956320 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 464/922] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:31 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:31.980503 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e673655-b014-417f-826b-cd2d10f607c1 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:31.993233 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e673655-b014-417f-826b-cd2d10f607c1 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:31.997976 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a8a68-5578-4766-99ee-73a5cd5d7c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:31.998791 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a8a68-5578-4766-99ee-73a5cd5d7c1e admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:31.999072 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a8a68-5578-4766-99ee-73a5cd5d7c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:31.999324 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a8a68-5578-4766-99ee-73a5cd5d7c1e admin admin] PATH_INFO: `/v3/services/image` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:31.999979 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a8a68-5578-4766-99ee-73a5cd5d7c1e admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:32.001563 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a8a68-5578-4766-99ee-73a5cd5d7c1e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:32.013012 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-665a8a68-5578-4766-99ee-73a5cd5d7c1e admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 14:25:32.014386 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 459/923] 10.222.0.79 () {56 vars in 1126 bytes} [Thu Oct 28 14:25:31 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:32.020884 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd82e7-c238-4b94-9804-630b8de0e37f None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:32.032625 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd82e7-c238-4b94-9804-630b8de0e37f None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:32.037128 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1aae6-24b3-4106-98a6-839f7065ae67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:32.037800 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1aae6-24b3-4106-98a6-839f7065ae67 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:32.038101 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1aae6-24b3-4106-98a6-839f7065ae67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:32.038396 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1aae6-24b3-4106-98a6-839f7065ae67 admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:32.039187 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1aae6-24b3-4106-98a6-839f7065ae67 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:32.039486 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1aae6-24b3-4106-98a6-839f7065ae67 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:32.041075 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1aae6-24b3-4106-98a6-839f7065ae67 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:32.046766 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 465/924] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:32 2021] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:32.053324 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a8a68-5578-4766-99ee-73a5cd5d7c1e admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:32.070000 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a8a68-5578-4766-99ee-73a5cd5d7c1e admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:32.074452 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d7bb6-f763-4960-99c0-b87ccb248609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:32.075141 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d7bb6-f763-4960-99c0-b87ccb248609 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:32.075421 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d7bb6-f763-4960-99c0-b87ccb248609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:32.075690 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d7bb6-f763-4960-99c0-b87ccb248609 admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:32.076407 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d7bb6-f763-4960-99c0-b87ccb248609 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:32.076711 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d7bb6-f763-4960-99c0-b87ccb248609 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:32.078297 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d7bb6-f763-4960-99c0-b87ccb248609 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:32.088967 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 460/925] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:32 2021] GET /identity/v3/services?type=image => generated 350 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:32.090089 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1aae6-24b3-4106-98a6-839f7065ae67 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:32.100005 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1aae6-24b3-4106-98a6-839f7065ae67 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:32.104759 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e66f1-d32a-4af0-9125-9ecb0532c024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:32.105511 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e66f1-d32a-4af0-9125-9ecb0532c024 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:32.105866 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e66f1-d32a-4af0-9125-9ecb0532c024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:32.106207 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e66f1-d32a-4af0-9125-9ecb0532c024 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:32.107078 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e66f1-d32a-4af0-9125-9ecb0532c024 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:32.108738 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e66f1-d32a-4af0-9125-9ecb0532c024 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:32.127730 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 466/926] 10.222.0.79 () {60 vars in 1165 bytes} [Thu Oct 28 14:25:32 2021] POST /identity/v3/endpoints => generated 327 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:25:32.302192 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c235be-4b91-4064-9b79-16e71777afe5 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:32.302382 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c235be-4b91-4064-9b79-16e71777afe5 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:32.302821 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c235be-4b91-4064-9b79-16e71777afe5 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:32.304787 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 461/927] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:32.312143 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a99c04-d6bd-44b8-90a7-8d3471b92015 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:32.312480 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a99c04-d6bd-44b8-90a7-8d3471b92015 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:32.312648 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a99c04-d6bd-44b8-90a7-8d3471b92015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:32.331822 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-44a99c04-d6bd-44b8-90a7-8d3471b92015 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:32.333039 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-44a99c04-d6bd-44b8-90a7-8d3471b92015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:32.356377 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 467/928] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:32 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:32.381049 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c235be-4b91-4064-9b79-16e71777afe5 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:32.393790 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c235be-4b91-4064-9b79-16e71777afe5 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:32.398196 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016874a-f94c-439d-ae2c-e3074461530d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:32.399000 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016874a-f94c-439d-ae2c-e3074461530d admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:32.399270 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016874a-f94c-439d-ae2c-e3074461530d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:32.399536 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016874a-f94c-439d-ae2c-e3074461530d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:32.411118 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016874a-f94c-439d-ae2c-e3074461530d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:25:32.418298 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-1016874a-f94c-439d-ae2c-e3074461530d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 14:25:32.419726 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 462/929] 10.222.0.79 () {56 vars in 1141 bytes} [Thu Oct 28 14:25:32 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:32.426769 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a99c04-d6bd-44b8-90a7-8d3471b92015 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:32.431813 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410619a-025a-4ba0-9958-59f8ca45c945 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:32.432100 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410619a-025a-4ba0-9958-59f8ca45c945 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:32.432339 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410619a-025a-4ba0-9958-59f8ca45c945 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:32.434142 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 463/930] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 14:25:32.436533 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a99c04-d6bd-44b8-90a7-8d3471b92015 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:32.440236 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335662dd-3a64-4c8d-8f62-6215efbdce40 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:32.440653 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335662dd-3a64-4c8d-8f62-6215efbdce40 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:32.440930 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335662dd-3a64-4c8d-8f62-6215efbdce40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:32.441742 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e359d58-bd5a-4b5c-9a5d-0c3dcbedf27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:32.442399 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e359d58-bd5a-4b5c-9a5d-0c3dcbedf27c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:32.442696 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e359d58-bd5a-4b5c-9a5d-0c3dcbedf27c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:32.442971 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e359d58-bd5a-4b5c-9a5d-0c3dcbedf27c admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:32.443729 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e359d58-bd5a-4b5c-9a5d-0c3dcbedf27c admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:32.444024 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e359d58-bd5a-4b5c-9a5d-0c3dcbedf27c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:32.445638 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e359d58-bd5a-4b5c-9a5d-0c3dcbedf27c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:32.455381 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 468/931] 10.222.0.79 () {56 vars in 1136 bytes} [Thu Oct 28 14:25:32 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:32.459800 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-335662dd-3a64-4c8d-8f62-6215efbdce40 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:32.461044 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-335662dd-3a64-4c8d-8f62-6215efbdce40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:32.461844 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e359d58-bd5a-4b5c-9a5d-0c3dcbedf27c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:32.469371 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 464/932] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:32 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:25:32.473028 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e359d58-bd5a-4b5c-9a5d-0c3dcbedf27c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:32.477777 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175ab80-8425-4747-ab87-232059de0c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:32.478601 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175ab80-8425-4747-ab87-232059de0c14 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:32.478940 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175ab80-8425-4747-ab87-232059de0c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:32.479214 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175ab80-8425-4747-ab87-232059de0c14 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:32.490053 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175ab80-8425-4747-ab87-232059de0c14 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:32.491996 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175ab80-8425-4747-ab87-232059de0c14 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:32.493361 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335662dd-3a64-4c8d-8f62-6215efbdce40 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:32.502383 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335662dd-3a64-4c8d-8f62-6215efbdce40 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:32.509414 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fe896-5067-493b-bb2b-639043283e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:32.510216 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fe896-5067-493b-bb2b-639043283e66 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:32.510489 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fe896-5067-493b-bb2b-639043283e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:32.510788 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fe896-5067-493b-bb2b-639043283e66 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:32.511630 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-6175ab80-8425-4747-ab87-232059de0c14 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:32.512061 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fe896-5067-493b-bb2b-639043283e66 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:32.514750 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 469/933] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:25:32.514888 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fe896-5067-493b-bb2b-639043283e66 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:32.515541 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 465/934] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:32 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:25:32.519778 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175ab80-8425-4747-ab87-232059de0c14 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:32.521696 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fe896-5067-493b-bb2b-639043283e66 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:32.529696 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175ab80-8425-4747-ab87-232059de0c14 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:32.531646 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fe896-5067-493b-bb2b-639043283e66 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:32.534278 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330be206-4221-44c7-834e-d3c3bcb4b1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:32.534958 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330be206-4221-44c7-834e-d3c3bcb4b1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:32.535231 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330be206-4221-44c7-834e-d3c3bcb4b1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:32.535493 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330be206-4221-44c7-834e-d3c3bcb4b1e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:32.536217 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330be206-4221-44c7-834e-d3c3bcb4b1e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:32.536511 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330be206-4221-44c7-834e-d3c3bcb4b1e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:32.537030 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40eb52e-d41e-4780-aea9-7da42af76e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:32.537669 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40eb52e-d41e-4780-aea9-7da42af76e68 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:32.537945 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40eb52e-d41e-4780-aea9-7da42af76e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:32.538157 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330be206-4221-44c7-834e-d3c3bcb4b1e8 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:32.538251 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40eb52e-d41e-4780-aea9-7da42af76e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:32.538943 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40eb52e-d41e-4780-aea9-7da42af76e68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:32.540795 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40eb52e-d41e-4780-aea9-7da42af76e68 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:32.551194 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 470/935] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:25:32.557717 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330be206-4221-44c7-834e-d3c3bcb4b1e8 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:32.567897 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330be206-4221-44c7-834e-d3c3bcb4b1e8 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:32.574732 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 466/936] 10.222.0.79 () {60 vars in 1162 bytes} [Thu Oct 28 14:25:32 2021] POST /identity/v3/projects => generated 311 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:25:32.574913 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ccaae-56f1-4e56-ba3f-96fe6adf544e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:32.574913 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ccaae-56f1-4e56-ba3f-96fe6adf544e admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:32.574913 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ccaae-56f1-4e56-ba3f-96fe6adf544e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:32.574913 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ccaae-56f1-4e56-ba3f-96fe6adf544e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:32.581979 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ccaae-56f1-4e56-ba3f-96fe6adf544e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:32.584079 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ccaae-56f1-4e56-ba3f-96fe6adf544e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:32.599465 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-223ccaae-56f1-4e56-ba3f-96fe6adf544e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 14:25:32.601057 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 471/937] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Oct 28 14:25:32 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:25:32.608487 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40eb52e-d41e-4780-aea9-7da42af76e68 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:32.675983 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40eb52e-d41e-4780-aea9-7da42af76e68 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:32.680887 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a292a8-b171-445e-828a-af6d9f3a900f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:32.681585 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a292a8-b171-445e-828a-af6d9f3a900f admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:32.681862 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a292a8-b171-445e-828a-af6d9f3a900f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:32.682130 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a292a8-b171-445e-828a-af6d9f3a900f admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:32.683026 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a292a8-b171-445e-828a-af6d9f3a900f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:32.683348 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a292a8-b171-445e-828a-af6d9f3a900f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:32.685359 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a292a8-b171-445e-828a-af6d9f3a900f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:32.705978 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 467/938] 10.222.0.79 () {56 vars in 1154 bytes} [Thu Oct 28 14:25:32 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:25:32.712676 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ccaae-56f1-4e56-ba3f-96fe6adf544e admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:32.723167 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ccaae-56f1-4e56-ba3f-96fe6adf544e admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:32.728386 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14db9dc-e9c5-4626-b12c-d369f0de0255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:32.729037 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14db9dc-e9c5-4626-b12c-d369f0de0255 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:32.729314 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14db9dc-e9c5-4626-b12c-d369f0de0255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:32.729600 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14db9dc-e9c5-4626-b12c-d369f0de0255 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:32.738910 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14db9dc-e9c5-4626-b12c-d369f0de0255 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:32.740676 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14db9dc-e9c5-4626-b12c-d369f0de0255 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:32.758563 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 472/939] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:25:32 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:25:32.758826 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a292a8-b171-445e-828a-af6d9f3a900f admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:32.769239 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a292a8-b171-445e-828a-af6d9f3a900f admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:32.774308 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3cb200-79d7-4c34-bfb4-577bc3da0a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:32.775168 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cb200-79d7-4c34-bfb4-577bc3da0a6d admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:32.775451 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cb200-79d7-4c34-bfb4-577bc3da0a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:32.775728 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cb200-79d7-4c34-bfb4-577bc3da0a6d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:32.786955 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3cb200-79d7-4c34-bfb4-577bc3da0a6d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:32.788943 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3cb200-79d7-4c34-bfb4-577bc3da0a6d admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:32.806524 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-1f3cb200-79d7-4c34-bfb4-577bc3da0a6d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:32.808166 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 468/940] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:32.814497 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14db9dc-e9c5-4626-b12c-d369f0de0255 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:32.824217 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14db9dc-e9c5-4626-b12c-d369f0de0255 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:32.829629 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee3bad-9a64-4679-adfc-6852b35b462c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:32.830295 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee3bad-9a64-4679-adfc-6852b35b462c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:32.830569 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee3bad-9a64-4679-adfc-6852b35b462c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:32.830869 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee3bad-9a64-4679-adfc-6852b35b462c admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:32.831600 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee3bad-9a64-4679-adfc-6852b35b462c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:32.831904 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee3bad-9a64-4679-adfc-6852b35b462c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:32.833473 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee3bad-9a64-4679-adfc-6852b35b462c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:32.845872 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 473/941] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:32.852629 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3cb200-79d7-4c34-bfb4-577bc3da0a6d admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:32.863145 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3cb200-79d7-4c34-bfb4-577bc3da0a6d admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:32.867819 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec673df7-fbd6-4024-bc7d-3320dc6fe779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:32.868693 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec673df7-fbd6-4024-bc7d-3320dc6fe779 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:32.869043 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec673df7-fbd6-4024-bc7d-3320dc6fe779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:32.869387 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec673df7-fbd6-4024-bc7d-3320dc6fe779 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:32.876691 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec673df7-fbd6-4024-bc7d-3320dc6fe779 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:32.878773 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec673df7-fbd6-4024-bc7d-3320dc6fe779 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:32.894193 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-ec673df7-fbd6-4024-bc7d-3320dc6fe779 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:25:32.895716 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 469/942] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:25:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:32.903621 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee3bad-9a64-4679-adfc-6852b35b462c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:32.914124 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee3bad-9a64-4679-adfc-6852b35b462c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:32.921421 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c88cf-e725-49d6-8d83-3dfd546119bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:32.921421 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c88cf-e725-49d6-8d83-3dfd546119bd admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:32.921421 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c88cf-e725-49d6-8d83-3dfd546119bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:32.921421 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c88cf-e725-49d6-8d83-3dfd546119bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:32.922164 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c88cf-e725-49d6-8d83-3dfd546119bd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:32.922164 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c88cf-e725-49d6-8d83-3dfd546119bd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:32.923194 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c88cf-e725-49d6-8d83-3dfd546119bd admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:32.937522 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 474/943] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:25:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:32.944296 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec673df7-fbd6-4024-bc7d-3320dc6fe779 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:32.954896 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec673df7-fbd6-4024-bc7d-3320dc6fe779 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:32.959832 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277cbc2-074a-45b4-aa7e-58251ff7739c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:32.960615 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277cbc2-074a-45b4-aa7e-58251ff7739c admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:32.960942 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277cbc2-074a-45b4-aa7e-58251ff7739c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:32.961278 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277cbc2-074a-45b4-aa7e-58251ff7739c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:32.962292 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277cbc2-074a-45b4-aa7e-58251ff7739c admin admin] RBAC: Adding query filter params (role.id=9108081ba69a4a18b558b93fe7521387, scope.project.id=b433200db4784bfeadca48d24212e823, user.id=18cd6636ae7847c78be910824410d295) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:32.962662 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277cbc2-074a-45b4-aa7e-58251ff7739c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:32.964621 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277cbc2-074a-45b4-aa7e-58251ff7739c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:32.970488 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 470/944] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:25:32 2021] GET /identity/v3/role_assignments?user.id=18cd6636ae7847c78be910824410d295&scope.project.id=b433200db4784bfeadca48d24212e823&role.id=9108081ba69a4a18b558b93fe7521387 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:34.424902 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5f01a-7a56-43b6-bba8-907675d4f094 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:34.425428 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5f01a-7a56-43b6-bba8-907675d4f094 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:34.425428 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5f01a-7a56-43b6-bba8-907675d4f094 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:34.428077 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 475/945] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:34.434133 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde39aec-72d7-4632-afb5-ceea62dddd72 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:34.434605 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde39aec-72d7-4632-afb5-ceea62dddd72 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:34.434718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde39aec-72d7-4632-afb5-ceea62dddd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:34.452432 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-fde39aec-72d7-4632-afb5-ceea62dddd72 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:34.453621 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-fde39aec-72d7-4632-afb5-ceea62dddd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:34.462084 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 471/946] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:34 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:34.485282 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5f01a-7a56-43b6-bba8-907675d4f094 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:34.498300 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5f01a-7a56-43b6-bba8-907675d4f094 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:34.503043 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f875d1-ed15-472b-8718-2b4857937210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:34.503687 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f875d1-ed15-472b-8718-2b4857937210 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:34.503967 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f875d1-ed15-472b-8718-2b4857937210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:34.504238 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f875d1-ed15-472b-8718-2b4857937210 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:34.512315 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f875d1-ed15-472b-8718-2b4857937210 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:34.514051 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f875d1-ed15-472b-8718-2b4857937210 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:34.523294 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 476/947] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:25:34 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:25:34.529717 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde39aec-72d7-4632-afb5-ceea62dddd72 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:34.539574 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde39aec-72d7-4632-afb5-ceea62dddd72 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:34.544454 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af9231-fddc-4dd3-8cfa-b966089faf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:34.545341 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af9231-fddc-4dd3-8cfa-b966089faf7d admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:34.545685 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af9231-fddc-4dd3-8cfa-b966089faf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:34.546026 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af9231-fddc-4dd3-8cfa-b966089faf7d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:34.547347 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af9231-fddc-4dd3-8cfa-b966089faf7d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:34.549143 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af9231-fddc-4dd3-8cfa-b966089faf7d admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:34.551308 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 472/948] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:34.881171 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194349f-da27-45ae-9981-dcf8a5cd4053 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:34.881364 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194349f-da27-45ae-9981-dcf8a5cd4053 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:34.881638 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194349f-da27-45ae-9981-dcf8a5cd4053 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:34.883606 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 477/949] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:34.889798 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d7201-02a3-4a30-a03e-011b8e2c5cb0 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:34.890061 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d7201-02a3-4a30-a03e-011b8e2c5cb0 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:34.890358 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d7201-02a3-4a30-a03e-011b8e2c5cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:34.908204 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-0e8d7201-02a3-4a30-a03e-011b8e2c5cb0 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:34.909386 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-0e8d7201-02a3-4a30-a03e-011b8e2c5cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:34.917117 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 473/950] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:34 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:34.943175 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194349f-da27-45ae-9981-dcf8a5cd4053 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:34.956348 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194349f-da27-45ae-9981-dcf8a5cd4053 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:34.962023 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3c58e-be92-4540-b32a-8a2e3cd05aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:34.962864 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3c58e-be92-4540-b32a-8a2e3cd05aaa admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:34.963145 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3c58e-be92-4540-b32a-8a2e3cd05aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:34.963413 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3c58e-be92-4540-b32a-8a2e3cd05aaa admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:34.964730 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae3c58e-be92-4540-b32a-8a2e3cd05aaa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:34.966435 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae3c58e-be92-4540-b32a-8a2e3cd05aaa admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:34.968057 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 478/951] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:34.974421 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d7201-02a3-4a30-a03e-011b8e2c5cb0 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:34.983638 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d7201-02a3-4a30-a03e-011b8e2c5cb0 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:34.988582 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55ca0f-0b0c-4c5f-912b-f1f6f2ebf85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:34.989247 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55ca0f-0b0c-4c5f-912b-f1f6f2ebf85f admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:34.989527 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55ca0f-0b0c-4c5f-912b-f1f6f2ebf85f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:34.989801 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55ca0f-0b0c-4c5f-912b-f1f6f2ebf85f admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:34.990525 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55ca0f-0b0c-4c5f-912b-f1f6f2ebf85f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:34.992489 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55ca0f-0b0c-4c5f-912b-f1f6f2ebf85f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:35.014770 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 474/952] 10.222.0.79 () {60 vars in 1153 bytes} [Thu Oct 28 14:25:34 2021] POST /identity/v3/users => generated 285 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:25:35.204697 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f2c12-f720-4cc8-a82f-fb00bc856bdd None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:35.204933 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f2c12-f720-4cc8-a82f-fb00bc856bdd None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:35.205238 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f2c12-f720-4cc8-a82f-fb00bc856bdd None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:35.207068 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 479/953] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:35.213676 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb2d35-8f16-49f7-99a7-d6b3daead5ed None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:35.214047 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb2d35-8f16-49f7-99a7-d6b3daead5ed None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:35.214326 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb2d35-8f16-49f7-99a7-d6b3daead5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:35.233087 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-98bb2d35-8f16-49f7-99a7-d6b3daead5ed None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:35.234245 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-98bb2d35-8f16-49f7-99a7-d6b3daead5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:35.242641 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 475/954] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:35 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:35.266839 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f2c12-f720-4cc8-a82f-fb00bc856bdd None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:35.279736 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f2c12-f720-4cc8-a82f-fb00bc856bdd None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:35.284487 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a55a5-32af-4995-8acd-e7b0d26c6f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:35.285308 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a55a5-32af-4995-8acd-e7b0d26c6f80 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:35.285587 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a55a5-32af-4995-8acd-e7b0d26c6f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:35.285856 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a55a5-32af-4995-8acd-e7b0d26c6f80 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:35.296963 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a55a5-32af-4995-8acd-e7b0d26c6f80 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:25:35.304846 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-3c0a55a5-32af-4995-8acd-e7b0d26c6f80 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 14:25:35.306053 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 480/955] 10.222.0.79 () {56 vars in 1141 bytes} [Thu Oct 28 14:25:35 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:35.312913 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb2d35-8f16-49f7-99a7-d6b3daead5ed None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:35.322159 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb2d35-8f16-49f7-99a7-d6b3daead5ed None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:35.327093 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6b499-19ae-4060-8804-e3730d20094c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:35.327823 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6b499-19ae-4060-8804-e3730d20094c admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:35.328120 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6b499-19ae-4060-8804-e3730d20094c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:35.328379 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6b499-19ae-4060-8804-e3730d20094c admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:35.329145 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6b499-19ae-4060-8804-e3730d20094c admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:35.329449 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6b499-19ae-4060-8804-e3730d20094c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:35.331086 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6b499-19ae-4060-8804-e3730d20094c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:35.339514 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 476/956] 10.222.0.79 () {56 vars in 1136 bytes} [Thu Oct 28 14:25:35 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:35.345790 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a55a5-32af-4995-8acd-e7b0d26c6f80 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:35.356886 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a55a5-32af-4995-8acd-e7b0d26c6f80 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:35.361762 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc541028-79b3-4c03-b80a-399a63ac9593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:35.362533 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc541028-79b3-4c03-b80a-399a63ac9593 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:35.362838 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc541028-79b3-4c03-b80a-399a63ac9593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:35.363079 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc541028-79b3-4c03-b80a-399a63ac9593 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:35.373745 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc541028-79b3-4c03-b80a-399a63ac9593 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:35.375555 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc541028-79b3-4c03-b80a-399a63ac9593 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:35.392563 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-fc541028-79b3-4c03-b80a-399a63ac9593 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:35.393698 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 481/957] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:35.400324 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6b499-19ae-4060-8804-e3730d20094c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:35.410192 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6b499-19ae-4060-8804-e3730d20094c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:35.415280 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250995e-062a-4373-bdb5-d3aa2d987eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:35.416014 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250995e-062a-4373-bdb5-d3aa2d987eeb admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:35.416362 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250995e-062a-4373-bdb5-d3aa2d987eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:35.416726 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250995e-062a-4373-bdb5-d3aa2d987eeb admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:35.417471 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250995e-062a-4373-bdb5-d3aa2d987eeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:35.417778 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250995e-062a-4373-bdb5-d3aa2d987eeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:35.419415 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250995e-062a-4373-bdb5-d3aa2d987eeb admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:35.432293 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 477/958] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:35.438546 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc541028-79b3-4c03-b80a-399a63ac9593 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:35.448627 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc541028-79b3-4c03-b80a-399a63ac9593 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:35.453544 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab6293-72a3-46f1-b10e-5813e6154c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:35.454321 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab6293-72a3-46f1-b10e-5813e6154c36 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:35.454594 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab6293-72a3-46f1-b10e-5813e6154c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:35.454958 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab6293-72a3-46f1-b10e-5813e6154c36 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:35.463161 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab6293-72a3-46f1-b10e-5813e6154c36 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:35.465157 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab6293-72a3-46f1-b10e-5813e6154c36 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:35.479730 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-94ab6293-72a3-46f1-b10e-5813e6154c36 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 14:25:35.480884 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 482/959] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Oct 28 14:25:35 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:25:35.487549 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250995e-062a-4373-bdb5-d3aa2d987eeb admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:35.497951 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250995e-062a-4373-bdb5-d3aa2d987eeb admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:35.503317 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3d953-e13f-45a2-91ff-375ee9547bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:35.503988 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3d953-e13f-45a2-91ff-375ee9547bcc admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:35.504274 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3d953-e13f-45a2-91ff-375ee9547bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:35.504541 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3d953-e13f-45a2-91ff-375ee9547bcc admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:35.505405 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3d953-e13f-45a2-91ff-375ee9547bcc admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:35.505704 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3d953-e13f-45a2-91ff-375ee9547bcc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:35.507610 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3d953-e13f-45a2-91ff-375ee9547bcc admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:35.525109 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 478/960] 10.222.0.79 () {56 vars in 1154 bytes} [Thu Oct 28 14:25:35 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:35.531273 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab6293-72a3-46f1-b10e-5813e6154c36 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:35.541460 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab6293-72a3-46f1-b10e-5813e6154c36 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:35.546331 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c7a15-a0b4-49f2-9275-b554639d366d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:35.547131 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c7a15-a0b4-49f2-9275-b554639d366d admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:35.547377 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c7a15-a0b4-49f2-9275-b554639d366d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:35.547671 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c7a15-a0b4-49f2-9275-b554639d366d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:35.558380 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c7a15-a0b4-49f2-9275-b554639d366d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:35.560213 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c7a15-a0b4-49f2-9275-b554639d366d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:35.576363 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-181c7a15-a0b4-49f2-9275-b554639d366d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:35.577644 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 483/961] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:35.583784 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3d953-e13f-45a2-91ff-375ee9547bcc admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:35.593744 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3d953-e13f-45a2-91ff-375ee9547bcc admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:35.600171 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d99497-6d34-4db9-9a02-0d2beccb517e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:35.600878 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d99497-6d34-4db9-9a02-0d2beccb517e admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:35.601155 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d99497-6d34-4db9-9a02-0d2beccb517e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:35.601431 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d99497-6d34-4db9-9a02-0d2beccb517e admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:35.602161 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d99497-6d34-4db9-9a02-0d2beccb517e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:35.602461 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d99497-6d34-4db9-9a02-0d2beccb517e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:35.604061 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d99497-6d34-4db9-9a02-0d2beccb517e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:35.615413 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 479/962] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:35.621512 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c7a15-a0b4-49f2-9275-b554639d366d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:35.631893 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c7a15-a0b4-49f2-9275-b554639d366d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:35.637513 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac16961-234f-4f62-8c19-e14e17255294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:35.638285 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac16961-234f-4f62-8c19-e14e17255294 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:35.638564 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac16961-234f-4f62-8c19-e14e17255294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:35.638876 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac16961-234f-4f62-8c19-e14e17255294 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:35.646134 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac16961-234f-4f62-8c19-e14e17255294 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:35.648620 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac16961-234f-4f62-8c19-e14e17255294 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:35.662590 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-7ac16961-234f-4f62-8c19-e14e17255294 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:25:35.663782 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 484/963] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:25:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:35.670379 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d99497-6d34-4db9-9a02-0d2beccb517e admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:35.680523 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d99497-6d34-4db9-9a02-0d2beccb517e admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:35.685943 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f4441-0bc7-4562-91a0-96ffa4fb3a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:35.686589 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f4441-0bc7-4562-91a0-96ffa4fb3a12 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:35.686903 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f4441-0bc7-4562-91a0-96ffa4fb3a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:35.687171 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f4441-0bc7-4562-91a0-96ffa4fb3a12 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:35.687969 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f4441-0bc7-4562-91a0-96ffa4fb3a12 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:35.688268 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f4441-0bc7-4562-91a0-96ffa4fb3a12 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:35.690097 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f4441-0bc7-4562-91a0-96ffa4fb3a12 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:35.702690 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 480/964] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:25:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:35.709305 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac16961-234f-4f62-8c19-e14e17255294 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:35.719900 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac16961-234f-4f62-8c19-e14e17255294 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:35.725701 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b23e98-f5f2-4dad-a22a-28302e1e8e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:35.726563 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b23e98-f5f2-4dad-a22a-28302e1e8e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:35.726877 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b23e98-f5f2-4dad-a22a-28302e1e8e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:35.727147 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b23e98-f5f2-4dad-a22a-28302e1e8e48 admin admin] PATH_INFO: `/v3/projects/b433200db4784bfeadca48d24212e823/users/18cd6636ae7847c78be910824410d295/roles/9108081ba69a4a18b558b93fe7521387` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:35.729756 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b23e98-f5f2-4dad-a22a-28302e1e8e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b433200db4784bfeadca48d24212e823, user_id=18cd6636ae7847c78be910824410d295, role_id=9108081ba69a4a18b558b93fe7521387)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:35.732429 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b23e98-f5f2-4dad-a22a-28302e1e8e48 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:35.746525 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 485/965] 10.222.0.79 () {58 vars in 1460 bytes} [Thu Oct 28 14:25:35 2021] PUT /identity/v3/projects/b433200db4784bfeadca48d24212e823/users/18cd6636ae7847c78be910824410d295/roles/9108081ba69a4a18b558b93fe7521387 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:25:37.307475 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd182feb-39f4-49fa-9a8d-1229318f6084 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:37.308103 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd182feb-39f4-49fa-9a8d-1229318f6084 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:37.308103 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd182feb-39f4-49fa-9a8d-1229318f6084 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:37.309734 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 481/966] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:37.315775 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63ddfd-6d91-4bb6-bbcc-ad8d0bb75d78 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:37.316190 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63ddfd-6d91-4bb6-bbcc-ad8d0bb75d78 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:37.316312 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63ddfd-6d91-4bb6-bbcc-ad8d0bb75d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:37.334019 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-4e63ddfd-6d91-4bb6-bbcc-ad8d0bb75d78 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:37.335454 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-4e63ddfd-6d91-4bb6-bbcc-ad8d0bb75d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:37.396708 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 486/967] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:37 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:37.421552 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd182feb-39f4-49fa-9a8d-1229318f6084 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:37.436146 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd182feb-39f4-49fa-9a8d-1229318f6084 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:37.441460 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f03b26-56f6-425c-86f8-2364af2c23d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:37.442349 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f03b26-56f6-425c-86f8-2364af2c23d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:37.442638 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f03b26-56f6-425c-86f8-2364af2c23d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:37.442946 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f03b26-56f6-425c-86f8-2364af2c23d8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:37.453583 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f03b26-56f6-425c-86f8-2364af2c23d8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:25:37.460507 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-35f03b26-56f6-425c-86f8-2364af2c23d8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:25:37.461867 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 482/968] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:25:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:37.468695 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63ddfd-6d91-4bb6-bbcc-ad8d0bb75d78 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:37.478251 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63ddfd-6d91-4bb6-bbcc-ad8d0bb75d78 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:37.484004 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0794a80-4476-4ebe-affa-fd4b1fcc3b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:37.484665 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0794a80-4476-4ebe-affa-fd4b1fcc3b5b admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:37.484939 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0794a80-4476-4ebe-affa-fd4b1fcc3b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:37.485202 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0794a80-4476-4ebe-affa-fd4b1fcc3b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:37.485958 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0794a80-4476-4ebe-affa-fd4b1fcc3b5b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:37.486297 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0794a80-4476-4ebe-affa-fd4b1fcc3b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:37.487999 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0794a80-4476-4ebe-affa-fd4b1fcc3b5b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:37.496886 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 487/969] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:25:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:37.503524 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f03b26-56f6-425c-86f8-2364af2c23d8 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:37.514696 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f03b26-56f6-425c-86f8-2364af2c23d8 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:37.520565 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef8a98-77aa-4462-a947-1065799c3edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:37.521434 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef8a98-77aa-4462-a947-1065799c3edb admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:37.521714 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef8a98-77aa-4462-a947-1065799c3edb admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:37.521986 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef8a98-77aa-4462-a947-1065799c3edb admin admin] PATH_INFO: `/v3/users/dadd8ecbfb0b4a7ebdca6fc3e0c989b1` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:37.536812 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef8a98-77aa-4462-a947-1065799c3edb admin admin] RBAC: Authorizing `identity:get_user(user_id=dadd8ecbfb0b4a7ebdca6fc3e0c989b1)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:37.539166 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef8a98-77aa-4462-a947-1065799c3edb admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:37.540881 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 483/970] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:25:37 2021] GET /identity/v3/users/dadd8ecbfb0b4a7ebdca6fc3e0c989b1 => generated 285 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:37.548142 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0794a80-4476-4ebe-affa-fd4b1fcc3b5b admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:37.563492 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0794a80-4476-4ebe-affa-fd4b1fcc3b5b admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:37.569284 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9bf38-b6ab-486b-94ab-71e9605f185b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:37.569927 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9bf38-b6ab-486b-94ab-71e9605f185b admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:37.570200 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9bf38-b6ab-486b-94ab-71e9605f185b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:37.570463 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9bf38-b6ab-486b-94ab-71e9605f185b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:37.578959 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9bf38-b6ab-486b-94ab-71e9605f185b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:37.580709 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9bf38-b6ab-486b-94ab-71e9605f185b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:37.589746 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 488/971] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:25:37 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:25:37.596650 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef8a98-77aa-4462-a947-1065799c3edb admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:37.606954 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef8a98-77aa-4462-a947-1065799c3edb admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:37.611862 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7e9b1-7ce2-4d64-8b63-e7d09e5a5df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:37.612821 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7e9b1-7ce2-4d64-8b63-e7d09e5a5df0 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:37.613168 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7e9b1-7ce2-4d64-8b63-e7d09e5a5df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:37.613452 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7e9b1-7ce2-4d64-8b63-e7d09e5a5df0 admin admin] PATH_INFO: `/v3/projects/89d93f57c0064a11934e16c4d4eee581` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:37.614715 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7e9b1-7ce2-4d64-8b63-e7d09e5a5df0 admin admin] RBAC: Authorizing `identity:get_project(project_id=89d93f57c0064a11934e16c4d4eee581)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:37.617340 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7e9b1-7ce2-4d64-8b63-e7d09e5a5df0 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:37.619200 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 484/972] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:25:37 2021] GET /identity/v3/projects/89d93f57c0064a11934e16c4d4eee581 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:37.625714 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9bf38-b6ab-486b-94ab-71e9605f185b admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:37.634975 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9bf38-b6ab-486b-94ab-71e9605f185b admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:37.639956 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0927776-d1fe-45f2-a322-e4ae12760000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:37.640590 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0927776-d1fe-45f2-a322-e4ae12760000 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:37.640861 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0927776-d1fe-45f2-a322-e4ae12760000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:37.641123 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0927776-d1fe-45f2-a322-e4ae12760000 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:37.641955 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0927776-d1fe-45f2-a322-e4ae12760000 admin admin] RBAC: Adding query filter params (role.id=f7b8954a0fe64dc2b6146c7174498ddb, scope.project.id=89d93f57c0064a11934e16c4d4eee581, user.id=dadd8ecbfb0b4a7ebdca6fc3e0c989b1) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:37.642256 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0927776-d1fe-45f2-a322-e4ae12760000 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:37.644098 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0927776-d1fe-45f2-a322-e4ae12760000 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:37.649977 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 489/973] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:25:37 2021] GET /identity/v3/role_assignments?user.id=dadd8ecbfb0b4a7ebdca6fc3e0c989b1&scope.project.id=89d93f57c0064a11934e16c4d4eee581&role.id=f7b8954a0fe64dc2b6146c7174498ddb => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:37.997485 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e419a7a-17f4-4905-8797-f3dd8524aa9c None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:37.997787 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e419a7a-17f4-4905-8797-f3dd8524aa9c None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:37.998096 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e419a7a-17f4-4905-8797-f3dd8524aa9c None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:37.999928 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 485/974] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:38.006222 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cb22b-60c4-4d2a-ab85-8b25e6673419 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:38.006586 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cb22b-60c4-4d2a-ab85-8b25e6673419 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:38.006999 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cb22b-60c4-4d2a-ab85-8b25e6673419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:38.026746 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-335cb22b-60c4-4d2a-ab85-8b25e6673419 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:38.028101 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-335cb22b-60c4-4d2a-ab85-8b25e6673419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:38.037295 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 490/975] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:38 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:38.062842 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e419a7a-17f4-4905-8797-f3dd8524aa9c None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:38.077396 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e419a7a-17f4-4905-8797-f3dd8524aa9c None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:38.082306 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bc567-8d80-43b5-907a-803f2fed9620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:38.083153 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bc567-8d80-43b5-907a-803f2fed9620 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:38.083434 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bc567-8d80-43b5-907a-803f2fed9620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:38.083712 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bc567-8d80-43b5-907a-803f2fed9620 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:38.094156 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bc567-8d80-43b5-907a-803f2fed9620 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:25:38.101493 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-3c5bc567-8d80-43b5-907a-803f2fed9620 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 14:25:38.102927 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 486/976] 10.222.0.79 () {56 vars in 1141 bytes} [Thu Oct 28 14:25:38 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:38.109558 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335cb22b-60c4-4d2a-ab85-8b25e6673419 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:38.118823 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335cb22b-60c4-4d2a-ab85-8b25e6673419 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:38.123821 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80dae9-413c-4418-a2b9-99e75269bdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:38.124480 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80dae9-413c-4418-a2b9-99e75269bdbf admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:38.124762 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80dae9-413c-4418-a2b9-99e75269bdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:38.125024 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80dae9-413c-4418-a2b9-99e75269bdbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:38.125765 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80dae9-413c-4418-a2b9-99e75269bdbf admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:38.126075 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80dae9-413c-4418-a2b9-99e75269bdbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:38.127768 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80dae9-413c-4418-a2b9-99e75269bdbf admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:38.136424 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 491/977] 10.222.0.79 () {56 vars in 1136 bytes} [Thu Oct 28 14:25:38 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:38.142818 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bc567-8d80-43b5-907a-803f2fed9620 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:38.153709 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bc567-8d80-43b5-907a-803f2fed9620 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:38.158639 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9566c9-c266-4576-8b52-9acb16701267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:38.159455 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9566c9-c266-4576-8b52-9acb16701267 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:38.159736 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9566c9-c266-4576-8b52-9acb16701267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:38.160008 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9566c9-c266-4576-8b52-9acb16701267 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:38.170465 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9566c9-c266-4576-8b52-9acb16701267 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:38.172361 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9566c9-c266-4576-8b52-9acb16701267 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:38.192935 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-7b9566c9-c266-4576-8b52-9acb16701267 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:38.194375 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 487/978] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:38.201133 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80dae9-413c-4418-a2b9-99e75269bdbf admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:38.211173 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80dae9-413c-4418-a2b9-99e75269bdbf admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:38.216162 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2f7ae-e01e-4aca-b315-915425795adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:38.216812 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2f7ae-e01e-4aca-b315-915425795adc admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:38.217089 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2f7ae-e01e-4aca-b315-915425795adc admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:38.217326 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2f7ae-e01e-4aca-b315-915425795adc admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:38.218099 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2f7ae-e01e-4aca-b315-915425795adc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:38.218401 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2f7ae-e01e-4aca-b315-915425795adc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:38.220009 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2f7ae-e01e-4aca-b315-915425795adc admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:38.232527 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 492/979] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:25:38.238907 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9566c9-c266-4576-8b52-9acb16701267 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:38.248952 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9566c9-c266-4576-8b52-9acb16701267 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:38.254013 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f63e2b-5bbe-4462-9176-73bf6034b5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:38.254815 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f63e2b-5bbe-4462-9176-73bf6034b5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:38.255130 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f63e2b-5bbe-4462-9176-73bf6034b5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:38.255398 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f63e2b-5bbe-4462-9176-73bf6034b5d2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:38.263698 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f63e2b-5bbe-4462-9176-73bf6034b5d2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:38.265749 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f63e2b-5bbe-4462-9176-73bf6034b5d2 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:38.279561 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-55f63e2b-5bbe-4462-9176-73bf6034b5d2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 14:25:38.280932 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 488/980] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Oct 28 14:25:38 2021] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:38.287320 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2f7ae-e01e-4aca-b315-915425795adc admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:38.297347 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2f7ae-e01e-4aca-b315-915425795adc admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:38.302728 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf10b10-d4a1-4921-ae19-9e98b03f19f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:38.303395 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf10b10-d4a1-4921-ae19-9e98b03f19f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:38.303688 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf10b10-d4a1-4921-ae19-9e98b03f19f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:38.303956 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf10b10-d4a1-4921-ae19-9e98b03f19f9 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:38.304817 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf10b10-d4a1-4921-ae19-9e98b03f19f9 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:38.305137 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf10b10-d4a1-4921-ae19-9e98b03f19f9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:38.307037 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf10b10-d4a1-4921-ae19-9e98b03f19f9 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:38.324753 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 493/981] 10.222.0.79 () {56 vars in 1154 bytes} [Thu Oct 28 14:25:38 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:38.331367 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f63e2b-5bbe-4462-9176-73bf6034b5d2 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:38.341508 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f63e2b-5bbe-4462-9176-73bf6034b5d2 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:38.346367 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5818ce4-64e5-45e0-adcb-d3b51b52d632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:38.347121 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5818ce4-64e5-45e0-adcb-d3b51b52d632 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:38.347400 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5818ce4-64e5-45e0-adcb-d3b51b52d632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:38.347672 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5818ce4-64e5-45e0-adcb-d3b51b52d632 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:38.356105 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5818ce4-64e5-45e0-adcb-d3b51b52d632 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:38.357843 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5818ce4-64e5-45e0-adcb-d3b51b52d632 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:38.367002 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 489/982] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:25:38 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:25:38.373572 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf10b10-d4a1-4921-ae19-9e98b03f19f9 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:38.384018 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf10b10-d4a1-4921-ae19-9e98b03f19f9 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:38.389718 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d283d-752c-4fdd-b36f-282e36e1847c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:38.390553 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d283d-752c-4fdd-b36f-282e36e1847c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:38.390857 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d283d-752c-4fdd-b36f-282e36e1847c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:38.391136 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d283d-752c-4fdd-b36f-282e36e1847c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:38.401901 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d283d-752c-4fdd-b36f-282e36e1847c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:38.403936 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d283d-752c-4fdd-b36f-282e36e1847c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:38.420659 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-1a7d283d-752c-4fdd-b36f-282e36e1847c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:25:38.421839 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 494/983] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:38.428884 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5818ce4-64e5-45e0-adcb-d3b51b52d632 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:38.438399 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5818ce4-64e5-45e0-adcb-d3b51b52d632 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:38.443933 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092f9f9-8e43-407e-be05-7f7b2f7f1ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:38.444672 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092f9f9-8e43-407e-be05-7f7b2f7f1ace admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:38.444955 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092f9f9-8e43-407e-be05-7f7b2f7f1ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:38.445227 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092f9f9-8e43-407e-be05-7f7b2f7f1ace admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:38.445972 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092f9f9-8e43-407e-be05-7f7b2f7f1ace admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:38.446275 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092f9f9-8e43-407e-be05-7f7b2f7f1ace admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:38.447932 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092f9f9-8e43-407e-be05-7f7b2f7f1ace admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:38.460539 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 490/984] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:25:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:38.467373 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d283d-752c-4fdd-b36f-282e36e1847c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:38.477542 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d283d-752c-4fdd-b36f-282e36e1847c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:38.484308 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7dd87-fcc3-4ad6-9026-a003b8544299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:38.485090 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7dd87-fcc3-4ad6-9026-a003b8544299 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:38.485360 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7dd87-fcc3-4ad6-9026-a003b8544299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:38.485626 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7dd87-fcc3-4ad6-9026-a003b8544299 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:38.493870 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7dd87-fcc3-4ad6-9026-a003b8544299 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:38.495948 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7dd87-fcc3-4ad6-9026-a003b8544299 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:38.510204 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-9fe7dd87-fcc3-4ad6-9026-a003b8544299 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:25:38.511421 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 495/985] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:25:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:38.518336 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092f9f9-8e43-407e-be05-7f7b2f7f1ace admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:38.529215 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092f9f9-8e43-407e-be05-7f7b2f7f1ace admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:38.534302 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce2999-5966-4126-94d2-014548b614d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:38.534996 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce2999-5966-4126-94d2-014548b614d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:38.535279 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce2999-5966-4126-94d2-014548b614d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:38.535548 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce2999-5966-4126-94d2-014548b614d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:38.536354 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce2999-5966-4126-94d2-014548b614d0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:38.536662 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce2999-5966-4126-94d2-014548b614d0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:38.538549 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce2999-5966-4126-94d2-014548b614d0 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:38.551988 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 491/986] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:25:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:38.559692 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7dd87-fcc3-4ad6-9026-a003b8544299 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:38.570952 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7dd87-fcc3-4ad6-9026-a003b8544299 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:38.575901 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d610ccc-f12e-4899-b941-93b2b53004be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:38.576531 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d610ccc-f12e-4899-b941-93b2b53004be admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:38.576804 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d610ccc-f12e-4899-b941-93b2b53004be admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:38.577066 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d610ccc-f12e-4899-b941-93b2b53004be admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:38.577891 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d610ccc-f12e-4899-b941-93b2b53004be admin admin] RBAC: Adding query filter params (role.id=9108081ba69a4a18b558b93fe7521387, scope.project.id=b433200db4784bfeadca48d24212e823, user.id=18cd6636ae7847c78be910824410d295) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:38.578192 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d610ccc-f12e-4899-b941-93b2b53004be admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:38.580167 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d610ccc-f12e-4899-b941-93b2b53004be admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:38.586668 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 496/987] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:25:38 2021] GET /identity/v3/role_assignments?user.id=18cd6636ae7847c78be910824410d295&scope.project.id=b433200db4784bfeadca48d24212e823&role.id=9108081ba69a4a18b558b93fe7521387 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:25:39.876413 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e43961-2e56-43a6-b097-36dc266e9163 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:39.877286 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e43961-2e56-43a6-b097-36dc266e9163 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:39.877286 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e43961-2e56-43a6-b097-36dc266e9163 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:39.880151 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 492/988] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:39 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:39.886377 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee79dee-f521-4379-918e-e3868f011f43 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:39.886826 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee79dee-f521-4379-918e-e3868f011f43 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:39.886933 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee79dee-f521-4379-918e-e3868f011f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:39.905009 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-6ee79dee-f521-4379-918e-e3868f011f43 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:39.906187 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-6ee79dee-f521-4379-918e-e3868f011f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:39.914362 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 497/989] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:39 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:39.938441 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e43961-2e56-43a6-b097-36dc266e9163 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:39.952604 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e43961-2e56-43a6-b097-36dc266e9163 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:39.957764 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53207eb-d409-4b51-811b-bf6b88a7e9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:39.958544 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53207eb-d409-4b51-811b-bf6b88a7e9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:39.958870 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53207eb-d409-4b51-811b-bf6b88a7e9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:39.959137 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53207eb-d409-4b51-811b-bf6b88a7e9d7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:39.970107 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53207eb-d409-4b51-811b-bf6b88a7e9d7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:25:39.976830 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-c53207eb-d409-4b51-811b-bf6b88a7e9d7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:25:39.977981 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 493/990] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:25:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:39.984728 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee79dee-f521-4379-918e-e3868f011f43 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:39.994055 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee79dee-f521-4379-918e-e3868f011f43 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:39.999777 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381f8e6-d925-49e1-936a-104eb6be623a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:40.000433 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381f8e6-d925-49e1-936a-104eb6be623a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:40.001039 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381f8e6-d925-49e1-936a-104eb6be623a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:40.001039 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381f8e6-d925-49e1-936a-104eb6be623a admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:40.001692 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381f8e6-d925-49e1-936a-104eb6be623a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:40.001988 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381f8e6-d925-49e1-936a-104eb6be623a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:40.003613 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381f8e6-d925-49e1-936a-104eb6be623a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:40.012148 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 498/991] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:25:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:25:40.018402 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53207eb-d409-4b51-811b-bf6b88a7e9d7 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:40.028783 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53207eb-d409-4b51-811b-bf6b88a7e9d7 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:40.033796 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3e8f5-836a-4f42-8057-bc5417635269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:40.034639 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3e8f5-836a-4f42-8057-bc5417635269 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:40.034949 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3e8f5-836a-4f42-8057-bc5417635269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:40.035222 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3e8f5-836a-4f42-8057-bc5417635269 admin admin] PATH_INFO: `/v3/users/dadd8ecbfb0b4a7ebdca6fc3e0c989b1` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:40.036510 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3e8f5-836a-4f42-8057-bc5417635269 admin admin] RBAC: Authorizing `identity:get_user(user_id=dadd8ecbfb0b4a7ebdca6fc3e0c989b1)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:40.038617 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3e8f5-836a-4f42-8057-bc5417635269 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:40.040217 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 494/992] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:25:40 2021] GET /identity/v3/users/dadd8ecbfb0b4a7ebdca6fc3e0c989b1 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:40.046179 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381f8e6-d925-49e1-936a-104eb6be623a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:40.056355 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381f8e6-d925-49e1-936a-104eb6be623a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:40.062115 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96334473-7c57-47a9-9339-61da0c142e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:40.062986 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96334473-7c57-47a9-9339-61da0c142e74 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:40.063259 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96334473-7c57-47a9-9339-61da0c142e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:40.063525 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96334473-7c57-47a9-9339-61da0c142e74 admin admin] PATH_INFO: `/v3/projects/89d93f57c0064a11934e16c4d4eee581` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:40.064802 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96334473-7c57-47a9-9339-61da0c142e74 admin admin] RBAC: Authorizing `identity:get_project(project_id=89d93f57c0064a11934e16c4d4eee581)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:40.066851 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96334473-7c57-47a9-9339-61da0c142e74 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:40.068437 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 499/993] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:25:40 2021] GET /identity/v3/projects/89d93f57c0064a11934e16c4d4eee581 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:40.074709 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3e8f5-836a-4f42-8057-bc5417635269 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:40.084885 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3e8f5-836a-4f42-8057-bc5417635269 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:40.090927 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0727e0-2ae6-45a4-9fb6-572c97662421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:40.091843 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0727e0-2ae6-45a4-9fb6-572c97662421 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:40.092122 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0727e0-2ae6-45a4-9fb6-572c97662421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:40.092398 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0727e0-2ae6-45a4-9fb6-572c97662421 admin admin] PATH_INFO: `/v3/projects/89d93f57c0064a11934e16c4d4eee581/users/dadd8ecbfb0b4a7ebdca6fc3e0c989b1/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:40.094453 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0727e0-2ae6-45a4-9fb6-572c97662421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d93f57c0064a11934e16c4d4eee581, user_id=dadd8ecbfb0b4a7ebdca6fc3e0c989b1, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:40.097105 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0727e0-2ae6-45a4-9fb6-572c97662421 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:40.113071 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 495/994] 10.222.0.79 () {58 vars in 1460 bytes} [Thu Oct 28 14:25:40 2021] PUT /identity/v3/projects/89d93f57c0064a11934e16c4d4eee581/users/dadd8ecbfb0b4a7ebdca6fc3e0c989b1/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:25:42.334927 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b3280-3121-45f3-9436-71560a3fbaa2 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:42.335785 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b3280-3121-45f3-9436-71560a3fbaa2 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:42.335785 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b3280-3121-45f3-9436-71560a3fbaa2 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:42.338503 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 500/995] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:42 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:42.345412 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c36d4-8272-4018-8c87-d2d084d758c7 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:42.346136 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c36d4-8272-4018-8c87-d2d084d758c7 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:42.346291 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c36d4-8272-4018-8c87-d2d084d758c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:42.372497 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-cc3c36d4-8272-4018-8c87-d2d084d758c7 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:42.373711 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-cc3c36d4-8272-4018-8c87-d2d084d758c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:42.431214 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 496/996] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:42 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:42.455899 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b3280-3121-45f3-9436-71560a3fbaa2 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:42.470068 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b3280-3121-45f3-9436-71560a3fbaa2 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:42.474838 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501cc9e-49b7-48bf-be42-33730ec9eab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:42.475622 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501cc9e-49b7-48bf-be42-33730ec9eab0 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:42.475894 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501cc9e-49b7-48bf-be42-33730ec9eab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:42.476162 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501cc9e-49b7-48bf-be42-33730ec9eab0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:42.489148 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501cc9e-49b7-48bf-be42-33730ec9eab0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:25:42.495963 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-0501cc9e-49b7-48bf-be42-33730ec9eab0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:25:42.497105 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 501/997] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:25:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:42.503795 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c36d4-8272-4018-8c87-d2d084d758c7 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:42.513320 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c36d4-8272-4018-8c87-d2d084d758c7 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:42.519086 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fdb33-eb2f-40bf-9838-c8c53c5b4ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:42.519741 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fdb33-eb2f-40bf-9838-c8c53c5b4ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:42.520017 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fdb33-eb2f-40bf-9838-c8c53c5b4ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:42.520283 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fdb33-eb2f-40bf-9838-c8c53c5b4ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:42.521042 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fdb33-eb2f-40bf-9838-c8c53c5b4ef4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:42.521337 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fdb33-eb2f-40bf-9838-c8c53c5b4ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:42.522983 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fdb33-eb2f-40bf-9838-c8c53c5b4ef4 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:42.532086 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 497/998] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:25:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:42.539206 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501cc9e-49b7-48bf-be42-33730ec9eab0 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:42.556300 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501cc9e-49b7-48bf-be42-33730ec9eab0 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:42.565267 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69833e1f-a448-4f23-b90a-160ece321982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:42.566225 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69833e1f-a448-4f23-b90a-160ece321982 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:42.566534 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69833e1f-a448-4f23-b90a-160ece321982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:42.567062 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69833e1f-a448-4f23-b90a-160ece321982 admin admin] PATH_INFO: `/v3/users/dadd8ecbfb0b4a7ebdca6fc3e0c989b1` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:42.569095 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69833e1f-a448-4f23-b90a-160ece321982 admin admin] RBAC: Authorizing `identity:get_user(user_id=dadd8ecbfb0b4a7ebdca6fc3e0c989b1)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:42.571271 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69833e1f-a448-4f23-b90a-160ece321982 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:42.572823 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 502/999] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:25:42 2021] GET /identity/v3/users/dadd8ecbfb0b4a7ebdca6fc3e0c989b1 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:42.582099 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fdb33-eb2f-40bf-9838-c8c53c5b4ef4 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:42.596955 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fdb33-eb2f-40bf-9838-c8c53c5b4ef4 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:42.603105 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639833d-4a2d-4cd9-9c7a-69f01ae2e65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:42.603723 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639833d-4a2d-4cd9-9c7a-69f01ae2e65b admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:42.603996 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639833d-4a2d-4cd9-9c7a-69f01ae2e65b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:42.604264 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639833d-4a2d-4cd9-9c7a-69f01ae2e65b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:42.612116 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639833d-4a2d-4cd9-9c7a-69f01ae2e65b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:42.613836 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639833d-4a2d-4cd9-9c7a-69f01ae2e65b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:42.622560 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 498/1000] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:25:42 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:25:42.628774 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69833e1f-a448-4f23-b90a-160ece321982 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:42.640138 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69833e1f-a448-4f23-b90a-160ece321982 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:42.646430 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c0213-746b-47a3-bc5c-4b7ca2a0251c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:42.647335 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c0213-746b-47a3-bc5c-4b7ca2a0251c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:42.647624 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c0213-746b-47a3-bc5c-4b7ca2a0251c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:42.647841 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c0213-746b-47a3-bc5c-4b7ca2a0251c admin admin] PATH_INFO: `/v3/projects/89d93f57c0064a11934e16c4d4eee581` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:42.649408 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c0213-746b-47a3-bc5c-4b7ca2a0251c admin admin] RBAC: Authorizing `identity:get_project(project_id=89d93f57c0064a11934e16c4d4eee581)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:42.651591 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c0213-746b-47a3-bc5c-4b7ca2a0251c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:42.653283 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 503/1001] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:25:42 2021] GET /identity/v3/projects/89d93f57c0064a11934e16c4d4eee581 => generated 311 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:42.659945 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639833d-4a2d-4cd9-9c7a-69f01ae2e65b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:42.669014 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639833d-4a2d-4cd9-9c7a-69f01ae2e65b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:42.673612 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b9363-07a4-4944-aa17-c66c9adc5e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:42.674240 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b9363-07a4-4944-aa17-c66c9adc5e94 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:42.674513 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b9363-07a4-4944-aa17-c66c9adc5e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:42.674809 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b9363-07a4-4944-aa17-c66c9adc5e94 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:42.675999 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b9363-07a4-4944-aa17-c66c9adc5e94 admin admin] RBAC: Adding query filter params (role.id=f7b8954a0fe64dc2b6146c7174498ddb, scope.project.id=89d93f57c0064a11934e16c4d4eee581, user.id=dadd8ecbfb0b4a7ebdca6fc3e0c989b1) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:42.676310 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b9363-07a4-4944-aa17-c66c9adc5e94 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:42.678112 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b9363-07a4-4944-aa17-c66c9adc5e94 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:42.683857 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 499/1002] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:25:42 2021] GET /identity/v3/role_assignments?user.id=dadd8ecbfb0b4a7ebdca6fc3e0c989b1&scope.project.id=89d93f57c0064a11934e16c4d4eee581&role.id=f7b8954a0fe64dc2b6146c7174498ddb => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:44.930755 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58071a5-92c0-4dda-b0e3-8189f69642c4 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:44.931675 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58071a5-92c0-4dda-b0e3-8189f69642c4 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:44.931675 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58071a5-92c0-4dda-b0e3-8189f69642c4 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:44.934464 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 504/1003] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:44 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:44.944382 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df06ca-99e2-4a2d-ba98-55c33e7080d0 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:44.944807 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df06ca-99e2-4a2d-ba98-55c33e7080d0 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:44.944930 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df06ca-99e2-4a2d-ba98-55c33e7080d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:44.965214 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-23df06ca-99e2-4a2d-ba98-55c33e7080d0 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:44.966414 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-23df06ca-99e2-4a2d-ba98-55c33e7080d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:44.974721 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 500/1004] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:44 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:45.000837 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58071a5-92c0-4dda-b0e3-8189f69642c4 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:45.014564 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58071a5-92c0-4dda-b0e3-8189f69642c4 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:45.020183 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f1b3e-f559-47ed-bb08-03b55c0cd0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:45.020964 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f1b3e-f559-47ed-bb08-03b55c0cd0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:45.021237 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f1b3e-f559-47ed-bb08-03b55c0cd0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:45.021499 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f1b3e-f559-47ed-bb08-03b55c0cd0f6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:45.022805 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f1b3e-f559-47ed-bb08-03b55c0cd0f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:45.024474 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f1b3e-f559-47ed-bb08-03b55c0cd0f6 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:45.026036 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 505/1005] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:44 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:45.032847 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df06ca-99e2-4a2d-ba98-55c33e7080d0 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:45.044908 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df06ca-99e2-4a2d-ba98-55c33e7080d0 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:45.051627 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd44d3-8712-44b5-9aab-ce427dc4ad07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:45.052281 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd44d3-8712-44b5-9aab-ce427dc4ad07 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:45.052555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd44d3-8712-44b5-9aab-ce427dc4ad07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:45.052822 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd44d3-8712-44b5-9aab-ce427dc4ad07 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:45.053538 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd44d3-8712-44b5-9aab-ce427dc4ad07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:45.055479 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd44d3-8712-44b5-9aab-ce427dc4ad07 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:45.080099 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 501/1006] 10.222.0.79 () {60 vars in 1153 bytes} [Thu Oct 28 14:25:45 2021] POST /identity/v3/users => generated 286 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:25:47.346804 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c7d69-18de-4258-83bd-69198fb31c6e None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:47.347343 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c7d69-18de-4258-83bd-69198fb31c6e None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:47.347343 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c7d69-18de-4258-83bd-69198fb31c6e None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:47.349021 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 506/1007] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:47.356378 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a19fe2-5ad8-46fd-960d-4efb829b7135 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:47.357110 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a19fe2-5ad8-46fd-960d-4efb829b7135 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:47.357300 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a19fe2-5ad8-46fd-960d-4efb829b7135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:47.385520 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-55a19fe2-5ad8-46fd-960d-4efb829b7135 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:47.386714 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-55a19fe2-5ad8-46fd-960d-4efb829b7135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:47.396197 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 502/1008] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:47 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:47.421142 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c7d69-18de-4258-83bd-69198fb31c6e None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:47.436633 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c7d69-18de-4258-83bd-69198fb31c6e None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:47.442974 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250d633-4562-47d5-8126-dea63faa9cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:47.443811 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250d633-4562-47d5-8126-dea63faa9cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:47.444088 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250d633-4562-47d5-8126-dea63faa9cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:47.444353 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250d633-4562-47d5-8126-dea63faa9cb5 admin admin] PATH_INFO: `/v3/roles/08b906e1585f45668d988e46a5d2659a` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:47.445976 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250d633-4562-47d5-8126-dea63faa9cb5 admin admin] RBAC: Authorizing `identity:get_role(role_id=08b906e1585f45668d988e46a5d2659a)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:47.447026 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING py.warnings [None req-6250d633-4562-47d5-8126-dea63faa9cb5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:25:47.447026 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: warnings.warn(msg) Oct 28 14:25:47.447026 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: Oct 28 14:25:47.447894 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250d633-4562-47d5-8126-dea63faa9cb5 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:47.449226 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 507/1009] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:25:47 2021] GET /identity/v3/roles/08b906e1585f45668d988e46a5d2659a => generated 223 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:47.456240 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a19fe2-5ad8-46fd-960d-4efb829b7135 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:47.470513 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a19fe2-5ad8-46fd-960d-4efb829b7135 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:47.477537 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93c3f6-73e7-49c6-b25f-6b7117a586d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:47.478863 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93c3f6-73e7-49c6-b25f-6b7117a586d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:47.479207 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93c3f6-73e7-49c6-b25f-6b7117a586d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:47.479592 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93c3f6-73e7-49c6-b25f-6b7117a586d0 admin admin] PATH_INFO: `/v3/users/46e92527362443fda56a0f53259813d1` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:47.496942 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93c3f6-73e7-49c6-b25f-6b7117a586d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=46e92527362443fda56a0f53259813d1)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:47.499129 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93c3f6-73e7-49c6-b25f-6b7117a586d0 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:47.500791 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 503/1010] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:25:47 2021] GET /identity/v3/users/46e92527362443fda56a0f53259813d1 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:47.508373 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250d633-4562-47d5-8126-dea63faa9cb5 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:47.519444 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250d633-4562-47d5-8126-dea63faa9cb5 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:47.525429 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a626b7-6c85-48b4-a07a-f9beae1fbcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:47.526072 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a626b7-6c85-48b4-a07a-f9beae1fbcaa admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:47.526351 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a626b7-6c85-48b4-a07a-f9beae1fbcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:47.526616 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a626b7-6c85-48b4-a07a-f9beae1fbcaa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:47.535080 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a626b7-6c85-48b4-a07a-f9beae1fbcaa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:47.536796 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a626b7-6c85-48b4-a07a-f9beae1fbcaa admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:47.545922 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 508/1011] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:25:47 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:25:47.553526 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93c3f6-73e7-49c6-b25f-6b7117a586d0 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:47.570073 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93c3f6-73e7-49c6-b25f-6b7117a586d0 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:47.579713 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa897f-06cc-4b64-a020-93ec9fca0371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:47.581068 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa897f-06cc-4b64-a020-93ec9fca0371 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:47.581542 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa897f-06cc-4b64-a020-93ec9fca0371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:47.581979 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa897f-06cc-4b64-a020-93ec9fca0371 admin admin] PATH_INFO: `/v3/projects/89d93f57c0064a11934e16c4d4eee581` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:47.584175 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa897f-06cc-4b64-a020-93ec9fca0371 admin admin] RBAC: Authorizing `identity:get_project(project_id=89d93f57c0064a11934e16c4d4eee581)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:47.586379 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa897f-06cc-4b64-a020-93ec9fca0371 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:47.588108 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 504/1012] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:25:47 2021] GET /identity/v3/projects/89d93f57c0064a11934e16c4d4eee581 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:47.598599 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a626b7-6c85-48b4-a07a-f9beae1fbcaa admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:47.612317 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a626b7-6c85-48b4-a07a-f9beae1fbcaa admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:47.619058 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c55a8-9c6e-4004-b18f-543d6d9370cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:47.619684 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c55a8-9c6e-4004-b18f-543d6d9370cc admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:47.619953 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c55a8-9c6e-4004-b18f-543d6d9370cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:47.620219 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c55a8-9c6e-4004-b18f-543d6d9370cc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:47.621091 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c55a8-9c6e-4004-b18f-543d6d9370cc admin admin] RBAC: Adding query filter params (role.id=08b906e1585f45668d988e46a5d2659a, scope.project.id=89d93f57c0064a11934e16c4d4eee581, user.id=46e92527362443fda56a0f53259813d1) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:47.621397 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c55a8-9c6e-4004-b18f-543d6d9370cc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:47.623241 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c55a8-9c6e-4004-b18f-543d6d9370cc admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:47.628724 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 509/1013] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:25:47 2021] GET /identity/v3/role_assignments?user.id=46e92527362443fda56a0f53259813d1&scope.project.id=89d93f57c0064a11934e16c4d4eee581&role.id=08b906e1585f45668d988e46a5d2659a => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:49.861156 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650c065-a174-4ccc-a362-d55744d27e3a None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:49.861733 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650c065-a174-4ccc-a362-d55744d27e3a None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:49.861733 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650c065-a174-4ccc-a362-d55744d27e3a None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:49.863533 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 505/1014] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:49.870817 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdd31b-6272-42af-9152-d2bcf9777241 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:49.871279 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdd31b-6272-42af-9152-d2bcf9777241 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:49.871372 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdd31b-6272-42af-9152-d2bcf9777241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:49.899543 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-1cbdd31b-6272-42af-9152-d2bcf9777241 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:49.900738 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-1cbdd31b-6272-42af-9152-d2bcf9777241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:49.909735 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 510/1015] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:49 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:49.934648 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650c065-a174-4ccc-a362-d55744d27e3a None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:49.957120 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650c065-a174-4ccc-a362-d55744d27e3a None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:49.964034 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea6800-d41f-4a17-befc-22b752d5a658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:49.964890 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea6800-d41f-4a17-befc-22b752d5a658 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:49.965172 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea6800-d41f-4a17-befc-22b752d5a658 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:49.965439 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea6800-d41f-4a17-befc-22b752d5a658 admin admin] PATH_INFO: `/v3/roles/08b906e1585f45668d988e46a5d2659a` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:49.967196 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea6800-d41f-4a17-befc-22b752d5a658 admin admin] RBAC: Authorizing `identity:get_role(role_id=08b906e1585f45668d988e46a5d2659a)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:49.968225 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING py.warnings [None req-53ea6800-d41f-4a17-befc-22b752d5a658 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:25:49.968225 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: warnings.warn(msg) Oct 28 14:25:49.968225 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: Oct 28 14:25:49.969115 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea6800-d41f-4a17-befc-22b752d5a658 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:49.970445 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 506/1016] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:25:49 2021] GET /identity/v3/roles/08b906e1585f45668d988e46a5d2659a => generated 223 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:49.976797 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdd31b-6272-42af-9152-d2bcf9777241 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:49.985858 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdd31b-6272-42af-9152-d2bcf9777241 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:49.991306 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900d6f2-5b14-4bb3-ae7a-6dfda76f1434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:49.992163 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900d6f2-5b14-4bb3-ae7a-6dfda76f1434 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:49.992441 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900d6f2-5b14-4bb3-ae7a-6dfda76f1434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:49.992713 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900d6f2-5b14-4bb3-ae7a-6dfda76f1434 admin admin] PATH_INFO: `/v3/users/46e92527362443fda56a0f53259813d1` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:49.994023 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900d6f2-5b14-4bb3-ae7a-6dfda76f1434 admin admin] RBAC: Authorizing `identity:get_user(user_id=46e92527362443fda56a0f53259813d1)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:49.996144 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900d6f2-5b14-4bb3-ae7a-6dfda76f1434 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:49.997699 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 511/1017] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:25:49 2021] GET /identity/v3/users/46e92527362443fda56a0f53259813d1 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:50.004166 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea6800-d41f-4a17-befc-22b752d5a658 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:50.015106 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea6800-d41f-4a17-befc-22b752d5a658 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:50.021284 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdb584-c2b4-4eae-b2b1-74ee08709d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:50.022097 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdb584-c2b4-4eae-b2b1-74ee08709d44 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:50.022369 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdb584-c2b4-4eae-b2b1-74ee08709d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:50.022635 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdb584-c2b4-4eae-b2b1-74ee08709d44 admin admin] PATH_INFO: `/v3/projects/89d93f57c0064a11934e16c4d4eee581` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:50.024139 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bdb584-c2b4-4eae-b2b1-74ee08709d44 admin admin] RBAC: Authorizing `identity:get_project(project_id=89d93f57c0064a11934e16c4d4eee581)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:50.026142 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bdb584-c2b4-4eae-b2b1-74ee08709d44 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:50.027795 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 507/1018] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:25:50 2021] GET /identity/v3/projects/89d93f57c0064a11934e16c4d4eee581 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:50.033907 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900d6f2-5b14-4bb3-ae7a-6dfda76f1434 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:50.043574 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900d6f2-5b14-4bb3-ae7a-6dfda76f1434 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:50.048847 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b56b1-7bfc-4208-87fb-7e4d55d7150f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:50.049669 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b56b1-7bfc-4208-87fb-7e4d55d7150f admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:50.049920 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b56b1-7bfc-4208-87fb-7e4d55d7150f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:50.050194 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b56b1-7bfc-4208-87fb-7e4d55d7150f admin admin] PATH_INFO: `/v3/projects/89d93f57c0064a11934e16c4d4eee581/users/46e92527362443fda56a0f53259813d1/roles/08b906e1585f45668d988e46a5d2659a` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:50.052976 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b56b1-7bfc-4208-87fb-7e4d55d7150f admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d93f57c0064a11934e16c4d4eee581, user_id=46e92527362443fda56a0f53259813d1, role_id=08b906e1585f45668d988e46a5d2659a)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:50.055554 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b56b1-7bfc-4208-87fb-7e4d55d7150f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:50.071848 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 512/1019] 10.222.0.79 () {58 vars in 1460 bytes} [Thu Oct 28 14:25:50 2021] PUT /identity/v3/projects/89d93f57c0064a11934e16c4d4eee581/users/46e92527362443fda56a0f53259813d1/roles/08b906e1585f45668d988e46a5d2659a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:25:52.301478 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d24981-7941-4bda-ac24-b03bfc96d9d8 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:52.302061 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d24981-7941-4bda-ac24-b03bfc96d9d8 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:52.302162 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d24981-7941-4bda-ac24-b03bfc96d9d8 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:52.304033 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 508/1020] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:52.311872 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ca1b6-c8bc-42c5-bc43-b53898f1e530 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:52.312610 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ca1b6-c8bc-42c5-bc43-b53898f1e530 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:52.312764 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ca1b6-c8bc-42c5-bc43-b53898f1e530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:52.335521 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-b80ca1b6-c8bc-42c5-bc43-b53898f1e530 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:52.336729 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-b80ca1b6-c8bc-42c5-bc43-b53898f1e530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:52.403129 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 513/1021] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:52 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:52.432514 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d24981-7941-4bda-ac24-b03bfc96d9d8 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:52.447152 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d24981-7941-4bda-ac24-b03bfc96d9d8 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:52.453087 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2542db6-a145-4ae4-9ed1-fb1dc9c30c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:52.453950 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2542db6-a145-4ae4-9ed1-fb1dc9c30c54 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:52.454252 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2542db6-a145-4ae4-9ed1-fb1dc9c30c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:52.454496 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2542db6-a145-4ae4-9ed1-fb1dc9c30c54 admin admin] PATH_INFO: `/v3/roles/08b906e1585f45668d988e46a5d2659a` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:52.456173 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2542db6-a145-4ae4-9ed1-fb1dc9c30c54 admin admin] RBAC: Authorizing `identity:get_role(role_id=08b906e1585f45668d988e46a5d2659a)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:52.457819 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2542db6-a145-4ae4-9ed1-fb1dc9c30c54 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:52.459209 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 509/1022] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:25:52 2021] GET /identity/v3/roles/08b906e1585f45668d988e46a5d2659a => generated 223 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:52.466246 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ca1b6-c8bc-42c5-bc43-b53898f1e530 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:52.478946 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ca1b6-c8bc-42c5-bc43-b53898f1e530 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:52.485131 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8014c0-2bcd-42eb-8d0c-5a388d267928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:52.485998 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8014c0-2bcd-42eb-8d0c-5a388d267928 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:52.486271 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8014c0-2bcd-42eb-8d0c-5a388d267928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:52.486548 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8014c0-2bcd-42eb-8d0c-5a388d267928 admin admin] PATH_INFO: `/v3/users/46e92527362443fda56a0f53259813d1` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:52.488003 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8014c0-2bcd-42eb-8d0c-5a388d267928 admin admin] RBAC: Authorizing `identity:get_user(user_id=46e92527362443fda56a0f53259813d1)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:52.490149 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8014c0-2bcd-42eb-8d0c-5a388d267928 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:52.491774 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 514/1023] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:25:52 2021] GET /identity/v3/users/46e92527362443fda56a0f53259813d1 => generated 286 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:52.501473 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2542db6-a145-4ae4-9ed1-fb1dc9c30c54 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:52.513347 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2542db6-a145-4ae4-9ed1-fb1dc9c30c54 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:52.519443 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ab7b5-5bb2-4d49-8fcf-2cf5002eb7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:52.520059 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ab7b5-5bb2-4d49-8fcf-2cf5002eb7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:52.520338 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ab7b5-5bb2-4d49-8fcf-2cf5002eb7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:52.520604 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ab7b5-5bb2-4d49-8fcf-2cf5002eb7a8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:52.529490 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ab7b5-5bb2-4d49-8fcf-2cf5002eb7a8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:52.531246 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ab7b5-5bb2-4d49-8fcf-2cf5002eb7a8 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:52.540054 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 510/1024] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:25:52 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:25:52.546614 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8014c0-2bcd-42eb-8d0c-5a388d267928 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:52.557963 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8014c0-2bcd-42eb-8d0c-5a388d267928 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:52.564435 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42cae7-8a50-4c15-b0d6-c9e3741736c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:52.565266 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42cae7-8a50-4c15-b0d6-c9e3741736c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:52.565544 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42cae7-8a50-4c15-b0d6-c9e3741736c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:52.565814 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42cae7-8a50-4c15-b0d6-c9e3741736c2 admin admin] PATH_INFO: `/v3/projects/89d93f57c0064a11934e16c4d4eee581` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:52.567243 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42cae7-8a50-4c15-b0d6-c9e3741736c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=89d93f57c0064a11934e16c4d4eee581)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:52.569342 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42cae7-8a50-4c15-b0d6-c9e3741736c2 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:52.570999 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 515/1025] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:25:52 2021] GET /identity/v3/projects/89d93f57c0064a11934e16c4d4eee581 => generated 311 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:52.577312 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ab7b5-5bb2-4d49-8fcf-2cf5002eb7a8 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:52.586923 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ab7b5-5bb2-4d49-8fcf-2cf5002eb7a8 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:52.592473 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae62767-35ea-409c-9997-5e9f9817ad54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:52.593113 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae62767-35ea-409c-9997-5e9f9817ad54 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:52.593391 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae62767-35ea-409c-9997-5e9f9817ad54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:52.593662 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae62767-35ea-409c-9997-5e9f9817ad54 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:52.594500 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae62767-35ea-409c-9997-5e9f9817ad54 admin admin] RBAC: Adding query filter params (role.id=08b906e1585f45668d988e46a5d2659a, scope.project.id=89d93f57c0064a11934e16c4d4eee581, user.id=46e92527362443fda56a0f53259813d1) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:52.594846 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae62767-35ea-409c-9997-5e9f9817ad54 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:52.596669 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae62767-35ea-409c-9997-5e9f9817ad54 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:52.603369 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 511/1026] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:25:52 2021] GET /identity/v3/role_assignments?user.id=46e92527362443fda56a0f53259813d1&scope.project.id=89d93f57c0064a11934e16c4d4eee581&role.id=08b906e1585f45668d988e46a5d2659a => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:54.856406 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe5066-c53b-47b5-8e7b-8f1298c06cd9 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:54.857015 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe5066-c53b-47b5-8e7b-8f1298c06cd9 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:54.857015 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe5066-c53b-47b5-8e7b-8f1298c06cd9 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:54.858708 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 516/1027] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:54.865904 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecdc2f-9e08-4f06-96a2-d52a57bab00a None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:54.866670 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecdc2f-9e08-4f06-96a2-d52a57bab00a None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:54.866854 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecdc2f-9e08-4f06-96a2-d52a57bab00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:54.890929 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-deecdc2f-9e08-4f06-96a2-d52a57bab00a None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:54.892116 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-deecdc2f-9e08-4f06-96a2-d52a57bab00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:54.904250 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 512/1028] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:54 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:54.938973 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe5066-c53b-47b5-8e7b-8f1298c06cd9 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:54.960383 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe5066-c53b-47b5-8e7b-8f1298c06cd9 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:54.966053 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1953a-692c-4633-a018-155b131da847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:54.966857 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1953a-692c-4633-a018-155b131da847 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:54.967138 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1953a-692c-4633-a018-155b131da847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:54.967410 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1953a-692c-4633-a018-155b131da847 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:54.968632 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1953a-692c-4633-a018-155b131da847 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:54.970295 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1953a-692c-4633-a018-155b131da847 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:54.971893 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 517/1029] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:54 2021] GET /identity/v3/domains/default => generated 199 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:54.984926 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deecdc2f-9e08-4f06-96a2-d52a57bab00a None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:54.999970 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deecdc2f-9e08-4f06-96a2-d52a57bab00a None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:55.006450 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90c9b1-69a3-422e-8fc1-4e59248b1b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:55.007139 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90c9b1-69a3-422e-8fc1-4e59248b1b06 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:55.007411 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90c9b1-69a3-422e-8fc1-4e59248b1b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:55.007682 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90c9b1-69a3-422e-8fc1-4e59248b1b06 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:55.008406 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90c9b1-69a3-422e-8fc1-4e59248b1b06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:55.010307 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90c9b1-69a3-422e-8fc1-4e59248b1b06 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:55.039158 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 513/1030] 10.222.0.79 () {60 vars in 1162 bytes} [Thu Oct 28 14:25:54 2021] POST /identity/v3/projects => generated 311 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:25:57.292607 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3e2ad-7c9d-498b-8b4c-3f7137349cb9 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:57.293159 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3e2ad-7c9d-498b-8b4c-3f7137349cb9 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:57.293159 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3e2ad-7c9d-498b-8b4c-3f7137349cb9 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:57.294824 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 518/1031] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:57.302356 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657770a6-d919-4d06-b8ba-d1dd82204b4a None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:57.303079 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657770a6-d919-4d06-b8ba-d1dd82204b4a None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:57.303172 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657770a6-d919-4d06-b8ba-d1dd82204b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:57.322420 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-657770a6-d919-4d06-b8ba-d1dd82204b4a None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:57.323640 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-657770a6-d919-4d06-b8ba-d1dd82204b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:57.385918 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 514/1032] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:57 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:57.413910 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3e2ad-7c9d-498b-8b4c-3f7137349cb9 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:57.429766 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3e2ad-7c9d-498b-8b4c-3f7137349cb9 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:57.434972 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85addb38-acd0-4b07-9102-914a6b9a0b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:57.435756 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85addb38-acd0-4b07-9102-914a6b9a0b3b admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:57.436034 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85addb38-acd0-4b07-9102-914a6b9a0b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:57.436309 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85addb38-acd0-4b07-9102-914a6b9a0b3b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:57.437525 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85addb38-acd0-4b07-9102-914a6b9a0b3b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:57.439239 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85addb38-acd0-4b07-9102-914a6b9a0b3b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:57.440817 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 519/1033] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:25:57 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:57.448089 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657770a6-d919-4d06-b8ba-d1dd82204b4a None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:57.461329 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657770a6-d919-4d06-b8ba-d1dd82204b4a None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:57.467679 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5465b4-5ac1-475d-a0c4-c83a570efcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:57.468338 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5465b4-5ac1-475d-a0c4-c83a570efcad admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:57.468613 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5465b4-5ac1-475d-a0c4-c83a570efcad admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:57.468882 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5465b4-5ac1-475d-a0c4-c83a570efcad admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:57.469599 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5465b4-5ac1-475d-a0c4-c83a570efcad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:57.471536 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5465b4-5ac1-475d-a0c4-c83a570efcad admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:57.496026 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 515/1034] 10.222.0.79 () {60 vars in 1153 bytes} [Thu Oct 28 14:25:57 2021] POST /identity/v3/users => generated 286 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:25:59.768314 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfa643-1a73-4347-9fe6-5dcca586582d None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:59.768919 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfa643-1a73-4347-9fe6-5dcca586582d None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:59.768919 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfa643-1a73-4347-9fe6-5dcca586582d None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:59.770601 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 520/1035] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:25:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:25:59.777878 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc86aa-3f59-4c75-8bd5-07c45444d77d None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:59.778629 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc86aa-3f59-4c75-8bd5-07c45444d77d None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:59.778895 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc86aa-3f59-4c75-8bd5-07c45444d77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:59.801895 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-c0fc86aa-3f59-4c75-8bd5-07c45444d77d None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:25:59.803122 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-c0fc86aa-3f59-4c75-8bd5-07c45444d77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:25:59.811437 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 516/1036] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:25:59 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:25:59.835992 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcfa643-1a73-4347-9fe6-5dcca586582d None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:59.850120 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcfa643-1a73-4347-9fe6-5dcca586582d None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:59.855445 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d62aa-fece-48eb-a725-c9a00254009a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:59.856276 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d62aa-fece-48eb-a725-c9a00254009a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:59.856551 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d62aa-fece-48eb-a725-c9a00254009a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:59.856814 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d62aa-fece-48eb-a725-c9a00254009a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:59.866917 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d62aa-fece-48eb-a725-c9a00254009a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:25:59.873575 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-756d62aa-fece-48eb-a725-c9a00254009a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:25:59.874729 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 521/1037] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:25:59 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:25:59.881976 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc86aa-3f59-4c75-8bd5-07c45444d77d None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:59.896522 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc86aa-3f59-4c75-8bd5-07c45444d77d None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:59.905433 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ff5a5-19c4-4069-b4e5-1c46954cf679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:59.906456 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ff5a5-19c4-4069-b4e5-1c46954cf679 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:59.907600 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ff5a5-19c4-4069-b4e5-1c46954cf679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:59.907600 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ff5a5-19c4-4069-b4e5-1c46954cf679 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:59.908665 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ff5a5-19c4-4069-b4e5-1c46954cf679 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:25:59.909177 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ff5a5-19c4-4069-b4e5-1c46954cf679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:59.911870 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ff5a5-19c4-4069-b4e5-1c46954cf679 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:59.921654 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 517/1038] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:25:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:59.929190 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d62aa-fece-48eb-a725-c9a00254009a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:59.945365 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d62aa-fece-48eb-a725-c9a00254009a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:25:59.951188 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97eb177-4d54-41e2-8467-68b26614940e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:25:59.952054 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97eb177-4d54-41e2-8467-68b26614940e admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:25:59.952326 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97eb177-4d54-41e2-8467-68b26614940e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:25:59.952587 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97eb177-4d54-41e2-8467-68b26614940e admin admin] PATH_INFO: `/v3/users/eaffa85288f148eb9290b7d1f03d54fa` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:25:59.966207 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97eb177-4d54-41e2-8467-68b26614940e admin admin] RBAC: Authorizing `identity:get_user(user_id=eaffa85288f148eb9290b7d1f03d54fa)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:25:59.968356 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97eb177-4d54-41e2-8467-68b26614940e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:25:59.969955 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 522/1039] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:25:59 2021] GET /identity/v3/users/eaffa85288f148eb9290b7d1f03d54fa => generated 286 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:25:59.977015 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ff5a5-19c4-4069-b4e5-1c46954cf679 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:25:59.992949 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ff5a5-19c4-4069-b4e5-1c46954cf679 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:00.001810 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdf2dc-db1a-4c89-89d8-6e972ec605d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:00.002854 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdf2dc-db1a-4c89-89d8-6e972ec605d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:00.003260 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdf2dc-db1a-4c89-89d8-6e972ec605d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:00.003658 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdf2dc-db1a-4c89-89d8-6e972ec605d2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:00.012706 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdf2dc-db1a-4c89-89d8-6e972ec605d2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:00.014453 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdf2dc-db1a-4c89-89d8-6e972ec605d2 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:00.023290 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 518/1040] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:25:59 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:26:00.033657 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97eb177-4d54-41e2-8467-68b26614940e admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:00.045040 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97eb177-4d54-41e2-8467-68b26614940e admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:00.051179 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ccb2a0-1714-4378-8d57-f9b3aa4493e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:00.052019 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccb2a0-1714-4378-8d57-f9b3aa4493e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:00.052293 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccb2a0-1714-4378-8d57-f9b3aa4493e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:00.052581 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccb2a0-1714-4378-8d57-f9b3aa4493e6 admin admin] PATH_INFO: `/v3/projects/e297121334bb408f923eb48a2aa9f230` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:00.053893 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ccb2a0-1714-4378-8d57-f9b3aa4493e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=e297121334bb408f923eb48a2aa9f230)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:00.055931 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ccb2a0-1714-4378-8d57-f9b3aa4493e6 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:00.057533 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 523/1041] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:26:00 2021] GET /identity/v3/projects/e297121334bb408f923eb48a2aa9f230 => generated 311 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:26:00.064015 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdf2dc-db1a-4c89-89d8-6e972ec605d2 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:00.073069 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdf2dc-db1a-4c89-89d8-6e972ec605d2 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:00.078883 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6835a6-d2e4-491d-b07f-044467602ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:00.079505 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6835a6-d2e4-491d-b07f-044467602ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:00.079786 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6835a6-d2e4-491d-b07f-044467602ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:00.080055 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6835a6-d2e4-491d-b07f-044467602ab3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:00.080885 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6835a6-d2e4-491d-b07f-044467602ab3 admin admin] RBAC: Adding query filter params (role.id=f7b8954a0fe64dc2b6146c7174498ddb, scope.project.id=e297121334bb408f923eb48a2aa9f230, user.id=eaffa85288f148eb9290b7d1f03d54fa) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:26:00.081191 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6835a6-d2e4-491d-b07f-044467602ab3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:00.083048 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6835a6-d2e4-491d-b07f-044467602ab3 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:00.088798 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 519/1042] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:26:00 2021] GET /identity/v3/role_assignments?user.id=eaffa85288f148eb9290b7d1f03d54fa&scope.project.id=e297121334bb408f923eb48a2aa9f230&role.id=f7b8954a0fe64dc2b6146c7174498ddb => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:26:02.300484 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299554f2-ac82-4b12-bdd7-2fcd05fccb57 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:02.301350 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299554f2-ac82-4b12-bdd7-2fcd05fccb57 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:02.301350 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299554f2-ac82-4b12-bdd7-2fcd05fccb57 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:02.304177 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 524/1043] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:26:02 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:26:02.311384 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d1b78-73ae-4596-8c96-2acbe4347263 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:02.312164 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d1b78-73ae-4596-8c96-2acbe4347263 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:02.312308 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d1b78-73ae-4596-8c96-2acbe4347263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:02.333504 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-131d1b78-73ae-4596-8c96-2acbe4347263 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:26:02.334721 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-131d1b78-73ae-4596-8c96-2acbe4347263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:26:02.343912 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 520/1044] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:26:02 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:26:02.368218 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299554f2-ac82-4b12-bdd7-2fcd05fccb57 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:02.387242 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299554f2-ac82-4b12-bdd7-2fcd05fccb57 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:02.393352 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9251e-8ca3-4c34-9edc-b1fc4a8f691f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:02.394122 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9251e-8ca3-4c34-9edc-b1fc4a8f691f admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:02.394400 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9251e-8ca3-4c34-9edc-b1fc4a8f691f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:02.394668 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9251e-8ca3-4c34-9edc-b1fc4a8f691f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:02.405708 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9251e-8ca3-4c34-9edc-b1fc4a8f691f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:26:02.412490 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-03f9251e-8ca3-4c34-9edc-b1fc4a8f691f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:26:02.413630 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 525/1045] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:26:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:26:02.424009 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d1b78-73ae-4596-8c96-2acbe4347263 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:02.435736 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d1b78-73ae-4596-8c96-2acbe4347263 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:02.442276 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f898a89-e3b6-490d-a65e-a6f60d5172ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:02.442987 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f898a89-e3b6-490d-a65e-a6f60d5172ac admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:02.445589 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f898a89-e3b6-490d-a65e-a6f60d5172ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:02.445874 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f898a89-e3b6-490d-a65e-a6f60d5172ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:02.446649 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f898a89-e3b6-490d-a65e-a6f60d5172ac admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:26:02.446978 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f898a89-e3b6-490d-a65e-a6f60d5172ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:02.448597 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f898a89-e3b6-490d-a65e-a6f60d5172ac admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:02.458325 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 521/1046] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:26:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:26:02.465759 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9251e-8ca3-4c34-9edc-b1fc4a8f691f admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:02.488083 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9251e-8ca3-4c34-9edc-b1fc4a8f691f admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:02.495309 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d19e9-1473-4e59-9b93-d55abd5890cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:02.496172 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d19e9-1473-4e59-9b93-d55abd5890cc admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:02.496448 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d19e9-1473-4e59-9b93-d55abd5890cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:02.496716 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d19e9-1473-4e59-9b93-d55abd5890cc admin admin] PATH_INFO: `/v3/users/eaffa85288f148eb9290b7d1f03d54fa` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:02.498131 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d19e9-1473-4e59-9b93-d55abd5890cc admin admin] RBAC: Authorizing `identity:get_user(user_id=eaffa85288f148eb9290b7d1f03d54fa)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:02.500284 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d19e9-1473-4e59-9b93-d55abd5890cc admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:02.501882 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 526/1047] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:26:02 2021] GET /identity/v3/users/eaffa85288f148eb9290b7d1f03d54fa => generated 286 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:26:02.511929 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f898a89-e3b6-490d-a65e-a6f60d5172ac admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:02.525816 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f898a89-e3b6-490d-a65e-a6f60d5172ac admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:02.532309 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5e6e4-d7b3-4700-891a-72be9d402375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:02.533155 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5e6e4-d7b3-4700-891a-72be9d402375 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:02.533428 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5e6e4-d7b3-4700-891a-72be9d402375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:02.533694 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5e6e4-d7b3-4700-891a-72be9d402375 admin admin] PATH_INFO: `/v3/projects/e297121334bb408f923eb48a2aa9f230` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:02.535111 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5e6e4-d7b3-4700-891a-72be9d402375 admin admin] RBAC: Authorizing `identity:get_project(project_id=e297121334bb408f923eb48a2aa9f230)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:02.537148 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5e6e4-d7b3-4700-891a-72be9d402375 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:02.538812 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 522/1048] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:26:02 2021] GET /identity/v3/projects/e297121334bb408f923eb48a2aa9f230 => generated 311 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:26:02.545314 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d19e9-1473-4e59-9b93-d55abd5890cc admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:02.556229 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d19e9-1473-4e59-9b93-d55abd5890cc admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:02.561912 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd53912-cc29-49e4-aa75-ebfa66225dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:02.562795 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd53912-cc29-49e4-aa75-ebfa66225dde admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:02.563071 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd53912-cc29-49e4-aa75-ebfa66225dde admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:02.563336 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd53912-cc29-49e4-aa75-ebfa66225dde admin admin] PATH_INFO: `/v3/projects/e297121334bb408f923eb48a2aa9f230/users/eaffa85288f148eb9290b7d1f03d54fa/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:02.565563 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd53912-cc29-49e4-aa75-ebfa66225dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=e297121334bb408f923eb48a2aa9f230, user_id=eaffa85288f148eb9290b7d1f03d54fa, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:02.568177 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd53912-cc29-49e4-aa75-ebfa66225dde admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:02.585987 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 527/1049] 10.222.0.79 () {58 vars in 1460 bytes} [Thu Oct 28 14:26:02 2021] PUT /identity/v3/projects/e297121334bb408f923eb48a2aa9f230/users/eaffa85288f148eb9290b7d1f03d54fa/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:26:04.784901 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4f93f-8759-413e-867a-5cd9c3c7e2bf None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:04.785822 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4f93f-8759-413e-867a-5cd9c3c7e2bf None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:04.785822 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4f93f-8759-413e-867a-5cd9c3c7e2bf None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:04.788774 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 523/1050] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:26:04 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:26:04.795883 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba0304-c443-4da5-98e5-eaf01087254f None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:04.796314 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba0304-c443-4da5-98e5-eaf01087254f None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:04.796437 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba0304-c443-4da5-98e5-eaf01087254f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:04.817757 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-d2ba0304-c443-4da5-98e5-eaf01087254f None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:26:04.819018 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-d2ba0304-c443-4da5-98e5-eaf01087254f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:26:04.882788 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 528/1051] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:26:04 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:26:04.908079 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4f93f-8759-413e-867a-5cd9c3c7e2bf None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:04.927100 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4f93f-8759-413e-867a-5cd9c3c7e2bf None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:04.932393 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3466a7-f80c-46b9-9807-2e429240150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:04.933168 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3466a7-f80c-46b9-9807-2e429240150a admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:04.933443 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3466a7-f80c-46b9-9807-2e429240150a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:04.933703 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3466a7-f80c-46b9-9807-2e429240150a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:04.945332 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3466a7-f80c-46b9-9807-2e429240150a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:26:04.952001 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-8a3466a7-f80c-46b9-9807-2e429240150a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:26:04.953148 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 524/1052] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:26:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:26:04.959946 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba0304-c443-4da5-98e5-eaf01087254f None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:04.968941 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba0304-c443-4da5-98e5-eaf01087254f None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:04.974228 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca268a-00e4-4014-a22c-200274d339b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:04.974925 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca268a-00e4-4014-a22c-200274d339b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:04.975198 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca268a-00e4-4014-a22c-200274d339b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:04.975465 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca268a-00e4-4014-a22c-200274d339b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:04.976223 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca268a-00e4-4014-a22c-200274d339b7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:26:04.976519 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca268a-00e4-4014-a22c-200274d339b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:04.978100 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca268a-00e4-4014-a22c-200274d339b7 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:04.986459 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 529/1053] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:26:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:26:04.992678 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3466a7-f80c-46b9-9807-2e429240150a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:05.002879 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3466a7-f80c-46b9-9807-2e429240150a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:05.008254 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753f4ab-7665-4ce4-b375-2e73a6d74759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:05.009074 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753f4ab-7665-4ce4-b375-2e73a6d74759 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:05.009347 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753f4ab-7665-4ce4-b375-2e73a6d74759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:05.009616 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753f4ab-7665-4ce4-b375-2e73a6d74759 admin admin] PATH_INFO: `/v3/users/eaffa85288f148eb9290b7d1f03d54fa` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:05.010956 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753f4ab-7665-4ce4-b375-2e73a6d74759 admin admin] RBAC: Authorizing `identity:get_user(user_id=eaffa85288f148eb9290b7d1f03d54fa)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:05.013045 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753f4ab-7665-4ce4-b375-2e73a6d74759 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:05.014597 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 525/1054] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:26:04 2021] GET /identity/v3/users/eaffa85288f148eb9290b7d1f03d54fa => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:26:05.021293 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca268a-00e4-4014-a22c-200274d339b7 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:05.037169 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca268a-00e4-4014-a22c-200274d339b7 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:05.043657 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1641aa-aa3c-486d-9426-0e701786df3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:05.044280 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1641aa-aa3c-486d-9426-0e701786df3d admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:05.044558 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1641aa-aa3c-486d-9426-0e701786df3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:05.044827 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1641aa-aa3c-486d-9426-0e701786df3d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:05.053500 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1641aa-aa3c-486d-9426-0e701786df3d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:05.055259 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1641aa-aa3c-486d-9426-0e701786df3d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:05.063941 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 530/1055] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:26:05 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:26:05.072095 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753f4ab-7665-4ce4-b375-2e73a6d74759 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:05.081649 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753f4ab-7665-4ce4-b375-2e73a6d74759 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:05.086592 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a7a41-fb3c-4333-99b2-59c13f8746ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:05.087431 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a7a41-fb3c-4333-99b2-59c13f8746ed admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:05.087708 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a7a41-fb3c-4333-99b2-59c13f8746ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:05.087981 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a7a41-fb3c-4333-99b2-59c13f8746ed admin admin] PATH_INFO: `/v3/projects/e297121334bb408f923eb48a2aa9f230` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:05.089199 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a7a41-fb3c-4333-99b2-59c13f8746ed admin admin] RBAC: Authorizing `identity:get_project(project_id=e297121334bb408f923eb48a2aa9f230)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:05.091228 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a7a41-fb3c-4333-99b2-59c13f8746ed admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:05.092835 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 526/1056] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:26:05 2021] GET /identity/v3/projects/e297121334bb408f923eb48a2aa9f230 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:26:05.099923 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1641aa-aa3c-486d-9426-0e701786df3d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:05.114446 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1641aa-aa3c-486d-9426-0e701786df3d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:05.123544 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9480c6-ff3a-4664-a7bb-33e5f8263f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:05.124398 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9480c6-ff3a-4664-a7bb-33e5f8263f37 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:05.124680 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9480c6-ff3a-4664-a7bb-33e5f8263f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:05.124956 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9480c6-ff3a-4664-a7bb-33e5f8263f37 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:05.126186 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9480c6-ff3a-4664-a7bb-33e5f8263f37 admin admin] RBAC: Adding query filter params (role.id=f7b8954a0fe64dc2b6146c7174498ddb, scope.project.id=e297121334bb408f923eb48a2aa9f230, user.id=eaffa85288f148eb9290b7d1f03d54fa) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:26:05.126609 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9480c6-ff3a-4664-a7bb-33e5f8263f37 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:05.129545 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9480c6-ff3a-4664-a7bb-33e5f8263f37 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:05.137559 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 531/1057] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:26:05 2021] GET /identity/v3/role_assignments?user.id=eaffa85288f148eb9290b7d1f03d54fa&scope.project.id=e297121334bb408f923eb48a2aa9f230&role.id=f7b8954a0fe64dc2b6146c7174498ddb => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:26:07.391990 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984a8c3-a196-4cc0-b08b-8b99834043d8 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:07.392834 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984a8c3-a196-4cc0-b08b-8b99834043d8 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:07.392834 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984a8c3-a196-4cc0-b08b-8b99834043d8 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:07.395643 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 527/1058] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:26:07 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:26:07.404788 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cc5d6-edc8-4134-9de3-6daaf02de09e None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:07.405226 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cc5d6-edc8-4134-9de3-6daaf02de09e None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:07.405315 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cc5d6-edc8-4134-9de3-6daaf02de09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:07.424759 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-8d8cc5d6-edc8-4134-9de3-6daaf02de09e None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:26:07.426283 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-8d8cc5d6-edc8-4134-9de3-6daaf02de09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:26:07.434448 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 532/1059] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:26:07 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:26:07.458008 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984a8c3-a196-4cc0-b08b-8b99834043d8 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:07.473616 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984a8c3-a196-4cc0-b08b-8b99834043d8 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:07.479236 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3e957-7b12-4b6e-80e2-045f0cfe6b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:07.479862 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3e957-7b12-4b6e-80e2-045f0cfe6b90 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:07.480142 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3e957-7b12-4b6e-80e2-045f0cfe6b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:07.480414 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3e957-7b12-4b6e-80e2-045f0cfe6b90 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:07.488394 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3e957-7b12-4b6e-80e2-045f0cfe6b90 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:07.490164 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3e957-7b12-4b6e-80e2-045f0cfe6b90 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:07.499123 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 528/1060] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:26:07 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:26:07.506240 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cc5d6-edc8-4134-9de3-6daaf02de09e None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:07.522360 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cc5d6-edc8-4134-9de3-6daaf02de09e None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:07.530932 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cc84f-acff-4fe3-9f17-1b850c73018e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:07.532186 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cc84f-acff-4fe3-9f17-1b850c73018e admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:07.532645 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cc84f-acff-4fe3-9f17-1b850c73018e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:07.533084 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cc84f-acff-4fe3-9f17-1b850c73018e admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:07.542614 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cc84f-acff-4fe3-9f17-1b850c73018e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:07.544490 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cc84f-acff-4fe3-9f17-1b850c73018e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:07.560227 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-218cc84f-acff-4fe3-9f17-1b850c73018e admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 28 14:26:07.561395 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 533/1061] 10.222.0.79 () {56 vars in 1138 bytes} [Thu Oct 28 14:26:07 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:26:07.569613 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3e957-7b12-4b6e-80e2-045f0cfe6b90 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:07.579276 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3e957-7b12-4b6e-80e2-045f0cfe6b90 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:07.585384 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70313cb7-a022-4229-ab8e-6efa921e027f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:07.586044 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70313cb7-a022-4229-ab8e-6efa921e027f admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:07.586326 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70313cb7-a022-4229-ab8e-6efa921e027f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:07.586592 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70313cb7-a022-4229-ab8e-6efa921e027f admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:07.587374 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70313cb7-a022-4229-ab8e-6efa921e027f admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:26:07.587678 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70313cb7-a022-4229-ab8e-6efa921e027f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:07.589280 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70313cb7-a022-4229-ab8e-6efa921e027f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:07.597060 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 529/1062] 10.222.0.79 () {56 vars in 1136 bytes} [Thu Oct 28 14:26:07 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:26:09.818704 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464ad0a-9799-42ea-8ae8-bb311dfa95f0 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:09.819280 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464ad0a-9799-42ea-8ae8-bb311dfa95f0 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:09.819280 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464ad0a-9799-42ea-8ae8-bb311dfa95f0 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:09.821053 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 534/1063] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:26:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:26:09.828265 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964236cf-2712-4bc9-849a-4caa836eff92 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:09.828967 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964236cf-2712-4bc9-849a-4caa836eff92 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:09.829111 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964236cf-2712-4bc9-849a-4caa836eff92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:09.855724 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-964236cf-2712-4bc9-849a-4caa836eff92 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:26:09.856906 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-964236cf-2712-4bc9-849a-4caa836eff92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:26:09.866495 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 530/1064] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:26:09 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:26:09.895825 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464ad0a-9799-42ea-8ae8-bb311dfa95f0 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:09.910513 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464ad0a-9799-42ea-8ae8-bb311dfa95f0 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:09.916499 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f66b4-126a-4dea-8650-a3535838f75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:09.917154 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f66b4-126a-4dea-8650-a3535838f75f admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:09.917433 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f66b4-126a-4dea-8650-a3535838f75f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:09.917703 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f66b4-126a-4dea-8650-a3535838f75f admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:09.918457 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f66b4-126a-4dea-8650-a3535838f75f admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:09.919505 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING py.warnings [None req-aa5f66b4-126a-4dea-8650-a3535838f75f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:26:09.919505 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: warnings.warn(msg) Oct 28 14:26:09.919505 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: Oct 28 14:26:09.920372 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f66b4-126a-4dea-8650-a3535838f75f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:09.939175 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 535/1065] 10.222.0.79 () {60 vars in 1159 bytes} [Thu Oct 28 14:26:09 2021] POST /identity/v3/domains => generated 267 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:26:12.195240 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2d3a1-cb69-4fb6-96ca-c66a409bc46c None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:12.196065 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2d3a1-cb69-4fb6-96ca-c66a409bc46c None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:12.196065 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2d3a1-cb69-4fb6-96ca-c66a409bc46c None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:12.198935 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 531/1066] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:26:12 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:26:12.205904 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491049d-3415-48f4-901f-f743b7a87ebe None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:12.206640 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491049d-3415-48f4-901f-f743b7a87ebe None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:12.206829 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491049d-3415-48f4-901f-f743b7a87ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:12.228203 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-2491049d-3415-48f4-901f-f743b7a87ebe None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:26:12.229398 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-2491049d-3415-48f4-901f-f743b7a87ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:26:12.289879 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 536/1067] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:26:12 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:26:12.319880 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2d3a1-cb69-4fb6-96ca-c66a409bc46c None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:12.339674 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2d3a1-cb69-4fb6-96ca-c66a409bc46c None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:12.345969 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0f5b9-cbff-40ef-b54d-7f42012364fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:12.346855 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0f5b9-cbff-40ef-b54d-7f42012364fb admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:12.347137 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0f5b9-cbff-40ef-b54d-7f42012364fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:12.347408 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0f5b9-cbff-40ef-b54d-7f42012364fb admin admin] PATH_INFO: `/v3/domains/feac97c1527446cca638a5c38e276239` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:12.359277 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0f5b9-cbff-40ef-b54d-7f42012364fb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=feac97c1527446cca638a5c38e276239)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:12.361255 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0f5b9-cbff-40ef-b54d-7f42012364fb admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:12.362888 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 532/1068] 10.222.0.79 () {56 vars in 1204 bytes} [Thu Oct 28 14:26:12 2021] GET /identity/v3/domains/feac97c1527446cca638a5c38e276239 => generated 267 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:26:12.370158 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491049d-3415-48f4-901f-f743b7a87ebe None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:12.379494 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491049d-3415-48f4-901f-f743b7a87ebe None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:12.386131 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8462806-eb74-4226-8b89-5e2c305bf967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:12.386820 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8462806-eb74-4226-8b89-5e2c305bf967 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:12.387093 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8462806-eb74-4226-8b89-5e2c305bf967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:12.387355 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8462806-eb74-4226-8b89-5e2c305bf967 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:12.388068 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8462806-eb74-4226-8b89-5e2c305bf967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:12.389937 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8462806-eb74-4226-8b89-5e2c305bf967 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:12.420262 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 537/1069] 10.222.0.79 () {60 vars in 1162 bytes} [Thu Oct 28 14:26:12 2021] POST /identity/v3/projects => generated 361 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:26:14.701639 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b6b5d-adc1-47ca-93cb-d6fccf389c92 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:14.702242 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b6b5d-adc1-47ca-93cb-d6fccf389c92 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:14.702242 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b6b5d-adc1-47ca-93cb-d6fccf389c92 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:14.704004 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 533/1070] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:26:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:26:14.711384 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3cd0f-a6f6-4387-a580-3a6de59a1914 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:14.711838 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3cd0f-a6f6-4387-a580-3a6de59a1914 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:14.711940 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3cd0f-a6f6-4387-a580-3a6de59a1914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:14.741388 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-dee3cd0f-a6f6-4387-a580-3a6de59a1914 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:26:14.742570 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-dee3cd0f-a6f6-4387-a580-3a6de59a1914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:26:14.802103 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 538/1071] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:26:14 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:26:14.828993 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b6b5d-adc1-47ca-93cb-d6fccf389c92 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:14.844172 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b6b5d-adc1-47ca-93cb-d6fccf389c92 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:14.849996 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6a483-ef3e-4bb7-8d4a-854d1839ae5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:14.850889 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6a483-ef3e-4bb7-8d4a-854d1839ae5c admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:14.851168 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6a483-ef3e-4bb7-8d4a-854d1839ae5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:14.851438 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6a483-ef3e-4bb7-8d4a-854d1839ae5c admin admin] PATH_INFO: `/v3/domains/feac97c1527446cca638a5c38e276239` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:14.852693 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6a483-ef3e-4bb7-8d4a-854d1839ae5c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=feac97c1527446cca638a5c38e276239)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:14.854629 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6a483-ef3e-4bb7-8d4a-854d1839ae5c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:14.856235 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 534/1072] 10.222.0.79 () {56 vars in 1204 bytes} [Thu Oct 28 14:26:14 2021] GET /identity/v3/domains/feac97c1527446cca638a5c38e276239 => generated 267 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:26:14.863369 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3cd0f-a6f6-4387-a580-3a6de59a1914 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:14.873510 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3cd0f-a6f6-4387-a580-3a6de59a1914 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:14.878843 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9a960-42c0-44f5-8940-5f4ee8ef141a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:14.879518 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9a960-42c0-44f5-8940-5f4ee8ef141a admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:14.879791 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9a960-42c0-44f5-8940-5f4ee8ef141a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:14.880100 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9a960-42c0-44f5-8940-5f4ee8ef141a admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:14.880816 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9a960-42c0-44f5-8940-5f4ee8ef141a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:14.882851 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9a960-42c0-44f5-8940-5f4ee8ef141a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:14.906716 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 539/1073] 10.222.0.79 () {60 vars in 1153 bytes} [Thu Oct 28 14:26:14 2021] POST /identity/v3/users => generated 311 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:26:17.180245 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057b678-1ba7-4c94-8dcb-3f8c5bbca836 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:17.180793 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057b678-1ba7-4c94-8dcb-3f8c5bbca836 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:17.180793 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057b678-1ba7-4c94-8dcb-3f8c5bbca836 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:17.182522 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 535/1074] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:26:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:26:17.189640 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f274a2-3f9d-46bd-b85c-248085e116ac None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:17.190403 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f274a2-3f9d-46bd-b85c-248085e116ac None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:17.190537 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f274a2-3f9d-46bd-b85c-248085e116ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:17.211648 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-61f274a2-3f9d-46bd-b85c-248085e116ac None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:26:17.212847 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-61f274a2-3f9d-46bd-b85c-248085e116ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:26:17.222357 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 540/1075] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:26:17 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:26:17.260232 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057b678-1ba7-4c94-8dcb-3f8c5bbca836 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:17.283025 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057b678-1ba7-4c94-8dcb-3f8c5bbca836 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:17.290051 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d38a0d-5d52-467e-8d75-fba84c494e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:17.290875 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d38a0d-5d52-467e-8d75-fba84c494e07 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:17.291149 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d38a0d-5d52-467e-8d75-fba84c494e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:17.291412 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d38a0d-5d52-467e-8d75-fba84c494e07 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:17.303266 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d38a0d-5d52-467e-8d75-fba84c494e07 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:26:17.309958 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-30d38a0d-5d52-467e-8d75-fba84c494e07 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:26:17.311123 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 536/1076] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:26:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:26:17.320409 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f274a2-3f9d-46bd-b85c-248085e116ac None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:17.329756 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f274a2-3f9d-46bd-b85c-248085e116ac None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:17.335603 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d062b-d82b-4420-89cd-7549e099134b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:17.336270 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d062b-d82b-4420-89cd-7549e099134b admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:17.336548 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d062b-d82b-4420-89cd-7549e099134b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:17.336818 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d062b-d82b-4420-89cd-7549e099134b admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:17.337575 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d062b-d82b-4420-89cd-7549e099134b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:26:17.337874 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d062b-d82b-4420-89cd-7549e099134b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:17.339495 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d062b-d82b-4420-89cd-7549e099134b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:17.348180 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 541/1077] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:26:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:26:17.355168 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d38a0d-5d52-467e-8d75-fba84c494e07 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:17.370770 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d38a0d-5d52-467e-8d75-fba84c494e07 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:17.379835 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a3872-d198-4b26-a83e-10f94c92e044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:17.380753 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a3872-d198-4b26-a83e-10f94c92e044 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:17.381026 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a3872-d198-4b26-a83e-10f94c92e044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:17.381260 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a3872-d198-4b26-a83e-10f94c92e044 admin admin] PATH_INFO: `/v3/users/dce34e6e6eba47e88b70fb1dceab3dbf` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:17.396125 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a3872-d198-4b26-a83e-10f94c92e044 admin admin] RBAC: Authorizing `identity:get_user(user_id=dce34e6e6eba47e88b70fb1dceab3dbf)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:17.398241 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a3872-d198-4b26-a83e-10f94c92e044 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:17.399877 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 537/1078] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:26:17 2021] GET /identity/v3/users/dce34e6e6eba47e88b70fb1dceab3dbf => generated 311 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:26:17.409666 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d062b-d82b-4420-89cd-7549e099134b admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:17.425932 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d062b-d82b-4420-89cd-7549e099134b admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:17.432104 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162abb0a-ba1c-4a89-b15f-bbe7ef21eee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:17.432685 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162abb0a-ba1c-4a89-b15f-bbe7ef21eee4 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:17.432964 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162abb0a-ba1c-4a89-b15f-bbe7ef21eee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:17.433229 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162abb0a-ba1c-4a89-b15f-bbe7ef21eee4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:17.441427 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162abb0a-ba1c-4a89-b15f-bbe7ef21eee4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:17.443256 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162abb0a-ba1c-4a89-b15f-bbe7ef21eee4 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:17.451955 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 542/1079] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:26:17 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:26:17.458901 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a3872-d198-4b26-a83e-10f94c92e044 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:17.475008 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a3872-d198-4b26-a83e-10f94c92e044 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:17.484154 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10227ee9-fcae-4716-bf71-fea655453086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:17.485393 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10227ee9-fcae-4716-bf71-fea655453086 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:17.485770 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10227ee9-fcae-4716-bf71-fea655453086 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:17.486130 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10227ee9-fcae-4716-bf71-fea655453086 admin admin] PATH_INFO: `/v3/projects/5205feeae8054c9facedbfd314ab1248` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:17.488219 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10227ee9-fcae-4716-bf71-fea655453086 admin admin] RBAC: Authorizing `identity:get_project(project_id=5205feeae8054c9facedbfd314ab1248)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:17.490812 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10227ee9-fcae-4716-bf71-fea655453086 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:17.492435 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 538/1080] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:26:17 2021] GET /identity/v3/projects/5205feeae8054c9facedbfd314ab1248 => generated 361 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:26:17.503891 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162abb0a-ba1c-4a89-b15f-bbe7ef21eee4 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:17.516609 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162abb0a-ba1c-4a89-b15f-bbe7ef21eee4 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:17.521701 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbb21b-e95e-4f66-ac79-1f9b2e777ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:17.522318 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbb21b-e95e-4f66-ac79-1f9b2e777ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:17.522574 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbb21b-e95e-4f66-ac79-1f9b2e777ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:17.522898 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbb21b-e95e-4f66-ac79-1f9b2e777ed1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:17.523711 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbb21b-e95e-4f66-ac79-1f9b2e777ed1 admin admin] RBAC: Adding query filter params (role.id=f7b8954a0fe64dc2b6146c7174498ddb, scope.project.id=5205feeae8054c9facedbfd314ab1248, user.id=dce34e6e6eba47e88b70fb1dceab3dbf) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:26:17.524015 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbb21b-e95e-4f66-ac79-1f9b2e777ed1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:17.525796 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbb21b-e95e-4f66-ac79-1f9b2e777ed1 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:17.531278 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 543/1081] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:26:17 2021] GET /identity/v3/role_assignments?user.id=dce34e6e6eba47e88b70fb1dceab3dbf&scope.project.id=5205feeae8054c9facedbfd314ab1248&role.id=f7b8954a0fe64dc2b6146c7174498ddb => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:26:19.729363 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44b9b7-da85-4834-bc22-25c36e2163aa None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:19.733507 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44b9b7-da85-4834-bc22-25c36e2163aa None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:19.733507 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44b9b7-da85-4834-bc22-25c36e2163aa None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:19.733507 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 539/1082] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:26:19 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:26:19.740316 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09512cd-4c7d-4e62-af0d-b5b164c46b77 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:19.740758 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09512cd-4c7d-4e62-af0d-b5b164c46b77 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:19.740862 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09512cd-4c7d-4e62-af0d-b5b164c46b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:19.759639 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-c09512cd-4c7d-4e62-af0d-b5b164c46b77 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:26:19.760850 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-c09512cd-4c7d-4e62-af0d-b5b164c46b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:26:19.769394 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 544/1083] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:26:19 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:26:19.794213 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44b9b7-da85-4834-bc22-25c36e2163aa None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:19.810558 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44b9b7-da85-4834-bc22-25c36e2163aa None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:19.816245 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827071d0-bbee-4105-b038-e0ffc337e59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:19.817024 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827071d0-bbee-4105-b038-e0ffc337e59d admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:19.817295 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827071d0-bbee-4105-b038-e0ffc337e59d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:19.817555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827071d0-bbee-4105-b038-e0ffc337e59d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:19.830266 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827071d0-bbee-4105-b038-e0ffc337e59d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:26:19.837166 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-827071d0-bbee-4105-b038-e0ffc337e59d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:26:19.838330 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 540/1084] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:26:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:26:19.848205 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09512cd-4c7d-4e62-af0d-b5b164c46b77 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:19.861379 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09512cd-4c7d-4e62-af0d-b5b164c46b77 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:19.867936 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d91ede-d2e1-45ac-8f81-0c3732f0b181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:19.868595 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d91ede-d2e1-45ac-8f81-0c3732f0b181 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:19.868866 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d91ede-d2e1-45ac-8f81-0c3732f0b181 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:19.869132 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d91ede-d2e1-45ac-8f81-0c3732f0b181 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:19.869887 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d91ede-d2e1-45ac-8f81-0c3732f0b181 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:26:19.870183 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d91ede-d2e1-45ac-8f81-0c3732f0b181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:19.871786 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d91ede-d2e1-45ac-8f81-0c3732f0b181 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:19.880192 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 545/1085] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:26:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:26:19.886830 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827071d0-bbee-4105-b038-e0ffc337e59d admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:19.897596 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827071d0-bbee-4105-b038-e0ffc337e59d admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:19.903422 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f43f1-3113-4435-93cc-c848cb09db2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:19.904626 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f43f1-3113-4435-93cc-c848cb09db2f admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:19.905070 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f43f1-3113-4435-93cc-c848cb09db2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:19.905499 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f43f1-3113-4435-93cc-c848cb09db2f admin admin] PATH_INFO: `/v3/users/dce34e6e6eba47e88b70fb1dceab3dbf` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:19.907730 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f43f1-3113-4435-93cc-c848cb09db2f admin admin] RBAC: Authorizing `identity:get_user(user_id=dce34e6e6eba47e88b70fb1dceab3dbf)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:19.911211 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f43f1-3113-4435-93cc-c848cb09db2f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:19.913654 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 541/1086] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:26:19 2021] GET /identity/v3/users/dce34e6e6eba47e88b70fb1dceab3dbf => generated 311 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:26:19.920168 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d91ede-d2e1-45ac-8f81-0c3732f0b181 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:19.930452 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d91ede-d2e1-45ac-8f81-0c3732f0b181 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:19.935800 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c38c4-29c7-4264-9e87-5272e07e9a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:19.936645 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c38c4-29c7-4264-9e87-5272e07e9a29 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:19.936911 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c38c4-29c7-4264-9e87-5272e07e9a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:19.937177 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c38c4-29c7-4264-9e87-5272e07e9a29 admin admin] PATH_INFO: `/v3/projects/5205feeae8054c9facedbfd314ab1248` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:19.938393 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c38c4-29c7-4264-9e87-5272e07e9a29 admin admin] RBAC: Authorizing `identity:get_project(project_id=5205feeae8054c9facedbfd314ab1248)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:19.940455 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c38c4-29c7-4264-9e87-5272e07e9a29 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:19.942059 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 546/1087] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:26:19 2021] GET /identity/v3/projects/5205feeae8054c9facedbfd314ab1248 => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:26:19.950986 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f43f1-3113-4435-93cc-c848cb09db2f admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:19.964326 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f43f1-3113-4435-93cc-c848cb09db2f admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:19.969741 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99c0ee-71ba-43e7-815f-ded76791185d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:19.970603 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99c0ee-71ba-43e7-815f-ded76791185d admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:19.970921 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99c0ee-71ba-43e7-815f-ded76791185d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:19.971193 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99c0ee-71ba-43e7-815f-ded76791185d admin admin] PATH_INFO: `/v3/projects/5205feeae8054c9facedbfd314ab1248/users/dce34e6e6eba47e88b70fb1dceab3dbf/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:19.973264 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99c0ee-71ba-43e7-815f-ded76791185d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5205feeae8054c9facedbfd314ab1248, user_id=dce34e6e6eba47e88b70fb1dceab3dbf, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:19.975905 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99c0ee-71ba-43e7-815f-ded76791185d admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:19.992125 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 542/1088] 10.222.0.79 () {58 vars in 1460 bytes} [Thu Oct 28 14:26:19 2021] PUT /identity/v3/projects/5205feeae8054c9facedbfd314ab1248/users/dce34e6e6eba47e88b70fb1dceab3dbf/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:26:22.203501 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fcf05-890b-4982-9cdb-ca1a8e796514 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:22.204039 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fcf05-890b-4982-9cdb-ca1a8e796514 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:22.204039 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fcf05-890b-4982-9cdb-ca1a8e796514 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:22.205715 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 547/1089] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:26:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:26:22.213107 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde8362-853a-4f83-9124-1560da553b54 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:22.213571 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde8362-853a-4f83-9124-1560da553b54 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:22.213672 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde8362-853a-4f83-9124-1560da553b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:22.241564 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-3dde8362-853a-4f83-9124-1560da553b54 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:26:22.242796 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-3dde8362-853a-4f83-9124-1560da553b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:26:22.301675 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 543/1090] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:26:22 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:26:22.333129 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fcf05-890b-4982-9cdb-ca1a8e796514 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:22.348955 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fcf05-890b-4982-9cdb-ca1a8e796514 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:22.354584 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaa10b-7478-4095-96de-62d55645bd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:22.355403 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaa10b-7478-4095-96de-62d55645bd0a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:22.355683 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaa10b-7478-4095-96de-62d55645bd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:22.355955 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaa10b-7478-4095-96de-62d55645bd0a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:22.373880 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaaa10b-7478-4095-96de-62d55645bd0a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:26:22.383278 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-5eaaa10b-7478-4095-96de-62d55645bd0a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:26:22.384422 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 548/1091] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:26:22 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:26:22.391723 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde8362-853a-4f83-9124-1560da553b54 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:22.406421 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde8362-853a-4f83-9124-1560da553b54 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:22.414268 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3138cf-62f3-4ad9-b09d-3076343a956a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:22.414965 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3138cf-62f3-4ad9-b09d-3076343a956a admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:22.415220 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3138cf-62f3-4ad9-b09d-3076343a956a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:22.415516 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3138cf-62f3-4ad9-b09d-3076343a956a admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:22.416303 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3138cf-62f3-4ad9-b09d-3076343a956a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:26:22.416633 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3138cf-62f3-4ad9-b09d-3076343a956a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:22.418224 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3138cf-62f3-4ad9-b09d-3076343a956a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:22.427447 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 544/1092] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:26:22 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:26:22.433926 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaa10b-7478-4095-96de-62d55645bd0a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:22.445194 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaa10b-7478-4095-96de-62d55645bd0a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:22.450993 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a973c88-8823-43f7-84cd-d6a60cf91c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:22.451840 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a973c88-8823-43f7-84cd-d6a60cf91c62 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:22.452114 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a973c88-8823-43f7-84cd-d6a60cf91c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:22.452386 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a973c88-8823-43f7-84cd-d6a60cf91c62 admin admin] PATH_INFO: `/v3/users/dce34e6e6eba47e88b70fb1dceab3dbf` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:22.453755 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a973c88-8823-43f7-84cd-d6a60cf91c62 admin admin] RBAC: Authorizing `identity:get_user(user_id=dce34e6e6eba47e88b70fb1dceab3dbf)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:22.455842 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a973c88-8823-43f7-84cd-d6a60cf91c62 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:22.457393 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 549/1093] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:26:22 2021] GET /identity/v3/users/dce34e6e6eba47e88b70fb1dceab3dbf => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:26:22.463581 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3138cf-62f3-4ad9-b09d-3076343a956a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:22.473395 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3138cf-62f3-4ad9-b09d-3076343a956a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:22.479402 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c017a22-aa15-48a3-9c23-5113d1a86c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:22.480034 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c017a22-aa15-48a3-9c23-5113d1a86c39 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:22.480310 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c017a22-aa15-48a3-9c23-5113d1a86c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:22.480582 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c017a22-aa15-48a3-9c23-5113d1a86c39 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:22.488734 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c017a22-aa15-48a3-9c23-5113d1a86c39 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:22.490456 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c017a22-aa15-48a3-9c23-5113d1a86c39 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:22.499578 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 545/1094] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:26:22 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:26:22.506006 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a973c88-8823-43f7-84cd-d6a60cf91c62 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:22.516083 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a973c88-8823-43f7-84cd-d6a60cf91c62 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:22.521913 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7754f-80a3-42b1-b5d9-8f4b94f7b6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:22.522804 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7754f-80a3-42b1-b5d9-8f4b94f7b6ca admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:22.523109 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7754f-80a3-42b1-b5d9-8f4b94f7b6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:22.523377 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7754f-80a3-42b1-b5d9-8f4b94f7b6ca admin admin] PATH_INFO: `/v3/projects/5205feeae8054c9facedbfd314ab1248` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:22.524684 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7754f-80a3-42b1-b5d9-8f4b94f7b6ca admin admin] RBAC: Authorizing `identity:get_project(project_id=5205feeae8054c9facedbfd314ab1248)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:22.526728 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7754f-80a3-42b1-b5d9-8f4b94f7b6ca admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:22.528298 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 550/1095] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:26:22 2021] GET /identity/v3/projects/5205feeae8054c9facedbfd314ab1248 => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:26:22.534712 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c017a22-aa15-48a3-9c23-5113d1a86c39 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:26:22.544472 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c017a22-aa15-48a3-9c23-5113d1a86c39 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:26:22.550462 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f7ef2-1bee-47cc-b15b-b298ec6c906f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:26:22.551131 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f7ef2-1bee-47cc-b15b-b298ec6c906f admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:26:22.551395 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f7ef2-1bee-47cc-b15b-b298ec6c906f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:26:22.551665 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f7ef2-1bee-47cc-b15b-b298ec6c906f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:26:22.552513 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f7ef2-1bee-47cc-b15b-b298ec6c906f admin admin] RBAC: Adding query filter params (role.id=f7b8954a0fe64dc2b6146c7174498ddb, scope.project.id=5205feeae8054c9facedbfd314ab1248, user.id=dce34e6e6eba47e88b70fb1dceab3dbf) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:26:22.552823 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f7ef2-1bee-47cc-b15b-b298ec6c906f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:26:22.554669 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f7ef2-1bee-47cc-b15b-b298ec6c906f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:26:22.561397 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 546/1096] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:26:22 2021] GET /identity/v3/role_assignments?user.id=dce34e6e6eba47e88b70fb1dceab3dbf&scope.project.id=5205feeae8054c9facedbfd314ab1248&role.id=f7b8954a0fe64dc2b6146c7174498ddb => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:27:18.544781 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7182319-6b54-4412-b170-89b9054ab041 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:18.544781 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7182319-6b54-4412-b170-89b9054ab041 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:18.544781 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7182319-6b54-4412-b170-89b9054ab041 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:18.544781 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 551/1097] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:27:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:27:18.552651 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fe964-bbfb-4118-8732-a264ffda4c33 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:18.553682 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fe964-bbfb-4118-8732-a264ffda4c33 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:18.554170 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fe964-bbfb-4118-8732-a264ffda4c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:18.577799 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-058fe964-bbfb-4118-8732-a264ffda4c33 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:27:18.579064 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-058fe964-bbfb-4118-8732-a264ffda4c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:27:18.589588 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 547/1098] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:27:18 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:27:18.616599 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7182319-6b54-4412-b170-89b9054ab041 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:18.630278 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7182319-6b54-4412-b170-89b9054ab041 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:18.635661 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acd3e3-e67c-4c54-a925-19c42852a06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:18.636592 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acd3e3-e67c-4c54-a925-19c42852a06d admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:18.636870 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acd3e3-e67c-4c54-a925-19c42852a06d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:18.637140 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acd3e3-e67c-4c54-a925-19c42852a06d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:18.648844 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acd3e3-e67c-4c54-a925-19c42852a06d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:18.650906 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acd3e3-e67c-4c54-a925-19c42852a06d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:18.672077 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-39acd3e3-e67c-4c54-a925-19c42852a06d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:27:18.674066 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 552/1099] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:27:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:18.681196 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058fe964-bbfb-4118-8732-a264ffda4c33 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:18.692185 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058fe964-bbfb-4118-8732-a264ffda4c33 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:18.698092 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ebf07-7bcb-4b8f-a69e-e45ac689860d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:18.698858 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ebf07-7bcb-4b8f-a69e-e45ac689860d admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:18.699137 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ebf07-7bcb-4b8f-a69e-e45ac689860d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:18.699405 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ebf07-7bcb-4b8f-a69e-e45ac689860d admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:18.700151 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ebf07-7bcb-4b8f-a69e-e45ac689860d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:18.700454 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ebf07-7bcb-4b8f-a69e-e45ac689860d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:18.702117 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ebf07-7bcb-4b8f-a69e-e45ac689860d admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:18.716536 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 548/1100] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:27:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:18.723047 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acd3e3-e67c-4c54-a925-19c42852a06d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:18.733573 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acd3e3-e67c-4c54-a925-19c42852a06d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:18.740681 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128a3ed-c45e-47d0-9f06-b132f85d1ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:18.741385 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128a3ed-c45e-47d0-9f06-b132f85d1ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:18.741706 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128a3ed-c45e-47d0-9f06-b132f85d1ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:18.741981 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128a3ed-c45e-47d0-9f06-b132f85d1ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:18.742826 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128a3ed-c45e-47d0-9f06-b132f85d1ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:18.745198 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128a3ed-c45e-47d0-9f06-b132f85d1ea4 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:18.782736 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 553/1101] 10.222.0.79 () {60 vars in 1153 bytes} [Thu Oct 28 14:27:18 2021] POST /identity/v3/users => generated 251 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:27:21.255392 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83140c97-8b96-4006-a84c-3d45bb2004cf None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:21.255944 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83140c97-8b96-4006-a84c-3d45bb2004cf None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:21.255944 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83140c97-8b96-4006-a84c-3d45bb2004cf None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:21.258120 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 549/1102] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:27:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:27:21.264117 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde3513-7dbf-401d-bd8c-25818e4bda66 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:21.266119 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde3513-7dbf-401d-bd8c-25818e4bda66 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:21.266119 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde3513-7dbf-401d-bd8c-25818e4bda66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:21.284577 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-5dde3513-7dbf-401d-bd8c-25818e4bda66 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:27:21.286104 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-5dde3513-7dbf-401d-bd8c-25818e4bda66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:27:21.294626 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 554/1103] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:27:21 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:27:21.319540 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83140c97-8b96-4006-a84c-3d45bb2004cf None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:21.333384 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83140c97-8b96-4006-a84c-3d45bb2004cf None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:21.338496 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cee1a-f825-4fb7-8c70-bb3b8bf772e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:21.339326 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cee1a-f825-4fb7-8c70-bb3b8bf772e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:21.339597 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cee1a-f825-4fb7-8c70-bb3b8bf772e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:21.339866 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cee1a-f825-4fb7-8c70-bb3b8bf772e1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:21.352365 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2cee1a-f825-4fb7-8c70-bb3b8bf772e1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:27:21.360366 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-5d2cee1a-f825-4fb7-8c70-bb3b8bf772e1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 14:27:21.361730 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 550/1104] 10.222.0.79 () {56 vars in 1123 bytes} [Thu Oct 28 14:27:21 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:21.370063 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde3513-7dbf-401d-bd8c-25818e4bda66 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:21.383454 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde3513-7dbf-401d-bd8c-25818e4bda66 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:21.388993 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd55168-3185-4ebe-a81b-bcf862b9e98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:21.389697 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd55168-3185-4ebe-a81b-bcf862b9e98b admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:21.390053 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd55168-3185-4ebe-a81b-bcf862b9e98b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:21.390400 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd55168-3185-4ebe-a81b-bcf862b9e98b admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:21.391265 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd55168-3185-4ebe-a81b-bcf862b9e98b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:21.391739 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd55168-3185-4ebe-a81b-bcf862b9e98b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:21.393699 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd55168-3185-4ebe-a81b-bcf862b9e98b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:21.403936 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 555/1105] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Oct 28 14:27:21 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:21.410582 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cee1a-f825-4fb7-8c70-bb3b8bf772e1 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:21.422026 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cee1a-f825-4fb7-8c70-bb3b8bf772e1 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:21.427667 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b04abb-8ea2-48b0-a64f-4ebd242442a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:21.428506 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b04abb-8ea2-48b0-a64f-4ebd242442a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:21.428823 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b04abb-8ea2-48b0-a64f-4ebd242442a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:21.429130 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b04abb-8ea2-48b0-a64f-4ebd242442a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:21.443003 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b04abb-8ea2-48b0-a64f-4ebd242442a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:21.443003 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b04abb-8ea2-48b0-a64f-4ebd242442a0 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:21.460232 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-e8b04abb-8ea2-48b0-a64f-4ebd242442a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:27:21.461611 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 551/1106] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:27:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:21.468264 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd55168-3185-4ebe-a81b-bcf862b9e98b admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:21.478099 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd55168-3185-4ebe-a81b-bcf862b9e98b admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:21.483296 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee0eb3-b608-42d0-9474-2df455a247a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:21.483965 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee0eb3-b608-42d0-9474-2df455a247a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:21.484241 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee0eb3-b608-42d0-9474-2df455a247a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:21.484499 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee0eb3-b608-42d0-9474-2df455a247a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:21.485232 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee0eb3-b608-42d0-9474-2df455a247a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:21.485529 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee0eb3-b608-42d0-9474-2df455a247a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:21.487216 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee0eb3-b608-42d0-9474-2df455a247a7 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:21.499948 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 556/1107] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:27:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:21.506538 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b04abb-8ea2-48b0-a64f-4ebd242442a0 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:21.516826 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b04abb-8ea2-48b0-a64f-4ebd242442a0 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:21.521943 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84c6aa-ea5d-4507-bf1a-5a8a85923eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:21.522779 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84c6aa-ea5d-4507-bf1a-5a8a85923eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:21.523056 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84c6aa-ea5d-4507-bf1a-5a8a85923eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:21.523323 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84c6aa-ea5d-4507-bf1a-5a8a85923eb0 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:21.530886 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84c6aa-ea5d-4507-bf1a-5a8a85923eb0 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:21.532912 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84c6aa-ea5d-4507-bf1a-5a8a85923eb0 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:21.548796 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-3b84c6aa-ea5d-4507-bf1a-5a8a85923eb0 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 14:27:21.554710 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 552/1108] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:27:21 2021] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:27:21.557677 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee0eb3-b608-42d0-9474-2df455a247a7 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:21.568545 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee0eb3-b608-42d0-9474-2df455a247a7 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:21.574349 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9e9ef-17a5-4fdc-8cc8-d9c32381dc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:21.575303 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9e9ef-17a5-4fdc-8cc8-d9c32381dc0f admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:21.575570 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9e9ef-17a5-4fdc-8cc8-d9c32381dc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:21.575891 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9e9ef-17a5-4fdc-8cc8-d9c32381dc0f admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:21.576859 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9e9ef-17a5-4fdc-8cc8-d9c32381dc0f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:21.577219 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9e9ef-17a5-4fdc-8cc8-d9c32381dc0f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:21.579439 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9e9ef-17a5-4fdc-8cc8-d9c32381dc0f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:21.600171 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 557/1109] 10.222.0.79 () {56 vars in 1164 bytes} [Thu Oct 28 14:27:21 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:27:21.607780 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84c6aa-ea5d-4507-bf1a-5a8a85923eb0 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:21.618490 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84c6aa-ea5d-4507-bf1a-5a8a85923eb0 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:21.623977 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97850d-7bb0-4627-899f-4243a1f3d656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:21.624695 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97850d-7bb0-4627-899f-4243a1f3d656 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:21.625168 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97850d-7bb0-4627-899f-4243a1f3d656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:21.625486 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97850d-7bb0-4627-899f-4243a1f3d656 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:21.635615 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97850d-7bb0-4627-899f-4243a1f3d656 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:21.637373 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97850d-7bb0-4627-899f-4243a1f3d656 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:21.653964 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 553/1110] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:27:21 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:27:21.655344 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9e9ef-17a5-4fdc-8cc8-d9c32381dc0f admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:21.668220 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9e9ef-17a5-4fdc-8cc8-d9c32381dc0f admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:21.675393 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ea7f3-1d62-4abb-a9e3-58f0ba7a7080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:21.676437 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ea7f3-1d62-4abb-a9e3-58f0ba7a7080 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:21.676954 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ea7f3-1d62-4abb-a9e3-58f0ba7a7080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:21.677858 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ea7f3-1d62-4abb-a9e3-58f0ba7a7080 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:21.694567 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ea7f3-1d62-4abb-a9e3-58f0ba7a7080 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:21.697194 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ea7f3-1d62-4abb-a9e3-58f0ba7a7080 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:21.717202 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-0b7ea7f3-1d62-4abb-a9e3-58f0ba7a7080 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:27:21.718798 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 558/1111] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:27:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:21.727369 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97850d-7bb0-4627-899f-4243a1f3d656 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:21.740109 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97850d-7bb0-4627-899f-4243a1f3d656 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:21.745788 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c7b0e-fcdf-47c1-94fd-a2656236e103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:21.746529 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c7b0e-fcdf-47c1-94fd-a2656236e103 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:21.746859 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c7b0e-fcdf-47c1-94fd-a2656236e103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:21.747134 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c7b0e-fcdf-47c1-94fd-a2656236e103 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:21.747903 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c7b0e-fcdf-47c1-94fd-a2656236e103 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:21.748216 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c7b0e-fcdf-47c1-94fd-a2656236e103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:21.750129 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c7b0e-fcdf-47c1-94fd-a2656236e103 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:21.762962 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 554/1112] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:27:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:21.770706 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ea7f3-1d62-4abb-a9e3-58f0ba7a7080 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:21.783945 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ea7f3-1d62-4abb-a9e3-58f0ba7a7080 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:21.789796 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3fa9a-9154-4163-a552-6f585c9ef641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:21.791124 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3fa9a-9154-4163-a552-6f585c9ef641 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:21.791240 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3fa9a-9154-4163-a552-6f585c9ef641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:21.791476 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3fa9a-9154-4163-a552-6f585c9ef641 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:21.799872 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3fa9a-9154-4163-a552-6f585c9ef641 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:21.801823 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3fa9a-9154-4163-a552-6f585c9ef641 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:21.818803 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-93b3fa9a-9154-4163-a552-6f585c9ef641 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:27:21.820271 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 559/1113] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:27:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:21.828583 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c7b0e-fcdf-47c1-94fd-a2656236e103 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:21.838882 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c7b0e-fcdf-47c1-94fd-a2656236e103 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:21.844434 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acf5b4-cc5d-45b1-9217-3c86d72929e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:21.845109 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acf5b4-cc5d-45b1-9217-3c86d72929e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:21.845426 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acf5b4-cc5d-45b1-9217-3c86d72929e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:21.845694 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acf5b4-cc5d-45b1-9217-3c86d72929e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:21.846743 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acf5b4-cc5d-45b1-9217-3c86d72929e5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:21.847051 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acf5b4-cc5d-45b1-9217-3c86d72929e5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:21.849009 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acf5b4-cc5d-45b1-9217-3c86d72929e5 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:21.863712 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 555/1114] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:27:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:21.870792 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3fa9a-9154-4163-a552-6f585c9ef641 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:21.881894 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3fa9a-9154-4163-a552-6f585c9ef641 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:21.887620 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aab517-942a-4d37-bee6-25de72964987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:21.888468 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aab517-942a-4d37-bee6-25de72964987 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:21.888783 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aab517-942a-4d37-bee6-25de72964987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:21.889005 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aab517-942a-4d37-bee6-25de72964987 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:21.889844 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aab517-942a-4d37-bee6-25de72964987 admin admin] RBAC: Adding query filter params (role.id=1ee8b426ca9a49e5b7fb33be19e8a616, scope.project.id=b433200db4784bfeadca48d24212e823, user.id=8bf32a6fafb7458788a47e4774cb7bc8) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:21.890147 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aab517-942a-4d37-bee6-25de72964987 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:21.892024 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aab517-942a-4d37-bee6-25de72964987 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:21.907203 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 560/1115] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:27:21 2021] GET /identity/v3/role_assignments?user.id=8bf32a6fafb7458788a47e4774cb7bc8&scope.project.id=b433200db4784bfeadca48d24212e823&role.id=1ee8b426ca9a49e5b7fb33be19e8a616 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:24.157666 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449ca31-ce5b-41f8-9887-d04dc5e94f07 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:24.158312 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449ca31-ce5b-41f8-9887-d04dc5e94f07 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:24.158312 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449ca31-ce5b-41f8-9887-d04dc5e94f07 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:24.160060 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 556/1116] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:27:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:27:24.166616 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600a03c-7882-45b5-9c9e-dd65952269ec None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:24.167109 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600a03c-7882-45b5-9c9e-dd65952269ec None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:24.167252 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600a03c-7882-45b5-9c9e-dd65952269ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:24.186022 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-f600a03c-7882-45b5-9c9e-dd65952269ec None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:27:24.187228 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-f600a03c-7882-45b5-9c9e-dd65952269ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:27:24.195612 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 561/1117] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:27:24 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:27:24.221269 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449ca31-ce5b-41f8-9887-d04dc5e94f07 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:24.234919 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449ca31-ce5b-41f8-9887-d04dc5e94f07 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:24.239885 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74488f7c-0220-4f31-a506-5b35f3146f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:24.240685 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74488f7c-0220-4f31-a506-5b35f3146f48 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:24.240964 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74488f7c-0220-4f31-a506-5b35f3146f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:24.241231 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74488f7c-0220-4f31-a506-5b35f3146f48 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:24.252481 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74488f7c-0220-4f31-a506-5b35f3146f48 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:27:24.259714 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-74488f7c-0220-4f31-a506-5b35f3146f48 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 14:27:24.261013 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 557/1118] 10.222.0.79 () {56 vars in 1123 bytes} [Thu Oct 28 14:27:24 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:24.268168 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600a03c-7882-45b5-9c9e-dd65952269ec None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:24.278200 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600a03c-7882-45b5-9c9e-dd65952269ec None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:24.283226 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ba96f-2f97-4864-ad6c-ebf61ca745e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:24.283996 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ba96f-2f97-4864-ad6c-ebf61ca745e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:24.284281 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ba96f-2f97-4864-ad6c-ebf61ca745e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:24.284553 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ba96f-2f97-4864-ad6c-ebf61ca745e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:24.285314 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ba96f-2f97-4864-ad6c-ebf61ca745e1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:24.285615 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ba96f-2f97-4864-ad6c-ebf61ca745e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:24.287557 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ba96f-2f97-4864-ad6c-ebf61ca745e1 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:24.299457 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 562/1119] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Oct 28 14:27:24 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:24.308056 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74488f7c-0220-4f31-a506-5b35f3146f48 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:24.318580 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74488f7c-0220-4f31-a506-5b35f3146f48 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:24.323088 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72462cee-cd0e-43d7-b9ec-da415f3698f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:24.323864 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72462cee-cd0e-43d7-b9ec-da415f3698f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:24.324142 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72462cee-cd0e-43d7-b9ec-da415f3698f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:24.324409 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72462cee-cd0e-43d7-b9ec-da415f3698f3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:24.335063 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72462cee-cd0e-43d7-b9ec-da415f3698f3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:24.337044 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72462cee-cd0e-43d7-b9ec-da415f3698f3 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:24.356362 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-72462cee-cd0e-43d7-b9ec-da415f3698f3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:27:24.357950 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 558/1120] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:27:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:24.365366 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ba96f-2f97-4864-ad6c-ebf61ca745e1 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:24.375997 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ba96f-2f97-4864-ad6c-ebf61ca745e1 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:24.380944 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b85e8-03fa-407f-9581-6840ea1f9fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:24.381685 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b85e8-03fa-407f-9581-6840ea1f9fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:24.382036 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b85e8-03fa-407f-9581-6840ea1f9fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:24.382379 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b85e8-03fa-407f-9581-6840ea1f9fe1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:24.383263 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b85e8-03fa-407f-9581-6840ea1f9fe1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:24.383633 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b85e8-03fa-407f-9581-6840ea1f9fe1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:24.385413 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b85e8-03fa-407f-9581-6840ea1f9fe1 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:24.403752 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 563/1121] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:27:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:24.405376 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72462cee-cd0e-43d7-b9ec-da415f3698f3 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:24.416323 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72462cee-cd0e-43d7-b9ec-da415f3698f3 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:24.421171 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707a808-2a5b-4160-9edc-d4783e08f42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:24.422056 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707a808-2a5b-4160-9edc-d4783e08f42e admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:24.422350 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707a808-2a5b-4160-9edc-d4783e08f42e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:24.422617 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707a808-2a5b-4160-9edc-d4783e08f42e admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:24.431675 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707a808-2a5b-4160-9edc-d4783e08f42e admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:24.433989 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707a808-2a5b-4160-9edc-d4783e08f42e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:24.450349 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-d707a808-2a5b-4160-9edc-d4783e08f42e admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 14:27:24.451831 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 559/1122] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:27:24 2021] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:27:24.459830 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b85e8-03fa-407f-9581-6840ea1f9fe1 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:24.470059 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b85e8-03fa-407f-9581-6840ea1f9fe1 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:24.475690 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfed0c-2c01-4334-a828-6b08f947d0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:24.476407 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfed0c-2c01-4334-a828-6b08f947d0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:24.478370 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfed0c-2c01-4334-a828-6b08f947d0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:24.478794 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfed0c-2c01-4334-a828-6b08f947d0e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:24.479818 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfed0c-2c01-4334-a828-6b08f947d0e4 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:24.480226 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfed0c-2c01-4334-a828-6b08f947d0e4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:24.482440 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfed0c-2c01-4334-a828-6b08f947d0e4 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:24.503135 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 564/1123] 10.222.0.79 () {56 vars in 1164 bytes} [Thu Oct 28 14:27:24 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:24.509621 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707a808-2a5b-4160-9edc-d4783e08f42e admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:24.520363 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707a808-2a5b-4160-9edc-d4783e08f42e admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:24.526039 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f33d1d-fb8b-40ff-9473-f77a40f841eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:24.526891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f33d1d-fb8b-40ff-9473-f77a40f841eb admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:24.527161 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f33d1d-fb8b-40ff-9473-f77a40f841eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:24.527438 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f33d1d-fb8b-40ff-9473-f77a40f841eb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:24.538445 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f33d1d-fb8b-40ff-9473-f77a40f841eb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:24.540440 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f33d1d-fb8b-40ff-9473-f77a40f841eb admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:24.559754 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-c5f33d1d-fb8b-40ff-9473-f77a40f841eb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:27:24.561137 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 560/1124] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:27:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:27:24.567500 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfed0c-2c01-4334-a828-6b08f947d0e4 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:24.577350 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfed0c-2c01-4334-a828-6b08f947d0e4 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:24.583371 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25bc95-9c2a-4234-a5bd-18e092661b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:24.584101 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25bc95-9c2a-4234-a5bd-18e092661b3d admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:24.584376 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25bc95-9c2a-4234-a5bd-18e092661b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:24.584643 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25bc95-9c2a-4234-a5bd-18e092661b3d admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:24.585382 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25bc95-9c2a-4234-a5bd-18e092661b3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:24.585687 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25bc95-9c2a-4234-a5bd-18e092661b3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:24.587524 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25bc95-9c2a-4234-a5bd-18e092661b3d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:24.602397 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 565/1125] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:27:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:27:24.610090 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f33d1d-fb8b-40ff-9473-f77a40f841eb admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:24.622992 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f33d1d-fb8b-40ff-9473-f77a40f841eb admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:24.628536 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea265cd-faff-4b22-9098-f91b1714dc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:24.629508 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea265cd-faff-4b22-9098-f91b1714dc1b admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:24.629814 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea265cd-faff-4b22-9098-f91b1714dc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:24.630193 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea265cd-faff-4b22-9098-f91b1714dc1b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:24.638622 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea265cd-faff-4b22-9098-f91b1714dc1b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:24.640955 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea265cd-faff-4b22-9098-f91b1714dc1b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:24.656603 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-dea265cd-faff-4b22-9098-f91b1714dc1b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:27:24.658041 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 561/1126] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:27:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:27:24.666457 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25bc95-9c2a-4234-a5bd-18e092661b3d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:24.677895 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25bc95-9c2a-4234-a5bd-18e092661b3d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:24.683713 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca31a2-a1f8-4cda-8dd3-3fc088f67d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:24.684452 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca31a2-a1f8-4cda-8dd3-3fc088f67d10 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:24.684685 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca31a2-a1f8-4cda-8dd3-3fc088f67d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:24.684983 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca31a2-a1f8-4cda-8dd3-3fc088f67d10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:24.685772 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca31a2-a1f8-4cda-8dd3-3fc088f67d10 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:24.686087 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca31a2-a1f8-4cda-8dd3-3fc088f67d10 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:24.688006 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca31a2-a1f8-4cda-8dd3-3fc088f67d10 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:24.703243 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 566/1127] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:27:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:24.712937 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea265cd-faff-4b22-9098-f91b1714dc1b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:24.726073 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea265cd-faff-4b22-9098-f91b1714dc1b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:24.732767 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea369ae3-cdfb-4e70-b102-f3cdceffb165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:24.733790 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea369ae3-cdfb-4e70-b102-f3cdceffb165 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:24.734072 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea369ae3-cdfb-4e70-b102-f3cdceffb165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:24.734335 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea369ae3-cdfb-4e70-b102-f3cdceffb165 admin admin] PATH_INFO: `/v3/projects/b433200db4784bfeadca48d24212e823/users/8bf32a6fafb7458788a47e4774cb7bc8/roles/1ee8b426ca9a49e5b7fb33be19e8a616` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:24.752856 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea369ae3-cdfb-4e70-b102-f3cdceffb165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b433200db4784bfeadca48d24212e823, user_id=8bf32a6fafb7458788a47e4774cb7bc8, role_id=1ee8b426ca9a49e5b7fb33be19e8a616)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:24.755532 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea369ae3-cdfb-4e70-b102-f3cdceffb165 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:24.770400 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 562/1128] 10.222.0.79 () {58 vars in 1460 bytes} [Thu Oct 28 14:27:24 2021] PUT /identity/v3/projects/b433200db4784bfeadca48d24212e823/users/8bf32a6fafb7458788a47e4774cb7bc8/roles/1ee8b426ca9a49e5b7fb33be19e8a616 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:27:27.309225 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf10969-ee1c-4002-8166-ebf845661a54 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:27.309809 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf10969-ee1c-4002-8166-ebf845661a54 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:27.309809 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf10969-ee1c-4002-8166-ebf845661a54 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:27.312156 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 567/1129] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:27:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:27:27.319404 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9fe9c-fd13-49ac-b61a-04b69aa47863 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:27.319849 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9fe9c-fd13-49ac-b61a-04b69aa47863 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:27.320092 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9fe9c-fd13-49ac-b61a-04b69aa47863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:27.339191 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-f5c9fe9c-fd13-49ac-b61a-04b69aa47863 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:27:27.340404 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-f5c9fe9c-fd13-49ac-b61a-04b69aa47863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:27:27.400185 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 563/1130] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:27:27 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:27:27.428092 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf10969-ee1c-4002-8166-ebf845661a54 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:27.440589 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf10969-ee1c-4002-8166-ebf845661a54 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:27.445963 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ac07f-910e-4351-bb56-ce83f614b3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:27.446803 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ac07f-910e-4351-bb56-ce83f614b3ce admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:27.447078 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ac07f-910e-4351-bb56-ce83f614b3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:27.447345 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ac07f-910e-4351-bb56-ce83f614b3ce admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:27.458894 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ac07f-910e-4351-bb56-ce83f614b3ce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:27:27.465756 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-047ac07f-910e-4351-bb56-ce83f614b3ce admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 14:27:27.467046 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 568/1131] 10.222.0.79 () {56 vars in 1123 bytes} [Thu Oct 28 14:27:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:27.474101 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9fe9c-fd13-49ac-b61a-04b69aa47863 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:27.483354 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9fe9c-fd13-49ac-b61a-04b69aa47863 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:27.488654 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15101d4-a2bd-4d30-a794-b541a811192e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:27.489313 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15101d4-a2bd-4d30-a794-b541a811192e admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:27.489587 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15101d4-a2bd-4d30-a794-b541a811192e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:27.489854 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15101d4-a2bd-4d30-a794-b541a811192e admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:27.490613 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15101d4-a2bd-4d30-a794-b541a811192e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:27.490956 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15101d4-a2bd-4d30-a794-b541a811192e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:27.492533 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15101d4-a2bd-4d30-a794-b541a811192e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:27.501634 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 564/1132] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Oct 28 14:27:27 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:27:27.508609 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ac07f-910e-4351-bb56-ce83f614b3ce admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:27.518959 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ac07f-910e-4351-bb56-ce83f614b3ce admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:27.523871 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf257c8d-6d0c-4034-8d4d-9ac767b9f4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:27.524651 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf257c8d-6d0c-4034-8d4d-9ac767b9f4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:27.524927 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf257c8d-6d0c-4034-8d4d-9ac767b9f4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:27.525192 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf257c8d-6d0c-4034-8d4d-9ac767b9f4a4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:27.535656 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf257c8d-6d0c-4034-8d4d-9ac767b9f4a4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:27.537468 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf257c8d-6d0c-4034-8d4d-9ac767b9f4a4 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:27.556007 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-cf257c8d-6d0c-4034-8d4d-9ac767b9f4a4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:27:27.557233 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 569/1133] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:27:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:27.563788 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15101d4-a2bd-4d30-a794-b541a811192e admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:27.575867 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15101d4-a2bd-4d30-a794-b541a811192e admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:27.581004 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d476e-5cbd-4b6d-80bb-19d7d49e9c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:27.581720 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d476e-5cbd-4b6d-80bb-19d7d49e9c44 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:27.581961 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d476e-5cbd-4b6d-80bb-19d7d49e9c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:27.582292 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d476e-5cbd-4b6d-80bb-19d7d49e9c44 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:27.583049 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d476e-5cbd-4b6d-80bb-19d7d49e9c44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:27.583322 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d476e-5cbd-4b6d-80bb-19d7d49e9c44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:27.584914 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d476e-5cbd-4b6d-80bb-19d7d49e9c44 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:27.598017 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 565/1134] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:27:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:27.605717 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf257c8d-6d0c-4034-8d4d-9ac767b9f4a4 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:27.616189 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf257c8d-6d0c-4034-8d4d-9ac767b9f4a4 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:27.621829 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf7887-8eb0-4cab-8ae4-59875b340d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:27.622639 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf7887-8eb0-4cab-8ae4-59875b340d2a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:27.622939 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf7887-8eb0-4cab-8ae4-59875b340d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:27.623201 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf7887-8eb0-4cab-8ae4-59875b340d2a admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:27.631819 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf7887-8eb0-4cab-8ae4-59875b340d2a admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:27.634223 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf7887-8eb0-4cab-8ae4-59875b340d2a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:27.652617 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-e9bf7887-8eb0-4cab-8ae4-59875b340d2a admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 14:27:27.653998 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 570/1135] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:27:27 2021] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:27.661469 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d476e-5cbd-4b6d-80bb-19d7d49e9c44 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:27.676184 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d476e-5cbd-4b6d-80bb-19d7d49e9c44 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:27.683260 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd79fb-1a8f-402a-b65a-2ab07d4a9cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:27.684072 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd79fb-1a8f-402a-b65a-2ab07d4a9cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:27.684354 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd79fb-1a8f-402a-b65a-2ab07d4a9cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:27.684808 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd79fb-1a8f-402a-b65a-2ab07d4a9cc1 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:27.686162 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd79fb-1a8f-402a-b65a-2ab07d4a9cc1 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:27.686616 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd79fb-1a8f-402a-b65a-2ab07d4a9cc1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:27.689203 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd79fb-1a8f-402a-b65a-2ab07d4a9cc1 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:27.711444 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 566/1136] 10.222.0.79 () {56 vars in 1164 bytes} [Thu Oct 28 14:27:27 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:27.718290 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf7887-8eb0-4cab-8ae4-59875b340d2a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:27.728928 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf7887-8eb0-4cab-8ae4-59875b340d2a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:27.734862 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3c134-48fb-485f-8ce5-136f5a4b5f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:27.735718 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3c134-48fb-485f-8ce5-136f5a4b5f69 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:27.736112 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3c134-48fb-485f-8ce5-136f5a4b5f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:27.736498 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3c134-48fb-485f-8ce5-136f5a4b5f69 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:27.747338 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3c134-48fb-485f-8ce5-136f5a4b5f69 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:27.749502 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3c134-48fb-485f-8ce5-136f5a4b5f69 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:27.760157 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 571/1137] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:27:27 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:27:27.766797 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd79fb-1a8f-402a-b65a-2ab07d4a9cc1 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:27.777826 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd79fb-1a8f-402a-b65a-2ab07d4a9cc1 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:27.782981 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38106be-ce24-4774-8111-0947cc680738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:27.783895 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38106be-ce24-4774-8111-0947cc680738 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:27.784173 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38106be-ce24-4774-8111-0947cc680738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:27.784425 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38106be-ce24-4774-8111-0947cc680738 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:27.798280 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38106be-ce24-4774-8111-0947cc680738 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:27.800597 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38106be-ce24-4774-8111-0947cc680738 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:27.821012 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-b38106be-ce24-4774-8111-0947cc680738 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:27:27.822406 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 567/1138] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:27:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:27.830502 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3c134-48fb-485f-8ce5-136f5a4b5f69 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:27.841195 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3c134-48fb-485f-8ce5-136f5a4b5f69 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:27.847112 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb6e06-e973-41ad-aa4c-d60f03f3ca25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:27.847935 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb6e06-e973-41ad-aa4c-d60f03f3ca25 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:27.848394 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb6e06-e973-41ad-aa4c-d60f03f3ca25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:27.848688 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb6e06-e973-41ad-aa4c-d60f03f3ca25 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:27.849433 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb6e06-e973-41ad-aa4c-d60f03f3ca25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:27.849905 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb6e06-e973-41ad-aa4c-d60f03f3ca25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:27.852037 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb6e06-e973-41ad-aa4c-d60f03f3ca25 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:27.866019 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 572/1139] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:27:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:27:27.872517 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38106be-ce24-4774-8111-0947cc680738 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:27.882727 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38106be-ce24-4774-8111-0947cc680738 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:27.887907 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03657e-ba98-4e46-bf06-c72299b1c90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:27.888704 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03657e-ba98-4e46-bf06-c72299b1c90b admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:27.888976 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03657e-ba98-4e46-bf06-c72299b1c90b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:27.889236 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03657e-ba98-4e46-bf06-c72299b1c90b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:27.896891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03657e-ba98-4e46-bf06-c72299b1c90b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:27.899284 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03657e-ba98-4e46-bf06-c72299b1c90b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:27.912713 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-7c03657e-ba98-4e46-bf06-c72299b1c90b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:27:27.913932 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 568/1140] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:27:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:27.921834 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb6e06-e973-41ad-aa4c-d60f03f3ca25 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:27.933735 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb6e06-e973-41ad-aa4c-d60f03f3ca25 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:27.938457 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17273f-7a38-422d-92dc-4d1dea39a44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:27.939189 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17273f-7a38-422d-92dc-4d1dea39a44c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:27.939449 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17273f-7a38-422d-92dc-4d1dea39a44c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:27.939813 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17273f-7a38-422d-92dc-4d1dea39a44c admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:27.940614 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17273f-7a38-422d-92dc-4d1dea39a44c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:27.940910 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17273f-7a38-422d-92dc-4d1dea39a44c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:27.942839 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17273f-7a38-422d-92dc-4d1dea39a44c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:27.955838 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 573/1141] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:27:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:27.962939 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03657e-ba98-4e46-bf06-c72299b1c90b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:27.974230 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03657e-ba98-4e46-bf06-c72299b1c90b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:27.979879 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5d417-58b9-4774-879b-cfb4abb161b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:27.980635 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5d417-58b9-4774-879b-cfb4abb161b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:27.980962 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5d417-58b9-4774-879b-cfb4abb161b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:27.981332 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5d417-58b9-4774-879b-cfb4abb161b4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:27.982411 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5d417-58b9-4774-879b-cfb4abb161b4 admin admin] RBAC: Adding query filter params (role.id=1ee8b426ca9a49e5b7fb33be19e8a616, scope.project.id=b433200db4784bfeadca48d24212e823, user.id=8bf32a6fafb7458788a47e4774cb7bc8) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:27.982804 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5d417-58b9-4774-879b-cfb4abb161b4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:27.984916 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5d417-58b9-4774-879b-cfb4abb161b4 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:27.991713 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 569/1142] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:27:27 2021] GET /identity/v3/role_assignments?user.id=8bf32a6fafb7458788a47e4774cb7bc8&scope.project.id=b433200db4784bfeadca48d24212e823&role.id=1ee8b426ca9a49e5b7fb33be19e8a616 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:30.436422 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81628aa-0a4e-43bf-b691-0cbf00246656 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:30.437048 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81628aa-0a4e-43bf-b691-0cbf00246656 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:30.437048 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81628aa-0a4e-43bf-b691-0cbf00246656 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:30.438762 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 574/1143] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:27:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:27:30.445771 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4124142-df74-4b1e-bc08-8706e64ad5ff None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:30.446261 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4124142-df74-4b1e-bc08-8706e64ad5ff None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:30.446368 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4124142-df74-4b1e-bc08-8706e64ad5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:30.464622 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-d4124142-df74-4b1e-bc08-8706e64ad5ff None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:27:30.465989 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-d4124142-df74-4b1e-bc08-8706e64ad5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:27:30.474402 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 570/1144] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:27:30 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:27:30.501074 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81628aa-0a4e-43bf-b691-0cbf00246656 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:30.515133 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81628aa-0a4e-43bf-b691-0cbf00246656 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:30.520070 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa548c7-da79-4481-a081-1782cf3a07fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:30.520967 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa548c7-da79-4481-a081-1782cf3a07fd admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:30.521347 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa548c7-da79-4481-a081-1782cf3a07fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:30.521724 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa548c7-da79-4481-a081-1782cf3a07fd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:30.531841 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa548c7-da79-4481-a081-1782cf3a07fd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:27:30.539005 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-2aa548c7-da79-4481-a081-1782cf3a07fd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:27:30.540453 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 575/1145] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:27:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:30.547647 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4124142-df74-4b1e-bc08-8706e64ad5ff None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:30.557974 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4124142-df74-4b1e-bc08-8706e64ad5ff None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:30.562956 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35452d-22bb-4064-8dbd-5cbc52e62525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:30.563761 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35452d-22bb-4064-8dbd-5cbc52e62525 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:30.564047 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35452d-22bb-4064-8dbd-5cbc52e62525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:30.564408 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35452d-22bb-4064-8dbd-5cbc52e62525 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:30.565327 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35452d-22bb-4064-8dbd-5cbc52e62525 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:30.565697 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35452d-22bb-4064-8dbd-5cbc52e62525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:30.567647 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35452d-22bb-4064-8dbd-5cbc52e62525 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:30.577087 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 571/1146] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:27:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:30.583882 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa548c7-da79-4481-a081-1782cf3a07fd admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:30.594426 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa548c7-da79-4481-a081-1782cf3a07fd admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:30.600490 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fe6bf-c614-4c75-bfca-dd000a05105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:30.601278 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fe6bf-c614-4c75-bfca-dd000a05105c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:30.601553 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fe6bf-c614-4c75-bfca-dd000a05105c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:30.601816 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fe6bf-c614-4c75-bfca-dd000a05105c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:30.613588 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57fe6bf-c614-4c75-bfca-dd000a05105c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:30.615605 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57fe6bf-c614-4c75-bfca-dd000a05105c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:30.632869 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-b57fe6bf-c614-4c75-bfca-dd000a05105c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:27:30.634101 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 576/1147] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:27:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:27:30.641130 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35452d-22bb-4064-8dbd-5cbc52e62525 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:30.651146 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35452d-22bb-4064-8dbd-5cbc52e62525 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:30.656419 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd35d3-eb69-4355-b144-da7c6b282e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:30.657126 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd35d3-eb69-4355-b144-da7c6b282e7c admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:30.657432 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd35d3-eb69-4355-b144-da7c6b282e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:30.657732 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd35d3-eb69-4355-b144-da7c6b282e7c admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:30.658715 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd35d3-eb69-4355-b144-da7c6b282e7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:30.659032 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd35d3-eb69-4355-b144-da7c6b282e7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:30.661150 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd35d3-eb69-4355-b144-da7c6b282e7c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:30.677674 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 572/1148] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:27:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:30.684951 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fe6bf-c614-4c75-bfca-dd000a05105c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:30.695138 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fe6bf-c614-4c75-bfca-dd000a05105c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:30.706303 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62752bee-ea4f-4521-909d-d3c001e5fe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:30.707163 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62752bee-ea4f-4521-909d-d3c001e5fe4c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:30.707443 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62752bee-ea4f-4521-909d-d3c001e5fe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:30.707713 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62752bee-ea4f-4521-909d-d3c001e5fe4c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:30.716386 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62752bee-ea4f-4521-909d-d3c001e5fe4c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:30.718408 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62752bee-ea4f-4521-909d-d3c001e5fe4c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:30.733485 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-62752bee-ea4f-4521-909d-d3c001e5fe4c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 14:27:30.742078 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 577/1149] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:27:30 2021] GET /identity/v3/users/placement => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:30.743515 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd35d3-eb69-4355-b144-da7c6b282e7c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:30.753899 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd35d3-eb69-4355-b144-da7c6b282e7c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:30.758869 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737d700-2fdd-42cc-a176-588638b90fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:30.759436 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737d700-2fdd-42cc-a176-588638b90fea admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:30.759712 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737d700-2fdd-42cc-a176-588638b90fea admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:30.759982 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737d700-2fdd-42cc-a176-588638b90fea admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:30.760865 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e737d700-2fdd-42cc-a176-588638b90fea admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:30.761335 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e737d700-2fdd-42cc-a176-588638b90fea admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:30.763045 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e737d700-2fdd-42cc-a176-588638b90fea admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:30.784209 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 573/1150] 10.222.0.79 () {56 vars in 1164 bytes} [Thu Oct 28 14:27:30 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:30.790877 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62752bee-ea4f-4521-909d-d3c001e5fe4c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:30.801428 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62752bee-ea4f-4521-909d-d3c001e5fe4c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:30.806000 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0f67a-2f64-4050-846a-a677108fd9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:30.806667 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0f67a-2f64-4050-846a-a677108fd9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:30.806982 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0f67a-2f64-4050-846a-a677108fd9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:30.807250 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0f67a-2f64-4050-846a-a677108fd9c0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:30.816233 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0f67a-2f64-4050-846a-a677108fd9c0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:30.817967 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0f67a-2f64-4050-846a-a677108fd9c0 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:30.827687 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 578/1151] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:27:30 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:27:30.834667 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737d700-2fdd-42cc-a176-588638b90fea admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:30.845921 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737d700-2fdd-42cc-a176-588638b90fea admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:30.851823 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e59661-b104-4705-96d6-d758097b7ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:30.852721 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e59661-b104-4705-96d6-d758097b7ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:30.852998 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e59661-b104-4705-96d6-d758097b7ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:30.853268 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e59661-b104-4705-96d6-d758097b7ef2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:30.865636 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e59661-b104-4705-96d6-d758097b7ef2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:30.867886 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e59661-b104-4705-96d6-d758097b7ef2 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:30.886560 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-85e59661-b104-4705-96d6-d758097b7ef2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:27:30.887821 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 574/1152] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:27:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:27:30.894627 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0f67a-2f64-4050-846a-a677108fd9c0 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:30.904573 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0f67a-2f64-4050-846a-a677108fd9c0 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:30.910148 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2f7b4-3cb4-438b-83c3-37df56bfed7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:30.910882 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2f7b4-3cb4-438b-83c3-37df56bfed7a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:30.911195 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2f7b4-3cb4-438b-83c3-37df56bfed7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:30.911497 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2f7b4-3cb4-438b-83c3-37df56bfed7a admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:30.912351 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2f7b4-3cb4-438b-83c3-37df56bfed7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:30.912722 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2f7b4-3cb4-438b-83c3-37df56bfed7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:30.914323 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2f7b4-3cb4-438b-83c3-37df56bfed7a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:30.929715 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 579/1153] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:27:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:30.936401 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e59661-b104-4705-96d6-d758097b7ef2 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:30.948687 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e59661-b104-4705-96d6-d758097b7ef2 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:30.953872 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731d239-c8fb-4479-a06a-263c8d6f3db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:30.954734 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731d239-c8fb-4479-a06a-263c8d6f3db2 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:30.955121 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731d239-c8fb-4479-a06a-263c8d6f3db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:30.955429 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731d239-c8fb-4479-a06a-263c8d6f3db2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:30.963271 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731d239-c8fb-4479-a06a-263c8d6f3db2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:30.965703 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731d239-c8fb-4479-a06a-263c8d6f3db2 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:30.980769 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-b731d239-c8fb-4479-a06a-263c8d6f3db2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:27:30.982160 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 575/1154] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:27:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:30.989239 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2f7b4-3cb4-438b-83c3-37df56bfed7a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:31.000405 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2f7b4-3cb4-438b-83c3-37df56bfed7a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:31.005903 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33324769-f940-49ee-b5b2-b25d69a77c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:31.006576 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33324769-f940-49ee-b5b2-b25d69a77c6e admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:31.006902 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33324769-f940-49ee-b5b2-b25d69a77c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:31.007181 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33324769-f940-49ee-b5b2-b25d69a77c6e admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:31.007985 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33324769-f940-49ee-b5b2-b25d69a77c6e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:31.008293 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33324769-f940-49ee-b5b2-b25d69a77c6e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:31.010390 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33324769-f940-49ee-b5b2-b25d69a77c6e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:31.024128 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 580/1155] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:27:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:31.031872 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731d239-c8fb-4479-a06a-263c8d6f3db2 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:31.043623 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731d239-c8fb-4479-a06a-263c8d6f3db2 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:31.049226 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751b6b3-bef4-4958-982c-ad0046745dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:31.049864 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751b6b3-bef4-4958-982c-ad0046745dbb admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:31.050139 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751b6b3-bef4-4958-982c-ad0046745dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:31.050410 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751b6b3-bef4-4958-982c-ad0046745dbb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:31.051455 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751b6b3-bef4-4958-982c-ad0046745dbb admin admin] RBAC: Adding query filter params (role.id=f7b8954a0fe64dc2b6146c7174498ddb, scope.project.id=b433200db4784bfeadca48d24212e823, user.id=8bf32a6fafb7458788a47e4774cb7bc8) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:31.051781 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751b6b3-bef4-4958-982c-ad0046745dbb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:31.053915 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751b6b3-bef4-4958-982c-ad0046745dbb admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:31.060184 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 576/1156] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:27:31 2021] GET /identity/v3/role_assignments?user.id=8bf32a6fafb7458788a47e4774cb7bc8&scope.project.id=b433200db4784bfeadca48d24212e823&role.id=f7b8954a0fe64dc2b6146c7174498ddb => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:33.461457 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189820d1-1775-4de2-8dd4-4da7dd4ce71b None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:33.462115 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189820d1-1775-4de2-8dd4-4da7dd4ce71b None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:33.462115 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189820d1-1775-4de2-8dd4-4da7dd4ce71b None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:33.463822 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 581/1157] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:27:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:27:33.470120 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c559570-ddfa-4e32-877f-6def8c8e1995 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:33.470765 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c559570-ddfa-4e32-877f-6def8c8e1995 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:33.471088 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c559570-ddfa-4e32-877f-6def8c8e1995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:33.492442 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-2c559570-ddfa-4e32-877f-6def8c8e1995 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:27:33.494059 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-2c559570-ddfa-4e32-877f-6def8c8e1995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:27:33.505970 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 577/1158] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:27:33 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:27:33.536218 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189820d1-1775-4de2-8dd4-4da7dd4ce71b None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:33.549876 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189820d1-1775-4de2-8dd4-4da7dd4ce71b None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:33.555481 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cab173-a5f2-441e-9135-92538825b450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:33.556693 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cab173-a5f2-441e-9135-92538825b450 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:33.557201 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cab173-a5f2-441e-9135-92538825b450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:33.557746 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cab173-a5f2-441e-9135-92538825b450 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:33.573327 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cab173-a5f2-441e-9135-92538825b450 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:27:33.583536 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-94cab173-a5f2-441e-9135-92538825b450 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:27:33.585431 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 582/1159] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:27:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:33.593454 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c559570-ddfa-4e32-877f-6def8c8e1995 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:33.604950 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c559570-ddfa-4e32-877f-6def8c8e1995 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:33.610394 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552d99e-0e5c-451a-b276-85d7ffcb7468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:33.611518 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552d99e-0e5c-451a-b276-85d7ffcb7468 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:33.611942 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552d99e-0e5c-451a-b276-85d7ffcb7468 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:33.612424 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552d99e-0e5c-451a-b276-85d7ffcb7468 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:33.613487 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e552d99e-0e5c-451a-b276-85d7ffcb7468 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:33.613929 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e552d99e-0e5c-451a-b276-85d7ffcb7468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:33.616252 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e552d99e-0e5c-451a-b276-85d7ffcb7468 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:33.628043 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 578/1160] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:27:33 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:33.635521 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cab173-a5f2-441e-9135-92538825b450 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:33.650261 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cab173-a5f2-441e-9135-92538825b450 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:33.657677 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286776e-c8d4-4701-83d7-6379c270eceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:33.658885 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286776e-c8d4-4701-83d7-6379c270eceb admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:33.659168 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286776e-c8d4-4701-83d7-6379c270eceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:33.659440 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286776e-c8d4-4701-83d7-6379c270eceb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:33.676590 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286776e-c8d4-4701-83d7-6379c270eceb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:33.679224 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286776e-c8d4-4701-83d7-6379c270eceb admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:33.701974 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-0286776e-c8d4-4701-83d7-6379c270eceb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:27:33.703585 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 583/1161] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:27:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:33.712260 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552d99e-0e5c-451a-b276-85d7ffcb7468 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:33.723166 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552d99e-0e5c-451a-b276-85d7ffcb7468 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:33.728227 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c482ac-5264-4f8e-98d1-3206d2049399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:33.728897 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c482ac-5264-4f8e-98d1-3206d2049399 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:33.729176 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c482ac-5264-4f8e-98d1-3206d2049399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:33.729529 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c482ac-5264-4f8e-98d1-3206d2049399 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:33.730195 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c482ac-5264-4f8e-98d1-3206d2049399 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:33.730498 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c482ac-5264-4f8e-98d1-3206d2049399 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:33.732133 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c482ac-5264-4f8e-98d1-3206d2049399 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:33.745359 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 579/1162] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:27:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:33.752987 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286776e-c8d4-4701-83d7-6379c270eceb admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:33.763030 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286776e-c8d4-4701-83d7-6379c270eceb admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:33.768562 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73842510-cc9d-4bdc-9813-0112d600a8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:33.769456 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73842510-cc9d-4bdc-9813-0112d600a8ad admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:33.769741 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73842510-cc9d-4bdc-9813-0112d600a8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:33.770022 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73842510-cc9d-4bdc-9813-0112d600a8ad admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:33.778846 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73842510-cc9d-4bdc-9813-0112d600a8ad admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:33.780880 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73842510-cc9d-4bdc-9813-0112d600a8ad admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:33.795152 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-73842510-cc9d-4bdc-9813-0112d600a8ad admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 14:27:33.796572 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 584/1163] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:27:33 2021] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:33.803836 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c482ac-5264-4f8e-98d1-3206d2049399 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:33.813897 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c482ac-5264-4f8e-98d1-3206d2049399 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:33.819165 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c3331-9cde-44ad-9625-285b1782ee83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:33.819850 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c3331-9cde-44ad-9625-285b1782ee83 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:33.820146 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c3331-9cde-44ad-9625-285b1782ee83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:33.820407 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c3331-9cde-44ad-9625-285b1782ee83 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:33.821262 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c3331-9cde-44ad-9625-285b1782ee83 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:33.821562 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c3331-9cde-44ad-9625-285b1782ee83 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:33.823444 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c3331-9cde-44ad-9625-285b1782ee83 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:33.848791 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 580/1164] 10.222.0.79 () {56 vars in 1164 bytes} [Thu Oct 28 14:27:33 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:33.850064 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73842510-cc9d-4bdc-9813-0112d600a8ad admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:33.861388 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73842510-cc9d-4bdc-9813-0112d600a8ad admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:33.866647 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af648586-62bc-4889-8a62-5be5f4f63325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:33.867614 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af648586-62bc-4889-8a62-5be5f4f63325 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:33.867966 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af648586-62bc-4889-8a62-5be5f4f63325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:33.868237 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af648586-62bc-4889-8a62-5be5f4f63325 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:33.880223 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af648586-62bc-4889-8a62-5be5f4f63325 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:33.882845 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af648586-62bc-4889-8a62-5be5f4f63325 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:33.901922 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-af648586-62bc-4889-8a62-5be5f4f63325 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:27:33.901922 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 585/1165] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:27:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:33.907931 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c3331-9cde-44ad-9625-285b1782ee83 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:33.921395 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c3331-9cde-44ad-9625-285b1782ee83 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:33.924859 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa063e6-c332-408d-85fb-227bf42c8525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:33.925539 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa063e6-c332-408d-85fb-227bf42c8525 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:33.925803 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa063e6-c332-408d-85fb-227bf42c8525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:33.926128 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa063e6-c332-408d-85fb-227bf42c8525 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:33.926849 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa063e6-c332-408d-85fb-227bf42c8525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:33.927226 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa063e6-c332-408d-85fb-227bf42c8525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:33.928829 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa063e6-c332-408d-85fb-227bf42c8525 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:33.941817 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 581/1166] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:27:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:33.948325 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af648586-62bc-4889-8a62-5be5f4f63325 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:33.958779 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af648586-62bc-4889-8a62-5be5f4f63325 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:33.963698 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833c34c-0d38-4d08-a4b4-18f38cd3b59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:33.964429 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833c34c-0d38-4d08-a4b4-18f38cd3b59a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:33.964705 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833c34c-0d38-4d08-a4b4-18f38cd3b59a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:33.964979 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833c34c-0d38-4d08-a4b4-18f38cd3b59a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:33.972717 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833c34c-0d38-4d08-a4b4-18f38cd3b59a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:33.974695 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833c34c-0d38-4d08-a4b4-18f38cd3b59a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:33.991147 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-3833c34c-0d38-4d08-a4b4-18f38cd3b59a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:27:33.992621 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 586/1167] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:27:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:34.000777 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa063e6-c332-408d-85fb-227bf42c8525 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:34.013536 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa063e6-c332-408d-85fb-227bf42c8525 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:34.020310 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b4592-69a6-4a73-aae4-1401c788449b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:34.021109 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b4592-69a6-4a73-aae4-1401c788449b admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:34.021555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b4592-69a6-4a73-aae4-1401c788449b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:34.021833 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b4592-69a6-4a73-aae4-1401c788449b admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:34.022649 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b4592-69a6-4a73-aae4-1401c788449b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:34.022994 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b4592-69a6-4a73-aae4-1401c788449b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:34.024859 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b4592-69a6-4a73-aae4-1401c788449b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:34.039470 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 582/1168] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:27:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:27:34.048382 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833c34c-0d38-4d08-a4b4-18f38cd3b59a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:34.061574 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833c34c-0d38-4d08-a4b4-18f38cd3b59a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:34.067319 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867aec8-f2f4-4f9c-9976-9d76c2022555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:34.068402 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867aec8-f2f4-4f9c-9976-9d76c2022555 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:34.068758 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867aec8-f2f4-4f9c-9976-9d76c2022555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:34.069026 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867aec8-f2f4-4f9c-9976-9d76c2022555 admin admin] PATH_INFO: `/v3/projects/b433200db4784bfeadca48d24212e823/users/8bf32a6fafb7458788a47e4774cb7bc8/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:34.071038 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867aec8-f2f4-4f9c-9976-9d76c2022555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b433200db4784bfeadca48d24212e823, user_id=8bf32a6fafb7458788a47e4774cb7bc8, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:34.074092 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867aec8-f2f4-4f9c-9976-9d76c2022555 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:34.087562 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 587/1169] 10.222.0.79 () {58 vars in 1460 bytes} [Thu Oct 28 14:27:34 2021] PUT /identity/v3/projects/b433200db4784bfeadca48d24212e823/users/8bf32a6fafb7458788a47e4774cb7bc8/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:27:36.371811 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511d4b5-dfc6-40ae-a665-2b3facfbc88f None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:36.372734 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511d4b5-dfc6-40ae-a665-2b3facfbc88f None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:36.372734 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511d4b5-dfc6-40ae-a665-2b3facfbc88f None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:36.375466 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 583/1170] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:27:36 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:27:36.382470 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e12c2-4f74-4d1a-8cb4-e70b6c0d0239 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:36.383269 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e12c2-4f74-4d1a-8cb4-e70b6c0d0239 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:36.383424 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e12c2-4f74-4d1a-8cb4-e70b6c0d0239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:36.405501 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-ef7e12c2-4f74-4d1a-8cb4-e70b6c0d0239 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:27:36.406703 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-ef7e12c2-4f74-4d1a-8cb4-e70b6c0d0239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:27:36.468654 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 588/1171] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:27:36 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:27:36.500359 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511d4b5-dfc6-40ae-a665-2b3facfbc88f None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:36.515774 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511d4b5-dfc6-40ae-a665-2b3facfbc88f None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:36.521877 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488991f-675a-461c-a5d1-fbb0dd581be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:36.522670 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488991f-675a-461c-a5d1-fbb0dd581be4 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:36.522987 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488991f-675a-461c-a5d1-fbb0dd581be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:36.523262 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488991f-675a-461c-a5d1-fbb0dd581be4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:36.534523 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488991f-675a-461c-a5d1-fbb0dd581be4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 14:27:36.541309 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-0488991f-675a-461c-a5d1-fbb0dd581be4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 14:27:36.542467 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 584/1172] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Oct 28 14:27:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:36.549927 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e12c2-4f74-4d1a-8cb4-e70b6c0d0239 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:36.564329 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e12c2-4f74-4d1a-8cb4-e70b6c0d0239 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:36.570105 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052e4d8-3b07-4540-a4ac-0ef8ee45bb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:36.570836 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052e4d8-3b07-4540-a4ac-0ef8ee45bb6b admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:36.571116 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052e4d8-3b07-4540-a4ac-0ef8ee45bb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:36.571383 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052e4d8-3b07-4540-a4ac-0ef8ee45bb6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:36.572143 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052e4d8-3b07-4540-a4ac-0ef8ee45bb6b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:36.572444 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052e4d8-3b07-4540-a4ac-0ef8ee45bb6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:36.574073 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052e4d8-3b07-4540-a4ac-0ef8ee45bb6b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:36.584047 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 589/1173] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Oct 28 14:27:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:36.590357 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488991f-675a-461c-a5d1-fbb0dd581be4 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:36.600592 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488991f-675a-461c-a5d1-fbb0dd581be4 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:36.606484 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d5edb-7c18-4ea6-95b6-6c885acfe4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:36.607284 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d5edb-7c18-4ea6-95b6-6c885acfe4fc admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:36.607560 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d5edb-7c18-4ea6-95b6-6c885acfe4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:36.607833 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d5edb-7c18-4ea6-95b6-6c885acfe4fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:36.618441 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d5edb-7c18-4ea6-95b6-6c885acfe4fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:36.620338 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d5edb-7c18-4ea6-95b6-6c885acfe4fc admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:36.637218 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-b41d5edb-7c18-4ea6-95b6-6c885acfe4fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:27:36.638285 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 585/1174] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:27:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 14:27:36.644632 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052e4d8-3b07-4540-a4ac-0ef8ee45bb6b admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:36.655587 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052e4d8-3b07-4540-a4ac-0ef8ee45bb6b admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:36.661926 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e91e55-be93-4e6e-9c2c-881191ac7abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:36.662617 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e91e55-be93-4e6e-9c2c-881191ac7abc admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:36.663030 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e91e55-be93-4e6e-9c2c-881191ac7abc admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:36.663372 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e91e55-be93-4e6e-9c2c-881191ac7abc admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:36.664222 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e91e55-be93-4e6e-9c2c-881191ac7abc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:36.664619 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e91e55-be93-4e6e-9c2c-881191ac7abc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:36.666580 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e91e55-be93-4e6e-9c2c-881191ac7abc admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:36.684233 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 590/1175] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:27:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:36.691962 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d5edb-7c18-4ea6-95b6-6c885acfe4fc admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:36.704715 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d5edb-7c18-4ea6-95b6-6c885acfe4fc admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:36.711135 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee3813-f5f7-48b5-bbcf-ef9ccc179158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:36.712058 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee3813-f5f7-48b5-bbcf-ef9ccc179158 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:36.712464 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee3813-f5f7-48b5-bbcf-ef9ccc179158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:36.712853 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee3813-f5f7-48b5-bbcf-ef9ccc179158 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:36.721345 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee3813-f5f7-48b5-bbcf-ef9ccc179158 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:36.723389 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee3813-f5f7-48b5-bbcf-ef9ccc179158 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:36.737137 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-84ee3813-f5f7-48b5-bbcf-ef9ccc179158 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 14:27:36.738298 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 586/1176] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:27:36 2021] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:36.745445 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e91e55-be93-4e6e-9c2c-881191ac7abc admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:36.758711 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e91e55-be93-4e6e-9c2c-881191ac7abc admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:36.766157 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea94700-19e3-4698-ac11-65bf6d6760c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:36.767215 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea94700-19e3-4698-ac11-65bf6d6760c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:36.767597 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea94700-19e3-4698-ac11-65bf6d6760c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:36.767984 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea94700-19e3-4698-ac11-65bf6d6760c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:36.769317 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea94700-19e3-4698-ac11-65bf6d6760c1 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:36.769764 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea94700-19e3-4698-ac11-65bf6d6760c1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:36.772680 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea94700-19e3-4698-ac11-65bf6d6760c1 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:36.795668 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 591/1177] 10.222.0.79 () {56 vars in 1164 bytes} [Thu Oct 28 14:27:36 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:36.802411 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee3813-f5f7-48b5-bbcf-ef9ccc179158 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:36.812204 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee3813-f5f7-48b5-bbcf-ef9ccc179158 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:36.817724 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8dd72-80a0-40e9-9a74-3e0addf5758b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:36.818345 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8dd72-80a0-40e9-9a74-3e0addf5758b admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:36.818618 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8dd72-80a0-40e9-9a74-3e0addf5758b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:36.818920 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8dd72-80a0-40e9-9a74-3e0addf5758b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:36.827415 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8dd72-80a0-40e9-9a74-3e0addf5758b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:36.829131 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8dd72-80a0-40e9-9a74-3e0addf5758b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:36.838443 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 587/1178] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Oct 28 14:27:36 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:27:36.845447 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea94700-19e3-4698-ac11-65bf6d6760c1 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:36.856273 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea94700-19e3-4698-ac11-65bf6d6760c1 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:36.862709 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230cd2d-4396-43ea-b41d-20e3d5926f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:36.863511 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230cd2d-4396-43ea-b41d-20e3d5926f95 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:36.863786 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230cd2d-4396-43ea-b41d-20e3d5926f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:36.864120 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230cd2d-4396-43ea-b41d-20e3d5926f95 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:36.875133 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230cd2d-4396-43ea-b41d-20e3d5926f95 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:36.876935 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230cd2d-4396-43ea-b41d-20e3d5926f95 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:36.894660 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-1230cd2d-4396-43ea-b41d-20e3d5926f95 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 14:27:36.895788 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 592/1179] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Oct 28 14:27:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:36.904978 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8dd72-80a0-40e9-9a74-3e0addf5758b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:36.919017 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8dd72-80a0-40e9-9a74-3e0addf5758b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:36.926507 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41f333-bf38-42b2-a222-5adcf55ca65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:36.927195 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41f333-bf38-42b2-a222-5adcf55ca65a admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:36.927468 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41f333-bf38-42b2-a222-5adcf55ca65a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:36.927731 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41f333-bf38-42b2-a222-5adcf55ca65a admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:36.928460 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41f333-bf38-42b2-a222-5adcf55ca65a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:36.928758 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41f333-bf38-42b2-a222-5adcf55ca65a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:36.930339 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41f333-bf38-42b2-a222-5adcf55ca65a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:36.942191 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 588/1180] 10.222.0.79 () {56 vars in 1130 bytes} [Thu Oct 28 14:27:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:36.949238 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230cd2d-4396-43ea-b41d-20e3d5926f95 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:36.961677 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230cd2d-4396-43ea-b41d-20e3d5926f95 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:36.967746 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9f763-53a1-4627-9163-cfa8b37c26bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:36.968526 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9f763-53a1-4627-9163-cfa8b37c26bd admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:36.968800 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9f763-53a1-4627-9163-cfa8b37c26bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:36.969065 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9f763-53a1-4627-9163-cfa8b37c26bd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:36.976580 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9f763-53a1-4627-9163-cfa8b37c26bd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:36.978546 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9f763-53a1-4627-9163-cfa8b37c26bd admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:36.991698 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING keystone.server.flask.application [None req-d4e9f763-53a1-4627-9163-cfa8b37c26bd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 14:27:36.992848 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 593/1181] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Oct 28 14:27:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:37.003523 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41f333-bf38-42b2-a222-5adcf55ca65a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:37.018710 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41f333-bf38-42b2-a222-5adcf55ca65a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:37.024702 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd5ce9-0f68-4143-81a7-5127c537a3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:37.025348 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd5ce9-0f68-4143-81a7-5127c537a3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:37.025627 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd5ce9-0f68-4143-81a7-5127c537a3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:37.025886 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd5ce9-0f68-4143-81a7-5127c537a3c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:37.026713 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd5ce9-0f68-4143-81a7-5127c537a3c9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:37.027019 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd5ce9-0f68-4143-81a7-5127c537a3c9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:37.028851 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd5ce9-0f68-4143-81a7-5127c537a3c9 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:37.041484 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 589/1182] 10.222.0.79 () {56 vars in 1169 bytes} [Thu Oct 28 14:27:37 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:37.049082 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9f763-53a1-4627-9163-cfa8b37c26bd admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:37.066374 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9f763-53a1-4627-9163-cfa8b37c26bd admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:37.073879 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c417b-6bda-400b-b8c4-3ee087a79e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:37.074506 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c417b-6bda-400b-b8c4-3ee087a79e6c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:37.074794 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c417b-6bda-400b-b8c4-3ee087a79e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:37.075095 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c417b-6bda-400b-b8c4-3ee087a79e6c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:37.075922 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c417b-6bda-400b-b8c4-3ee087a79e6c admin admin] RBAC: Adding query filter params (role.id=f7b8954a0fe64dc2b6146c7174498ddb, scope.project.id=b433200db4784bfeadca48d24212e823, user.id=8bf32a6fafb7458788a47e4774cb7bc8) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:37.076233 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c417b-6bda-400b-b8c4-3ee087a79e6c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:37.078033 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c417b-6bda-400b-b8c4-3ee087a79e6c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:37.084062 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 594/1183] 10.222.0.79 () {56 vars in 1395 bytes} [Thu Oct 28 14:27:37 2021] GET /identity/v3/role_assignments?user.id=8bf32a6fafb7458788a47e4774cb7bc8&scope.project.id=b433200db4784bfeadca48d24212e823&role.id=f7b8954a0fe64dc2b6146c7174498ddb => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:39.342440 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693ccd0-edf5-428d-9539-f5237cbc5ff5 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:39.343064 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693ccd0-edf5-428d-9539-f5237cbc5ff5 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:39.343064 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693ccd0-edf5-428d-9539-f5237cbc5ff5 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:39.345522 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 590/1184] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:27:39 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:27:39.355830 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439eaba9-5aa9-4a10-b575-e754edd3f9bf None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:39.356727 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439eaba9-5aa9-4a10-b575-e754edd3f9bf None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:39.356727 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439eaba9-5aa9-4a10-b575-e754edd3f9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:39.378010 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-439eaba9-5aa9-4a10-b575-e754edd3f9bf None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:27:39.379253 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-439eaba9-5aa9-4a10-b575-e754edd3f9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:27:39.391312 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 595/1185] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:27:39 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:27:39.416355 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693ccd0-edf5-428d-9539-f5237cbc5ff5 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:39.433442 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693ccd0-edf5-428d-9539-f5237cbc5ff5 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:39.439354 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23a78d-3e80-4eb6-9fa7-6f0c549a0405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:39.440166 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23a78d-3e80-4eb6-9fa7-6f0c549a0405 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:39.440450 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23a78d-3e80-4eb6-9fa7-6f0c549a0405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:39.440735 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23a78d-3e80-4eb6-9fa7-6f0c549a0405 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:39.441413 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23a78d-3e80-4eb6-9fa7-6f0c549a0405 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:39.443071 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23a78d-3e80-4eb6-9fa7-6f0c549a0405 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:39.455548 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-1a23a78d-3e80-4eb6-9fa7-6f0c549a0405 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 14:27:39.456731 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 591/1186] 10.222.0.79 () {56 vars in 1138 bytes} [Thu Oct 28 14:27:39 2021] GET /identity/v3/services/placement => generated 90 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:39.467771 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439eaba9-5aa9-4a10-b575-e754edd3f9bf None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:39.481556 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439eaba9-5aa9-4a10-b575-e754edd3f9bf None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:39.490904 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2dafec-bddf-4d68-b2d9-84afd78c65f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:39.491916 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dafec-bddf-4d68-b2d9-84afd78c65f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:39.492249 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dafec-bddf-4d68-b2d9-84afd78c65f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:39.492638 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dafec-bddf-4d68-b2d9-84afd78c65f7 admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:39.493757 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2dafec-bddf-4d68-b2d9-84afd78c65f7 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:39.494235 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2dafec-bddf-4d68-b2d9-84afd78c65f7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:39.496849 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2dafec-bddf-4d68-b2d9-84afd78c65f7 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:39.504823 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 596/1187] 10.222.0.79 () {56 vars in 1137 bytes} [Thu Oct 28 14:27:39 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:39.514246 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23a78d-3e80-4eb6-9fa7-6f0c549a0405 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:39.525310 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23a78d-3e80-4eb6-9fa7-6f0c549a0405 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:39.532149 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5dd602-98df-4bac-be4c-44d85a421c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:39.533113 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5dd602-98df-4bac-be4c-44d85a421c38 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:39.533587 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5dd602-98df-4bac-be4c-44d85a421c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:39.533866 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5dd602-98df-4bac-be4c-44d85a421c38 admin admin] PATH_INFO: `/v3/services` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:39.534711 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5dd602-98df-4bac-be4c-44d85a421c38 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:39.535117 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5dd602-98df-4bac-be4c-44d85a421c38 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:39.536874 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5dd602-98df-4bac-be4c-44d85a421c38 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:39.542379 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 592/1188] 10.222.0.79 () {56 vars in 1137 bytes} [Thu Oct 28 14:27:39 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:41.819760 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09006c-d299-4300-b3bb-4d6a83817a1a None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:41.820677 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09006c-d299-4300-b3bb-4d6a83817a1a None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:41.820677 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09006c-d299-4300-b3bb-4d6a83817a1a None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:41.823442 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 597/1189] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:27:41 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:27:41.833591 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85a4a4-d6ee-48f2-bc19-10143cb73cba None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:41.834016 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85a4a4-d6ee-48f2-bc19-10143cb73cba None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:41.834185 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85a4a4-d6ee-48f2-bc19-10143cb73cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:41.856868 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-5d85a4a4-d6ee-48f2-bc19-10143cb73cba None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:27:41.858068 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-5d85a4a4-d6ee-48f2-bc19-10143cb73cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:27:41.866807 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 593/1190] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:27:41 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:27:41.894951 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09006c-d299-4300-b3bb-4d6a83817a1a None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:41.909970 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09006c-d299-4300-b3bb-4d6a83817a1a None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:41.914946 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dd9a6-90f0-497c-86a5-586a26ef5155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:41.915708 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dd9a6-90f0-497c-86a5-586a26ef5155 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:41.915985 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dd9a6-90f0-497c-86a5-586a26ef5155 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:41.916253 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dd9a6-90f0-497c-86a5-586a26ef5155 admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:41.916984 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4dd9a6-90f0-497c-86a5-586a26ef5155 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:41.918552 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4dd9a6-90f0-497c-86a5-586a26ef5155 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:41.936155 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 598/1191] 10.222.0.79 () {60 vars in 1162 bytes} [Thu Oct 28 14:27:41 2021] POST /identity/v3/services => generated 246 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:27:44.162849 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc656043-1f21-40ad-86e6-60c531f56b68 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:44.163467 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc656043-1f21-40ad-86e6-60c531f56b68 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:44.163467 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc656043-1f21-40ad-86e6-60c531f56b68 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:44.165061 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 594/1192] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:27:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:27:44.171116 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c16d2f-ba8d-4bf0-92e5-7eb4f440f581 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:44.171518 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c16d2f-ba8d-4bf0-92e5-7eb4f440f581 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:44.171646 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c16d2f-ba8d-4bf0-92e5-7eb4f440f581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:44.196773 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-52c16d2f-ba8d-4bf0-92e5-7eb4f440f581 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:27:44.197944 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-52c16d2f-ba8d-4bf0-92e5-7eb4f440f581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:27:44.217544 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 599/1193] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:27:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:27:44.242070 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc656043-1f21-40ad-86e6-60c531f56b68 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:44.259846 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc656043-1f21-40ad-86e6-60c531f56b68 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:44.265701 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11c06c-5827-4c74-8d62-1fd1363cf6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:44.266495 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11c06c-5827-4c74-8d62-1fd1363cf6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:44.266796 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11c06c-5827-4c74-8d62-1fd1363cf6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:44.267075 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11c06c-5827-4c74-8d62-1fd1363cf6d0 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:44.267748 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11c06c-5827-4c74-8d62-1fd1363cf6d0 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:44.269370 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11c06c-5827-4c74-8d62-1fd1363cf6d0 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:44.280653 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-aa11c06c-5827-4c74-8d62-1fd1363cf6d0 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 14:27:44.281782 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 595/1194] 10.222.0.79 () {56 vars in 1138 bytes} [Thu Oct 28 14:27:44 2021] GET /identity/v3/services/placement => generated 90 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:44.288480 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c16d2f-ba8d-4bf0-92e5-7eb4f440f581 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:44.298219 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c16d2f-ba8d-4bf0-92e5-7eb4f440f581 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:44.303681 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa635d4-532e-4ce8-a7a4-21fcb0fa4e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:44.304520 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa635d4-532e-4ce8-a7a4-21fcb0fa4e14 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:44.304803 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa635d4-532e-4ce8-a7a4-21fcb0fa4e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:44.305149 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa635d4-532e-4ce8-a7a4-21fcb0fa4e14 admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:44.305878 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa635d4-532e-4ce8-a7a4-21fcb0fa4e14 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:44.306192 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa635d4-532e-4ce8-a7a4-21fcb0fa4e14 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:44.307839 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa635d4-532e-4ce8-a7a4-21fcb0fa4e14 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:44.313103 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 600/1195] 10.222.0.79 () {56 vars in 1137 bytes} [Thu Oct 28 14:27:44 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:44.319685 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11c06c-5827-4c74-8d62-1fd1363cf6d0 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:44.329495 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11c06c-5827-4c74-8d62-1fd1363cf6d0 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:44.335233 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b6ffe-e76c-46eb-9430-002ea5d39362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:44.335872 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b6ffe-e76c-46eb-9430-002ea5d39362 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:44.336151 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b6ffe-e76c-46eb-9430-002ea5d39362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:44.336417 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b6ffe-e76c-46eb-9430-002ea5d39362 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:44.337219 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b6ffe-e76c-46eb-9430-002ea5d39362 admin admin] RBAC: Adding query filter params (interface=public, service_id=163f6f3d576843879b83a2d605dd813f, region_id=RegionOne) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:44.337528 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b6ffe-e76c-46eb-9430-002ea5d39362 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:44.339149 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b6ffe-e76c-46eb-9430-002ea5d39362 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:44.344555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 596/1196] 10.222.0.79 () {56 vars in 1272 bytes} [Thu Oct 28 14:27:44 2021] GET /identity/v3/endpoints?service_id=163f6f3d576843879b83a2d605dd813f&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:44.351185 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa635d4-532e-4ce8-a7a4-21fcb0fa4e14 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:44.365335 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa635d4-532e-4ce8-a7a4-21fcb0fa4e14 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:44.371549 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56705779-421c-455e-8d2a-d689fe4f250a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:44.372188 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56705779-421c-455e-8d2a-d689fe4f250a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:44.372464 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56705779-421c-455e-8d2a-d689fe4f250a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:44.372732 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56705779-421c-455e-8d2a-d689fe4f250a admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:44.373419 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56705779-421c-455e-8d2a-d689fe4f250a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:44.375007 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56705779-421c-455e-8d2a-d689fe4f250a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:44.382543 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 601/1197] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Oct 28 14:27:44 2021] GET /identity/v3/services => generated 2191 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:27:46.645019 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed726cc-9ddf-4f32-94af-f648c427f276 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:46.645942 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed726cc-9ddf-4f32-94af-f648c427f276 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:46.645942 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed726cc-9ddf-4f32-94af-f648c427f276 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:46.648708 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 597/1198] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:27:46 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:27:46.658526 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffb806-25bb-43c9-a9bb-f8afdce01127 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:46.659004 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffb806-25bb-43c9-a9bb-f8afdce01127 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:46.659122 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffb806-25bb-43c9-a9bb-f8afdce01127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:46.686401 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-f1ffb806-25bb-43c9-a9bb-f8afdce01127 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:27:46.687804 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-f1ffb806-25bb-43c9-a9bb-f8afdce01127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:27:46.697757 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 602/1199] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:27:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:27:46.727086 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed726cc-9ddf-4f32-94af-f648c427f276 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:46.741030 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed726cc-9ddf-4f32-94af-f648c427f276 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:46.746322 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fbe7a-ce2b-4957-ba33-0387b4eedc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:46.747171 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fbe7a-ce2b-4957-ba33-0387b4eedc4d admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:46.747439 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fbe7a-ce2b-4957-ba33-0387b4eedc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:46.747698 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fbe7a-ce2b-4957-ba33-0387b4eedc4d admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:46.748372 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1fbe7a-ce2b-4957-ba33-0387b4eedc4d admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:46.749956 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1fbe7a-ce2b-4957-ba33-0387b4eedc4d admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:46.761372 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING keystone.server.flask.application [None req-bc1fbe7a-ce2b-4957-ba33-0387b4eedc4d admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 14:27:46.762513 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 598/1200] 10.222.0.79 () {56 vars in 1138 bytes} [Thu Oct 28 14:27:46 2021] GET /identity/v3/services/placement => generated 90 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 14:27:46.769390 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffb806-25bb-43c9-a9bb-f8afdce01127 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:46.779213 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffb806-25bb-43c9-a9bb-f8afdce01127 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:46.785531 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29b411-f921-4060-886b-494c5f593956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:46.786344 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29b411-f921-4060-886b-494c5f593956 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:46.786344 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29b411-f921-4060-886b-494c5f593956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:46.786902 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29b411-f921-4060-886b-494c5f593956 admin admin] PATH_INFO: `/v3/services` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:46.787445 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29b411-f921-4060-886b-494c5f593956 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:27:46.787745 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29b411-f921-4060-886b-494c5f593956 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:46.789318 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29b411-f921-4060-886b-494c5f593956 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:46.794750 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 603/1201] 10.222.0.79 () {56 vars in 1137 bytes} [Thu Oct 28 14:27:46 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:27:46.801944 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fbe7a-ce2b-4957-ba33-0387b4eedc4d admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:27:46.818522 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fbe7a-ce2b-4957-ba33-0387b4eedc4d admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:27:46.827688 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4966fc0-0a79-4428-89a1-e738f0e173fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:27:46.828614 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4966fc0-0a79-4428-89a1-e738f0e173fe admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:27:46.828980 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4966fc0-0a79-4428-89a1-e738f0e173fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:27:46.829721 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4966fc0-0a79-4428-89a1-e738f0e173fe admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:27:46.830465 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4966fc0-0a79-4428-89a1-e738f0e173fe admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:27:46.832067 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4966fc0-0a79-4428-89a1-e738f0e173fe admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:27:46.854333 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 599/1202] 10.222.0.79 () {60 vars in 1165 bytes} [Thu Oct 28 14:27:46 2021] POST /identity/v3/endpoints => generated 331 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:28:50.218585 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc3f02-5a2d-46c7-9826-a70e211e2ed9 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:28:50.219709 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc3f02-5a2d-46c7-9826-a70e211e2ed9 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:28:50.220201 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc3f02-5a2d-46c7-9826-a70e211e2ed9 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:28:50.226896 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 604/1203] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:28:50 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:28:50.228276 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a20068-95d6-40d8-bb5c-fbd26e0de0c8 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:28:50.228688 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a20068-95d6-40d8-bb5c-fbd26e0de0c8 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:28:50.228903 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a20068-95d6-40d8-bb5c-fbd26e0de0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:28:50.299768 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-b4a20068-95d6-40d8-bb5c-fbd26e0de0c8 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:28:50.301348 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-b4a20068-95d6-40d8-bb5c-fbd26e0de0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:28:50.408439 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 600/1204] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:28:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:28:50.433945 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc3f02-5a2d-46c7-9826-a70e211e2ed9 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:28:50.436144 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-82dc3f02-5a2d-46c7-9826-a70e211e2ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:28:50.571928 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc3f02-5a2d-46c7-9826-a70e211e2ed9 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:28:50.685812 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306c715-6474-4227-b52b-98e0c84b9363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:28:50.686554 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306c715-6474-4227-b52b-98e0c84b9363 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:28:50.687099 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306c715-6474-4227-b52b-98e0c84b9363 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:28:50.687539 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306c715-6474-4227-b52b-98e0c84b9363 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:28:50.688362 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306c715-6474-4227-b52b-98e0c84b9363 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:28:50.690220 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306c715-6474-4227-b52b-98e0c84b9363 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:28:50.712897 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 605/1205] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Oct 28 14:28:50 2021] GET /identity/v3/projects => generated 2553 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:28:53.042165 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6d39e-ab3b-448e-9d36-bd8e1fd7b88c None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:28:53.043095 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6d39e-ab3b-448e-9d36-bd8e1fd7b88c None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:28:53.043095 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6d39e-ab3b-448e-9d36-bd8e1fd7b88c None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:28:53.046370 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 601/1206] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:28:53 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:28:53.056865 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203ae2a-9c9e-4b59-a3a6-2885494e7d0b None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:28:53.057628 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203ae2a-9c9e-4b59-a3a6-2885494e7d0b None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:28:53.057780 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203ae2a-9c9e-4b59-a3a6-2885494e7d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:28:53.145185 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-6203ae2a-9c9e-4b59-a3a6-2885494e7d0b None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:28:53.146281 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-6203ae2a-9c9e-4b59-a3a6-2885494e7d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:28:53.245933 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 606/1207] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:28:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:28:53.299796 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80e228-b348-4d64-bb56-725b1fde59aa None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:28:53.300063 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80e228-b348-4d64-bb56-725b1fde59aa None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:28:53.300322 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80e228-b348-4d64-bb56-725b1fde59aa None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:28:53.302100 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 602/1208] 10.222.0.79 () {54 vars in 964 bytes} [Thu Oct 28 14:28:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:28:53.308598 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d57aa-cff7-47b2-8153-781df675bd73 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:28:53.308889 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d57aa-cff7-47b2-8153-781df675bd73 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:28:53.309165 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d57aa-cff7-47b2-8153-781df675bd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:28:53.386407 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-134d57aa-cff7-47b2-8153-781df675bd73 None None] MFA Rules not processed for user `a689fc75b37b4557a682f6cad357df6c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:28:53.387668 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-134d57aa-cff7-47b2-8153-781df675bd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:28:53.466113 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 607/1209] 10.222.0.79 () {58 vars in 1061 bytes} [Thu Oct 28 14:28:53 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:28:53.475843 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80e228-b348-4d64-bb56-725b1fde59aa None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:28:53.477399 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-0b80e228-b348-4d64-bb56-725b1fde59aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:28:53.582856 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80e228-b348-4d64-bb56-725b1fde59aa None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:28:53.656752 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e4ee6-f79e-4729-84f6-e2d12b9cf61b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:28:53.657412 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e4ee6-f79e-4729-84f6-e2d12b9cf61b service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:28:53.657695 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e4ee6-f79e-4729-84f6-e2d12b9cf61b service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:28:53.657925 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e4ee6-f79e-4729-84f6-e2d12b9cf61b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:28:53.659604 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-8a3e4ee6-f79e-4729-84f6-e2d12b9cf61b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:28:53.776834 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e4ee6-f79e-4729-84f6-e2d12b9cf61b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:28:53.778188 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e4ee6-f79e-4729-84f6-e2d12b9cf61b service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:28:53.796788 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 603/1210] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:28:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:28:56.326656 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fad15-c5a6-4bc8-b6a4-bb8892e53a51 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:28:56.327548 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fad15-c5a6-4bc8-b6a4-bb8892e53a51 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:28:56.327548 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fad15-c5a6-4bc8-b6a4-bb8892e53a51 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:28:56.329229 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 608/1211] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:28:56 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:28:56.335391 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0510fe1-6ad5-444c-ae99-633cce7bff53 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:28:56.335840 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0510fe1-6ad5-444c-ae99-633cce7bff53 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:28:56.335942 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0510fe1-6ad5-444c-ae99-633cce7bff53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:28:56.403230 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-b0510fe1-6ad5-444c-ae99-633cce7bff53 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:28:56.404447 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-b0510fe1-6ad5-444c-ae99-633cce7bff53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:28:56.526649 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 604/1212] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:28:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:28:56.570605 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fad15-c5a6-4bc8-b6a4-bb8892e53a51 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:28:56.572181 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-7c8fad15-c5a6-4bc8-b6a4-bb8892e53a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:28:56.680543 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fad15-c5a6-4bc8-b6a4-bb8892e53a51 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:28:56.765093 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654e2f8-a9f9-431a-bf9f-7be706f80b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:28:56.765728 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654e2f8-a9f9-431a-bf9f-7be706f80b29 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:28:56.766001 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654e2f8-a9f9-431a-bf9f-7be706f80b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:28:56.766262 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654e2f8-a9f9-431a-bf9f-7be706f80b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:28:56.767914 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-0654e2f8-a9f9-431a-bf9f-7be706f80b29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:28:56.895848 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654e2f8-a9f9-431a-bf9f-7be706f80b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:28:56.897300 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654e2f8-a9f9-431a-bf9f-7be706f80b29 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:28:56.916122 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 609/1213] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:28:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:28:59.467657 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba399ba-ccd2-495c-8e07-615bc4cba13f None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:28:59.468267 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba399ba-ccd2-495c-8e07-615bc4cba13f None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:28:59.468267 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba399ba-ccd2-495c-8e07-615bc4cba13f None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:28:59.469995 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 605/1214] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:28:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:28:59.477174 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabf9d6-04fa-45d2-b64d-6d25970fb44a None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:28:59.477869 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabf9d6-04fa-45d2-b64d-6d25970fb44a None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:28:59.478054 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabf9d6-04fa-45d2-b64d-6d25970fb44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:28:59.551117 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-4eabf9d6-04fa-45d2-b64d-6d25970fb44a None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:28:59.552392 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-4eabf9d6-04fa-45d2-b64d-6d25970fb44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:28:59.651850 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 610/1215] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:28:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:28:59.690169 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba399ba-ccd2-495c-8e07-615bc4cba13f None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:28:59.691807 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-bba399ba-ccd2-495c-8e07-615bc4cba13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:28:59.830430 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba399ba-ccd2-495c-8e07-615bc4cba13f None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:28:59.926018 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f7b9a-a232-43a1-a27f-5107f80406c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:28:59.926924 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f7b9a-a232-43a1-a27f-5107f80406c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:28:59.927199 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f7b9a-a232-43a1-a27f-5107f80406c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:28:59.927467 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f7b9a-a232-43a1-a27f-5107f80406c8 admin admin] PATH_INFO: `/v3/projects/c0fc8be7ace747daba1f61a78ad61736` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:28:59.937583 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f7b9a-a232-43a1-a27f-5107f80406c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0fc8be7ace747daba1f61a78ad61736)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:28:59.939713 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f7b9a-a232-43a1-a27f-5107f80406c8 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:28:59.941455 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 606/1216] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:28:59 2021] GET /identity/v3/projects/c0fc8be7ace747daba1f61a78ad61736 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:28:59.956987 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabf9d6-04fa-45d2-b64d-6d25970fb44a None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:28:59.958291 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-4eabf9d6-04fa-45d2-b64d-6d25970fb44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:00.048099 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabf9d6-04fa-45d2-b64d-6d25970fb44a None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:29:00.131050 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbc095-93fd-4199-a199-6c2b3e23263b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:29:00.131653 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbc095-93fd-4199-a199-6c2b3e23263b service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:00.131988 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbc095-93fd-4199-a199-6c2b3e23263b service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:00.132262 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbc095-93fd-4199-a199-6c2b3e23263b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:00.133907 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-0cbbc095-93fd-4199-a199-6c2b3e23263b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:00.249218 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbc095-93fd-4199-a199-6c2b3e23263b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:29:00.250644 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbc095-93fd-4199-a199-6c2b3e23263b service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:29:00.268559 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 611/1217] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:28:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:29:03.088538 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fa87e-61af-425c-bb94-8c2cd00611bc None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:03.089432 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fa87e-61af-425c-bb94-8c2cd00611bc None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:03.089432 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fa87e-61af-425c-bb94-8c2cd00611bc None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:03.092302 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 607/1218] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:29:03 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:29:03.102964 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a722c0d-3a7f-4201-8adf-1109d0d69497 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:03.103656 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a722c0d-3a7f-4201-8adf-1109d0d69497 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:03.103761 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a722c0d-3a7f-4201-8adf-1109d0d69497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:03.173354 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-1a722c0d-3a7f-4201-8adf-1109d0d69497 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:29:03.174574 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-1a722c0d-3a7f-4201-8adf-1109d0d69497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:03.275281 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 612/1219] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:29:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:29:03.311654 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fa87e-61af-425c-bb94-8c2cd00611bc None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:29:03.313993 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-d48fa87e-61af-425c-bb94-8c2cd00611bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:03.465351 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fa87e-61af-425c-bb94-8c2cd00611bc None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:29:03.558630 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae73b0a-68d6-4adc-bc74-529acbc264a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:29:03.559519 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae73b0a-68d6-4adc-bc74-529acbc264a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:03.559801 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae73b0a-68d6-4adc-bc74-529acbc264a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:03.560072 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae73b0a-68d6-4adc-bc74-529acbc264a7 admin admin] PATH_INFO: `/v3/projects/c0fc8be7ace747daba1f61a78ad61736` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:03.570435 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae73b0a-68d6-4adc-bc74-529acbc264a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0fc8be7ace747daba1f61a78ad61736)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:29:03.572548 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae73b0a-68d6-4adc-bc74-529acbc264a7 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:29:03.574250 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 608/1220] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:29:03 2021] GET /identity/v3/projects/c0fc8be7ace747daba1f61a78ad61736 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:29:03.587738 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a722c0d-3a7f-4201-8adf-1109d0d69497 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:29:03.589577 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-1a722c0d-3a7f-4201-8adf-1109d0d69497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:03.692126 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a722c0d-3a7f-4201-8adf-1109d0d69497 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:29:03.766644 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b88eff-2973-40aa-aa43-f94dc60a3c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:29:03.767253 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b88eff-2973-40aa-aa43-f94dc60a3c3b service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:03.767529 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b88eff-2973-40aa-aa43-f94dc60a3c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:03.767796 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b88eff-2973-40aa-aa43-f94dc60a3c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:03.769415 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-19b88eff-2973-40aa-aa43-f94dc60a3c3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:03.881081 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b88eff-2973-40aa-aa43-f94dc60a3c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:29:03.882501 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b88eff-2973-40aa-aa43-f94dc60a3c3b service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:29:03.901896 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 613/1221] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:29:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:29:06.827916 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f47bf8-6802-468c-bbe5-dd7d0b3c6346 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:06.828519 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f47bf8-6802-468c-bbe5-dd7d0b3c6346 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:06.828519 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f47bf8-6802-468c-bbe5-dd7d0b3c6346 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:06.830581 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 609/1222] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:29:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:29:06.837471 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c515c19-914e-4773-b684-f7867bbf93a2 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:06.838061 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c515c19-914e-4773-b684-f7867bbf93a2 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:06.838061 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c515c19-914e-4773-b684-f7867bbf93a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:06.909021 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-9c515c19-914e-4773-b684-f7867bbf93a2 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:29:06.910253 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-9c515c19-914e-4773-b684-f7867bbf93a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:07.009036 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 614/1223] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:29:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:29:07.047242 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f47bf8-6802-468c-bbe5-dd7d0b3c6346 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:29:07.048891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-10f47bf8-6802-468c-bbe5-dd7d0b3c6346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:07.152908 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f47bf8-6802-468c-bbe5-dd7d0b3c6346 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:29:07.223501 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd29b85-f71d-49be-a2ed-7603f210ed5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:29:07.224061 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd29b85-f71d-49be-a2ed-7603f210ed5e service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:07.224336 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd29b85-f71d-49be-a2ed-7603f210ed5e service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:07.224599 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd29b85-f71d-49be-a2ed-7603f210ed5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:07.226211 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-efd29b85-f71d-49be-a2ed-7603f210ed5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:07.335636 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd29b85-f71d-49be-a2ed-7603f210ed5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:29:07.337095 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd29b85-f71d-49be-a2ed-7603f210ed5e service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:29:07.358960 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 610/1224] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:29:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:29:09.642990 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3af407-4cfd-48be-8f98-d0bb1d1efa47 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:09.643588 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3af407-4cfd-48be-8f98-d0bb1d1efa47 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:09.643588 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3af407-4cfd-48be-8f98-d0bb1d1efa47 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:09.645309 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 615/1225] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:29:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:29:09.651456 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835f9d3-76f3-4f51-9d8f-271c9d43339e None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:09.651898 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835f9d3-76f3-4f51-9d8f-271c9d43339e None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:09.652127 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835f9d3-76f3-4f51-9d8f-271c9d43339e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:09.722061 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-e835f9d3-76f3-4f51-9d8f-271c9d43339e None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:29:09.723196 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e835f9d3-76f3-4f51-9d8f-271c9d43339e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:09.820960 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 611/1226] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:29:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:29:09.858200 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3af407-4cfd-48be-8f98-d0bb1d1efa47 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:29:09.859821 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-ff3af407-4cfd-48be-8f98-d0bb1d1efa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:09.967517 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3af407-4cfd-48be-8f98-d0bb1d1efa47 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:29:10.043157 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f08d9e-bf8e-4eb3-8e5b-cbce032b0beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:29:10.043798 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f08d9e-bf8e-4eb3-8e5b-cbce032b0beb service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:10.044071 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f08d9e-bf8e-4eb3-8e5b-cbce032b0beb service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:10.044331 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f08d9e-bf8e-4eb3-8e5b-cbce032b0beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:10.046547 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-e9f08d9e-bf8e-4eb3-8e5b-cbce032b0beb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:10.159986 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f08d9e-bf8e-4eb3-8e5b-cbce032b0beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:29:10.161419 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f08d9e-bf8e-4eb3-8e5b-cbce032b0beb service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:29:10.180951 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 616/1227] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:29:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:29:12.485634 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc4ea4-3ebd-47bb-b532-f78f4d019e2b None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:12.486247 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc4ea4-3ebd-47bb-b532-f78f4d019e2b None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:12.486247 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc4ea4-3ebd-47bb-b532-f78f4d019e2b None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:12.487980 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 612/1228] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:29:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:29:12.494427 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0f0ba-15fc-42e3-ab57-48eb23be0868 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:12.494901 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0f0ba-15fc-42e3-ab57-48eb23be0868 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:12.495134 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0f0ba-15fc-42e3-ab57-48eb23be0868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:12.565283 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-6fc0f0ba-15fc-42e3-ab57-48eb23be0868 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:29:12.566527 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-6fc0f0ba-15fc-42e3-ab57-48eb23be0868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:12.666076 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 617/1229] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:29:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:29:12.699739 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc4ea4-3ebd-47bb-b532-f78f4d019e2b None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:29:12.701464 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-65fc4ea4-3ebd-47bb-b532-f78f4d019e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:12.823936 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc4ea4-3ebd-47bb-b532-f78f4d019e2b None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:29:12.923553 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899816c-c774-4a3a-8d22-ae957f86320e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:29:12.924822 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899816c-c774-4a3a-8d22-ae957f86320e admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:12.925251 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899816c-c774-4a3a-8d22-ae957f86320e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:12.925695 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899816c-c774-4a3a-8d22-ae957f86320e admin admin] PATH_INFO: `/v3/projects/c0fc8be7ace747daba1f61a78ad61736` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:12.937101 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899816c-c774-4a3a-8d22-ae957f86320e admin admin] RBAC: Authorizing `identity:get_project(project_id=c0fc8be7ace747daba1f61a78ad61736)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:29:12.939239 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899816c-c774-4a3a-8d22-ae957f86320e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:29:12.941026 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 613/1230] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:29:12 2021] GET /identity/v3/projects/c0fc8be7ace747daba1f61a78ad61736 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:29:12.953667 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0f0ba-15fc-42e3-ab57-48eb23be0868 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:29:12.954989 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-6fc0f0ba-15fc-42e3-ab57-48eb23be0868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:13.047025 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0f0ba-15fc-42e3-ab57-48eb23be0868 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:29:13.121867 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09607f80-9388-4668-b874-267b7f32676c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:29:13.122528 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09607f80-9388-4668-b874-267b7f32676c service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:13.122854 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09607f80-9388-4668-b874-267b7f32676c service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:13.123245 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09607f80-9388-4668-b874-267b7f32676c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:13.124900 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-09607f80-9388-4668-b874-267b7f32676c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:13.235385 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09607f80-9388-4668-b874-267b7f32676c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:29:13.236827 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09607f80-9388-4668-b874-267b7f32676c service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:29:13.255906 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 618/1231] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:29:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:29:15.786167 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fc3c4-9469-48c4-9f2a-23a8c67e4fdd None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:15.787090 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fc3c4-9469-48c4-9f2a-23a8c67e4fdd None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:15.787090 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fc3c4-9469-48c4-9f2a-23a8c67e4fdd None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:15.790018 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 614/1232] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:29:15 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:29:15.796521 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00d730-11d9-44c9-a6a4-3e534a0f31b2 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:15.796974 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00d730-11d9-44c9-a6a4-3e534a0f31b2 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:15.797066 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00d730-11d9-44c9-a6a4-3e534a0f31b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:15.861841 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-6f00d730-11d9-44c9-a6a4-3e534a0f31b2 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:29:15.863068 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-6f00d730-11d9-44c9-a6a4-3e534a0f31b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:15.960065 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 619/1233] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:29:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:29:16.001290 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fc3c4-9469-48c4-9f2a-23a8c67e4fdd None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:29:16.003791 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-b58fc3c4-9469-48c4-9f2a-23a8c67e4fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:16.112100 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fc3c4-9469-48c4-9f2a-23a8c67e4fdd None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:29:16.183865 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01b183-da84-4e98-bf18-abf1cf19dfff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:29:16.184504 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01b183-da84-4e98-bf18-abf1cf19dfff service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:16.184780 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01b183-da84-4e98-bf18-abf1cf19dfff service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:16.185076 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01b183-da84-4e98-bf18-abf1cf19dfff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:16.186696 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-4c01b183-da84-4e98-bf18-abf1cf19dfff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:16.292374 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01b183-da84-4e98-bf18-abf1cf19dfff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:29:16.293792 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01b183-da84-4e98-bf18-abf1cf19dfff service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:29:16.312592 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 615/1234] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:29:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:29:18.584594 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0e257-0d73-4143-acb5-c04f58778e6c None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:18.585514 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0e257-0d73-4143-acb5-c04f58778e6c None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:18.585514 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0e257-0d73-4143-acb5-c04f58778e6c None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:18.588337 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 620/1235] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:29:18 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:29:18.594796 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575fa8f-a1ce-49b6-8bc2-cae00f546f10 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:18.595225 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575fa8f-a1ce-49b6-8bc2-cae00f546f10 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:18.595315 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575fa8f-a1ce-49b6-8bc2-cae00f546f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:18.660333 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-6575fa8f-a1ce-49b6-8bc2-cae00f546f10 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:29:18.661510 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-6575fa8f-a1ce-49b6-8bc2-cae00f546f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:18.762834 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 616/1236] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:29:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:29:18.808323 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0e257-0d73-4143-acb5-c04f58778e6c None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:29:18.810701 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-8ad0e257-0d73-4143-acb5-c04f58778e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:18.917989 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0e257-0d73-4143-acb5-c04f58778e6c None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:29:18.993426 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf8e94-002e-4d9c-a2dd-bcd599ab21b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:29:18.994069 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf8e94-002e-4d9c-a2dd-bcd599ab21b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:18.994343 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf8e94-002e-4d9c-a2dd-bcd599ab21b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:18.994607 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf8e94-002e-4d9c-a2dd-bcd599ab21b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:18.996242 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-7fdf8e94-002e-4d9c-a2dd-bcd599ab21b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:19.107261 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf8e94-002e-4d9c-a2dd-bcd599ab21b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:29:19.108605 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf8e94-002e-4d9c-a2dd-bcd599ab21b9 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:29:19.126951 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 621/1237] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:29:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:29:21.717454 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aeebfe-6b6d-4861-82f8-486bdccc473b None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:21.718362 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aeebfe-6b6d-4861-82f8-486bdccc473b None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:21.718362 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aeebfe-6b6d-4861-82f8-486bdccc473b None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:21.721266 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 617/1238] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:29:21 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:29:21.727429 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30af809-44ef-44ac-b2f6-91163ab57f1c None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:21.727886 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30af809-44ef-44ac-b2f6-91163ab57f1c None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:21.727979 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30af809-44ef-44ac-b2f6-91163ab57f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:21.806510 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-c30af809-44ef-44ac-b2f6-91163ab57f1c None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:29:21.807725 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-c30af809-44ef-44ac-b2f6-91163ab57f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:21.926817 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 622/1239] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:29:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:29:21.966821 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aeebfe-6b6d-4861-82f8-486bdccc473b None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:29:21.969388 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-03aeebfe-6b6d-4861-82f8-486bdccc473b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:22.069772 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aeebfe-6b6d-4861-82f8-486bdccc473b None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:29:22.074261 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4c431-9f7f-4d31-b0de-b31c6cf068fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:29:22.074949 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4c431-9f7f-4d31-b0de-b31c6cf068fe service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:22.075223 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4c431-9f7f-4d31-b0de-b31c6cf068fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:22.075526 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4c431-9f7f-4d31-b0de-b31c6cf068fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:22.085263 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4c431-9f7f-4d31-b0de-b31c6cf068fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:29:22.086703 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4c431-9f7f-4d31-b0de-b31c6cf068fe service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:29:22.096265 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 618/1240] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:29:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:29:26.258815 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a4cb1-3004-4b33-94f9-2420fcd4ba08 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:26.259379 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a4cb1-3004-4b33-94f9-2420fcd4ba08 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:26.259379 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a4cb1-3004-4b33-94f9-2420fcd4ba08 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:26.261245 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 623/1241] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:29:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:29:26.267201 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e548e3-4061-41a3-a779-4e95a323dda4 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:26.267632 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e548e3-4061-41a3-a779-4e95a323dda4 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:26.267884 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e548e3-4061-41a3-a779-4e95a323dda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:26.286630 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-f9e548e3-4061-41a3-a779-4e95a323dda4 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:29:26.287892 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-f9e548e3-4061-41a3-a779-4e95a323dda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:26.296720 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 619/1242] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:29:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:29:26.349478 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a3b82-4cf5-414a-ae33-ef815ca34c0a None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:26.349743 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a3b82-4cf5-414a-ae33-ef815ca34c0a None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:26.350036 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a3b82-4cf5-414a-ae33-ef815ca34c0a None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:26.351879 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 624/1243] 10.222.0.79 () {54 vars in 964 bytes} [Thu Oct 28 14:29:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:29:26.358160 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73161f-b146-47ad-9476-6dd28e26174d None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:26.358541 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73161f-b146-47ad-9476-6dd28e26174d None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:26.358933 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73161f-b146-47ad-9476-6dd28e26174d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:26.424249 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-0e73161f-b146-47ad-9476-6dd28e26174d None None] MFA Rules not processed for user `a689fc75b37b4557a682f6cad357df6c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:29:26.425568 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-0e73161f-b146-47ad-9476-6dd28e26174d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:26.433273 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 620/1244] 10.222.0.79 () {58 vars in 1061 bytes} [Thu Oct 28 14:29:26 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:29:26.443167 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a3b82-4cf5-414a-ae33-ef815ca34c0a None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:29:26.457084 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a3b82-4cf5-414a-ae33-ef815ca34c0a None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:29:26.461591 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6118e-e8c0-4243-b299-ecb7e0a5136e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:29:26.462270 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6118e-e8c0-4243-b299-ecb7e0a5136e service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:26.462541 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6118e-e8c0-4243-b299-ecb7e0a5136e service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:26.462837 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6118e-e8c0-4243-b299-ecb7e0a5136e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:26.473360 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6118e-e8c0-4243-b299-ecb7e0a5136e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:29:26.474909 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6118e-e8c0-4243-b299-ecb7e0a5136e service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:29:26.485048 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 625/1245] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:29:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:29:29.968745 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48efa7-5ff7-4e59-b01c-e3d17b822461 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:29.969301 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48efa7-5ff7-4e59-b01c-e3d17b822461 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:29.969301 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48efa7-5ff7-4e59-b01c-e3d17b822461 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:29.971040 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 621/1246] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:29:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:29:29.977281 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e3597-804b-494c-a705-0422715ed6ca None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:29.977747 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e3597-804b-494c-a705-0422715ed6ca None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:29.977747 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e3597-804b-494c-a705-0422715ed6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:29.997355 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-549e3597-804b-494c-a705-0422715ed6ca None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:29:29.998611 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-549e3597-804b-494c-a705-0422715ed6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:30.006869 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 626/1247] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:29:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:29:30.045879 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48efa7-5ff7-4e59-b01c-e3d17b822461 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:29:30.058092 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48efa7-5ff7-4e59-b01c-e3d17b822461 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:29:30.062408 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1bc22-90f3-4d2c-bca3-dabd1c02af73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:29:30.063095 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1bc22-90f3-4d2c-bca3-dabd1c02af73 service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:30.063374 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1bc22-90f3-4d2c-bca3-dabd1c02af73 service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:30.063648 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1bc22-90f3-4d2c-bca3-dabd1c02af73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:30.073287 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1bc22-90f3-4d2c-bca3-dabd1c02af73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:29:30.074726 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1bc22-90f3-4d2c-bca3-dabd1c02af73 service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:29:30.084400 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 622/1248] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:29:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:29:34.534731 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250b2c1-80a2-46a9-a0e1-94bf389dbf30 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:34.535317 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250b2c1-80a2-46a9-a0e1-94bf389dbf30 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:34.535317 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250b2c1-80a2-46a9-a0e1-94bf389dbf30 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:34.537232 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 627/1249] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:29:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:29:34.543586 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee387f8-48f0-420b-b165-a4fa529bf239 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:34.544403 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee387f8-48f0-420b-b165-a4fa529bf239 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:34.544518 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee387f8-48f0-420b-b165-a4fa529bf239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:34.565427 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-0ee387f8-48f0-420b-b165-a4fa529bf239 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:29:34.567067 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-0ee387f8-48f0-420b-b165-a4fa529bf239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:34.576627 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 623/1250] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:29:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:29:34.615954 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250b2c1-80a2-46a9-a0e1-94bf389dbf30 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:29:34.627075 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250b2c1-80a2-46a9-a0e1-94bf389dbf30 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:29:34.630637 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5325d68-9b2f-4e31-b181-460385438f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:29:34.631303 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5325d68-9b2f-4e31-b181-460385438f12 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:34.631575 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5325d68-9b2f-4e31-b181-460385438f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:34.631844 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5325d68-9b2f-4e31-b181-460385438f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:34.640939 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5325d68-9b2f-4e31-b181-460385438f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:29:34.642349 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5325d68-9b2f-4e31-b181-460385438f12 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:29:34.652607 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 628/1251] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:29:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:29:39.611095 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd04ac1-2d70-4af8-a799-9c619ccc2f18 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:39.611623 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd04ac1-2d70-4af8-a799-9c619ccc2f18 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:39.611623 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd04ac1-2d70-4af8-a799-9c619ccc2f18 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:39.613339 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 624/1252] 10.222.0.79 () {54 vars in 921 bytes} [Thu Oct 28 14:29:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:29:39.636618 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15425f39-1e40-4f80-a0b0-745dbe9309b8 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:39.637628 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15425f39-1e40-4f80-a0b0-745dbe9309b8 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:39.638044 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15425f39-1e40-4f80-a0b0-745dbe9309b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:39.704486 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-15425f39-1e40-4f80-a0b0-745dbe9309b8 None None] MFA Rules not processed for user `8bf32a6fafb7458788a47e4774cb7bc8`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:29:39.706124 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-15425f39-1e40-4f80-a0b0-745dbe9309b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:39.803136 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 629/1253] 10.222.0.79 () {58 vars in 1018 bytes} [Thu Oct 28 14:29:39 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:29:44.058318 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e1142-eb05-4d4e-89d5-7acaa42438ac None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:44.059467 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e1142-eb05-4d4e-89d5-7acaa42438ac None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:44.059689 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e1142-eb05-4d4e-89d5-7acaa42438ac None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:44.061616 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 625/1254] 10.222.0.79 () {54 vars in 921 bytes} [Thu Oct 28 14:29:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:29:44.067130 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478b97e-e681-4caa-a09f-6b2e896d6506 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:44.067953 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478b97e-e681-4caa-a09f-6b2e896d6506 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:44.068426 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478b97e-e681-4caa-a09f-6b2e896d6506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:44.087194 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-c478b97e-e681-4caa-a09f-6b2e896d6506 None None] MFA Rules not processed for user `8bf32a6fafb7458788a47e4774cb7bc8`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:29:44.088381 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-c478b97e-e681-4caa-a09f-6b2e896d6506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:44.097411 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 630/1255] 10.222.0.79 () {58 vars in 1018 bytes} [Thu Oct 28 14:29:44 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:29:45.575913 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aead2c0-df85-41d3-bd08-77064619b83b None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:45.576485 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aead2c0-df85-41d3-bd08-77064619b83b None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:45.576485 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aead2c0-df85-41d3-bd08-77064619b83b None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:45.578137 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 626/1256] 10.222.0.79 () {54 vars in 921 bytes} [Thu Oct 28 14:29:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:29:45.583639 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02f52f-c1fc-4ad5-920b-5c17878128b3 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:45.584090 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02f52f-c1fc-4ad5-920b-5c17878128b3 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:45.584206 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02f52f-c1fc-4ad5-920b-5c17878128b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:45.610948 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-5d02f52f-c1fc-4ad5-920b-5c17878128b3 None None] MFA Rules not processed for user `8bf32a6fafb7458788a47e4774cb7bc8`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:29:45.612184 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-5d02f52f-c1fc-4ad5-920b-5c17878128b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:45.622642 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 631/1257] 10.222.0.79 () {58 vars in 1018 bytes} [Thu Oct 28 14:29:45 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:29:49.438043 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8465e-6db2-4470-82d4-f5a554973f3c None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:49.438640 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8465e-6db2-4470-82d4-f5a554973f3c None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:49.438640 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8465e-6db2-4470-82d4-f5a554973f3c None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:49.440327 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 627/1258] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:29:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:29:49.446301 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65321d-2134-4f03-b100-cffa9f215026 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:49.446753 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65321d-2134-4f03-b100-cffa9f215026 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:49.446836 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65321d-2134-4f03-b100-cffa9f215026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:49.465277 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-8a65321d-2134-4f03-b100-cffa9f215026 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:29:49.466449 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-8a65321d-2134-4f03-b100-cffa9f215026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:49.474937 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 632/1259] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:29:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:29:49.527492 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a150537-c6fd-409c-9823-a4e981cde89f None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:49.528046 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a150537-c6fd-409c-9823-a4e981cde89f None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:49.528322 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a150537-c6fd-409c-9823-a4e981cde89f None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:49.530395 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 628/1260] 10.222.0.79 () {54 vars in 960 bytes} [Thu Oct 28 14:29:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:29:49.536069 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbea11-5d40-49b4-93c6-2df4c1059f56 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:49.536485 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbea11-5d40-49b4-93c6-2df4c1059f56 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:49.536860 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbea11-5d40-49b4-93c6-2df4c1059f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:49.590153 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-19bbea11-5d40-49b4-93c6-2df4c1059f56 None None] MFA Rules not processed for user `18cd6636ae7847c78be910824410d295`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:29:49.591526 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-19bbea11-5d40-49b4-93c6-2df4c1059f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:49.678728 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 633/1261] 10.222.0.79 () {58 vars in 1057 bytes} [Thu Oct 28 14:29:49 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:29:49.687246 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a150537-c6fd-409c-9823-a4e981cde89f None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:29:49.701384 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a150537-c6fd-409c-9823-a4e981cde89f None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:29:49.706647 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b97e6-b1fa-4882-b8fd-a1b50810ba5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:29:49.707326 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b97e6-b1fa-4882-b8fd-a1b50810ba5f service nova] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:49.707607 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b97e6-b1fa-4882-b8fd-a1b50810ba5f service nova] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:49.707930 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b97e6-b1fa-4882-b8fd-a1b50810ba5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:49.716371 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b97e6-b1fa-4882-b8fd-a1b50810ba5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:29:49.717965 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b97e6-b1fa-4882-b8fd-a1b50810ba5f service nova] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:29:49.728000 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 629/1262] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:29:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:29:52.206587 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec3c91-7af6-46a8-a1b3-565be6e36fc8 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:52.207236 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec3c91-7af6-46a8-a1b3-565be6e36fc8 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:52.207236 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec3c91-7af6-46a8-a1b3-565be6e36fc8 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:52.210745 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 634/1263] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:29:52 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:29:52.214972 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f0408-4863-44ff-9a1d-4bedc9c33119 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:52.215449 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f0408-4863-44ff-9a1d-4bedc9c33119 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:52.215634 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f0408-4863-44ff-9a1d-4bedc9c33119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:52.233281 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-758f0408-4863-44ff-9a1d-4bedc9c33119 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:29:52.234457 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-758f0408-4863-44ff-9a1d-4bedc9c33119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:52.242407 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 630/1264] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:29:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:29:52.288906 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec3c91-7af6-46a8-a1b3-565be6e36fc8 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:29:52.305155 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec3c91-7af6-46a8-a1b3-565be6e36fc8 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:29:52.311188 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb6c5d-83f2-42bc-b7ac-672b8fb74a8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:29:52.311991 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb6c5d-83f2-42bc-b7ac-672b8fb74a8a service nova] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:52.312371 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb6c5d-83f2-42bc-b7ac-672b8fb74a8a service nova] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:52.312766 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb6c5d-83f2-42bc-b7ac-672b8fb74a8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:52.321261 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb6c5d-83f2-42bc-b7ac-672b8fb74a8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:29:52.323028 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb6c5d-83f2-42bc-b7ac-672b8fb74a8a service nova] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:29:52.333270 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 635/1265] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:29:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:29:54.929103 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f669b66-4ca4-41e7-969d-a23bc37063ba None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:54.929655 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f669b66-4ca4-41e7-969d-a23bc37063ba None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:54.929655 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f669b66-4ca4-41e7-969d-a23bc37063ba None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:54.931498 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 631/1266] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:29:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:29:54.937720 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d9042-8c17-4ea6-b005-8a4aef99a676 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:54.938156 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d9042-8c17-4ea6-b005-8a4aef99a676 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:54.938266 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d9042-8c17-4ea6-b005-8a4aef99a676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:54.958609 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-9a3d9042-8c17-4ea6-b005-8a4aef99a676 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:29:54.959987 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-9a3d9042-8c17-4ea6-b005-8a4aef99a676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:54.968696 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 636/1267] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:29:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:29:55.016750 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ad920-7e01-46ac-97b0-50a4e9f5f756 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:55.017041 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ad920-7e01-46ac-97b0-50a4e9f5f756 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:55.017311 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ad920-7e01-46ac-97b0-50a4e9f5f756 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:55.019235 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 632/1268] 10.222.0.79 () {54 vars in 960 bytes} [Thu Oct 28 14:29:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:29:55.025205 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f7df5-c0cf-4edb-9022-26cecc8e721e None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:55.025496 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f7df5-c0cf-4edb-9022-26cecc8e721e None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:55.025772 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f7df5-c0cf-4edb-9022-26cecc8e721e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:55.047945 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-517f7df5-c0cf-4edb-9022-26cecc8e721e None None] MFA Rules not processed for user `18cd6636ae7847c78be910824410d295`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:29:55.051086 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-517f7df5-c0cf-4edb-9022-26cecc8e721e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:55.063434 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 637/1269] 10.222.0.79 () {58 vars in 1057 bytes} [Thu Oct 28 14:29:55 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:29:55.073655 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ad920-7e01-46ac-97b0-50a4e9f5f756 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:29:55.091924 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ad920-7e01-46ac-97b0-50a4e9f5f756 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:29:55.097717 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404de706-8595-4550-8b13-cf599c40c111 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:29:55.098610 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404de706-8595-4550-8b13-cf599c40c111 service nova] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:55.099083 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404de706-8595-4550-8b13-cf599c40c111 service nova] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:55.099453 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404de706-8595-4550-8b13-cf599c40c111 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:55.109314 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404de706-8595-4550-8b13-cf599c40c111 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:29:55.111077 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404de706-8595-4550-8b13-cf599c40c111 service nova] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:29:55.122027 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 633/1270] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:29:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:29:57.238260 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c6e7e-0e87-40c9-bc16-04d5f7f0841d None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:57.238870 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c6e7e-0e87-40c9-bc16-04d5f7f0841d None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:57.238870 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c6e7e-0e87-40c9-bc16-04d5f7f0841d None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:57.240592 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 638/1271] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:29:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:29:57.246915 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42457c-964a-4a22-8b88-512910cf7867 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:57.247349 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42457c-964a-4a22-8b88-512910cf7867 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:57.247427 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42457c-964a-4a22-8b88-512910cf7867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:57.265713 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-af42457c-964a-4a22-8b88-512910cf7867 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:29:57.266943 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-af42457c-964a-4a22-8b88-512910cf7867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:57.275296 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 634/1272] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:29:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:29:57.330848 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f39d6-79b9-44b4-86ad-69b514871cc7 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:57.331304 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f39d6-79b9-44b4-86ad-69b514871cc7 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:57.331846 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f39d6-79b9-44b4-86ad-69b514871cc7 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:57.334669 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 639/1273] 10.222.0.79 () {54 vars in 962 bytes} [Thu Oct 28 14:29:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:29:57.340976 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7749506-f99b-4754-bfd2-2cef7f226943 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:57.341237 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7749506-f99b-4754-bfd2-2cef7f226943 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:57.341688 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7749506-f99b-4754-bfd2-2cef7f226943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:57.397062 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-a7749506-f99b-4754-bfd2-2cef7f226943 None None] MFA Rules not processed for user `218708788ed447499b00de12cff0f6e5`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:29:57.398264 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-a7749506-f99b-4754-bfd2-2cef7f226943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:57.461205 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 635/1274] 10.222.0.79 () {58 vars in 1059 bytes} [Thu Oct 28 14:29:57 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:29:57.470270 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5e8d4-ec91-42e7-8a9d-87f9d48ffe56 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:57.470557 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5e8d4-ec91-42e7-8a9d-87f9d48ffe56 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:57.470857 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5e8d4-ec91-42e7-8a9d-87f9d48ffe56 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:57.472653 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 640/1275] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:29:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:29:57.474905 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7749506-f99b-4754-bfd2-2cef7f226943 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:29:57.478291 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4f0f0-2e0f-4bd8-a84c-8ab7517d47c6 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:57.478579 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4f0f0-2e0f-4bd8-a84c-8ab7517d47c6 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:57.478885 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4f0f0-2e0f-4bd8-a84c-8ab7517d47c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:57.483700 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7749506-f99b-4754-bfd2-2cef7f226943 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:29:57.489079 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee9e1c-0730-4886-96a4-e66cf590b333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:29:57.489667 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee9e1c-0730-4886-96a4-e66cf590b333 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:57.489951 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee9e1c-0730-4886-96a4-e66cf590b333 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:57.490192 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee9e1c-0730-4886-96a4-e66cf590b333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:57.498420 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-d7c4f0f0-2e0f-4bd8-a84c-8ab7517d47c6 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:29:57.499642 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-d7c4f0f0-2e0f-4bd8-a84c-8ab7517d47c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:29:57.500234 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee9e1c-0730-4886-96a4-e66cf590b333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:29:57.501802 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee9e1c-0730-4886-96a4-e66cf590b333 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:29:57.508800 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 641/1276] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:29:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:29:57.513634 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 636/1277] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:29:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:29:57.564728 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4f0f0-2e0f-4bd8-a84c-8ab7517d47c6 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:29:57.577878 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4f0f0-2e0f-4bd8-a84c-8ab7517d47c6 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:29:57.619224 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbd087-6d24-487c-8823-85917e47c597 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:29:57.620125 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbd087-6d24-487c-8823-85917e47c597 service nova] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:57.620562 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbd087-6d24-487c-8823-85917e47c597 service nova] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:57.620954 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbd087-6d24-487c-8823-85917e47c597 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:57.632885 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbd087-6d24-487c-8823-85917e47c597 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:29:57.634474 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbd087-6d24-487c-8823-85917e47c597 service nova] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:29:57.656182 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 642/1278] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:29:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:29:59.996780 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b271876-1767-4f96-b171-8a757e89060b None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:29:59.997373 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b271876-1767-4f96-b171-8a757e89060b None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:29:59.997373 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b271876-1767-4f96-b171-8a757e89060b None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:29:59.999141 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 637/1279] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:29:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:30:00.005092 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a42bd-2da2-48b4-bc4b-4f492b29409f None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:00.005533 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a42bd-2da2-48b4-bc4b-4f492b29409f None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:00.005625 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a42bd-2da2-48b4-bc4b-4f492b29409f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:00.024108 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-993a42bd-2da2-48b4-bc4b-4f492b29409f None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:30:00.025284 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-993a42bd-2da2-48b4-bc4b-4f492b29409f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:30:00.034321 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 643/1280] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:30:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:30:00.081561 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b271876-1767-4f96-b171-8a757e89060b None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:00.097742 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b271876-1767-4f96-b171-8a757e89060b None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:00.103610 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729836e-7800-4d93-a2cd-26fae64f82b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:00.104273 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729836e-7800-4d93-a2cd-26fae64f82b0 service nova] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:00.104557 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729836e-7800-4d93-a2cd-26fae64f82b0 service nova] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:00.104863 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729836e-7800-4d93-a2cd-26fae64f82b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:00.113905 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729836e-7800-4d93-a2cd-26fae64f82b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:00.115537 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729836e-7800-4d93-a2cd-26fae64f82b0 service nova] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:00.125549 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 638/1281] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:30:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:30:02.415092 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7af523-3dfe-4ccb-a38c-79c7025d03db None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:02.415608 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7af523-3dfe-4ccb-a38c-79c7025d03db None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:02.415699 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7af523-3dfe-4ccb-a38c-79c7025d03db None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:02.417861 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 644/1282] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:30:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:30:02.424541 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092d557-cda1-4302-986c-bd18794c147e None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:02.425027 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092d557-cda1-4302-986c-bd18794c147e None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:02.425027 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092d557-cda1-4302-986c-bd18794c147e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:02.443568 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-7092d557-cda1-4302-986c-bd18794c147e None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:30:02.444740 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-7092d557-cda1-4302-986c-bd18794c147e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:30:02.453188 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 639/1283] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:30:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:30:02.499634 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7af523-3dfe-4ccb-a38c-79c7025d03db None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:02.515445 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7af523-3dfe-4ccb-a38c-79c7025d03db None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:02.521789 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8eb6e-9a92-4e9c-955e-fef6ee9b67ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:02.522624 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8eb6e-9a92-4e9c-955e-fef6ee9b67ab service nova] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:02.523012 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8eb6e-9a92-4e9c-955e-fef6ee9b67ab service nova] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:02.523353 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8eb6e-9a92-4e9c-955e-fef6ee9b67ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:02.532822 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8eb6e-9a92-4e9c-955e-fef6ee9b67ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:02.534505 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8eb6e-9a92-4e9c-955e-fef6ee9b67ab service nova] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:02.561774 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 645/1284] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:30:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:30:04.888645 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c657236-8cf6-4a0c-99cb-4b91715bb3de None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:04.889454 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c657236-8cf6-4a0c-99cb-4b91715bb3de None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:04.889454 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c657236-8cf6-4a0c-99cb-4b91715bb3de None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:04.892308 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 640/1285] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:30:04 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:30:04.899925 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd06cd-e96b-4d11-9d49-42712a38e0ba None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:04.900345 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd06cd-e96b-4d11-9d49-42712a38e0ba None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:04.900540 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd06cd-e96b-4d11-9d49-42712a38e0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:04.925279 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-59cd06cd-e96b-4d11-9d49-42712a38e0ba None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:30:04.926493 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-59cd06cd-e96b-4d11-9d49-42712a38e0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:30:04.935647 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 646/1286] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:30:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:30:04.982624 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c657236-8cf6-4a0c-99cb-4b91715bb3de None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:05.001027 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c657236-8cf6-4a0c-99cb-4b91715bb3de None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:05.006966 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6e725-d3bf-4b1c-985d-9061d105e6e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:05.007617 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6e725-d3bf-4b1c-985d-9061d105e6e4 service nova] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:05.007891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6e725-d3bf-4b1c-985d-9061d105e6e4 service nova] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:05.008217 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6e725-d3bf-4b1c-985d-9061d105e6e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:05.016263 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6e725-d3bf-4b1c-985d-9061d105e6e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:05.017893 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6e725-d3bf-4b1c-985d-9061d105e6e4 service nova] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:05.027295 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 641/1287] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:30:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:30:07.278139 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd9230-cd69-44f7-bfa4-8e3e35e880bb None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:07.278871 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd9230-cd69-44f7-bfa4-8e3e35e880bb None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:07.278871 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd9230-cd69-44f7-bfa4-8e3e35e880bb None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:07.281092 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 647/1288] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:30:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:30:07.288712 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08af274-3af3-4afb-8d4f-b67f50afd529 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:07.289172 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08af274-3af3-4afb-8d4f-b67f50afd529 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:07.289334 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08af274-3af3-4afb-8d4f-b67f50afd529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:07.308777 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-f08af274-3af3-4afb-8d4f-b67f50afd529 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:30:07.309981 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-f08af274-3af3-4afb-8d4f-b67f50afd529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:30:07.318716 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 642/1289] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:30:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:30:07.370854 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd9230-cd69-44f7-bfa4-8e3e35e880bb None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:07.386858 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd9230-cd69-44f7-bfa4-8e3e35e880bb None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:07.393210 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d576237-d8dc-4aa6-bfa7-207116399970 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:07.393914 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d576237-d8dc-4aa6-bfa7-207116399970 service nova] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:07.394203 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d576237-d8dc-4aa6-bfa7-207116399970 service nova] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:07.394486 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d576237-d8dc-4aa6-bfa7-207116399970 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:07.403950 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d576237-d8dc-4aa6-bfa7-207116399970 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:07.405591 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d576237-d8dc-4aa6-bfa7-207116399970 service nova] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:07.415813 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 648/1290] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:30:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:30:09.704993 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab93c34-48cd-49ce-91cf-4940ae592f3c None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:09.705671 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab93c34-48cd-49ce-91cf-4940ae592f3c None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:09.705671 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab93c34-48cd-49ce-91cf-4940ae592f3c None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:09.708121 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 643/1291] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:30:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:30:09.715000 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b356eb-41a3-407f-aacf-1a36fd5804bf None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:09.715472 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b356eb-41a3-407f-aacf-1a36fd5804bf None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:09.715664 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b356eb-41a3-407f-aacf-1a36fd5804bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:09.738572 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-b0b356eb-41a3-407f-aacf-1a36fd5804bf None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:30:09.740065 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-b0b356eb-41a3-407f-aacf-1a36fd5804bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:30:09.751435 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 649/1292] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:30:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:30:09.811437 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab93c34-48cd-49ce-91cf-4940ae592f3c None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:09.827830 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab93c34-48cd-49ce-91cf-4940ae592f3c None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:09.833751 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36269051-dfae-4e78-81d5-506d66d79ba1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:09.834450 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36269051-dfae-4e78-81d5-506d66d79ba1 service nova] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:09.834775 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36269051-dfae-4e78-81d5-506d66d79ba1 service nova] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:09.835061 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36269051-dfae-4e78-81d5-506d66d79ba1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:09.843809 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36269051-dfae-4e78-81d5-506d66d79ba1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:09.845541 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36269051-dfae-4e78-81d5-506d66d79ba1 service nova] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:09.855188 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 644/1293] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:30:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:30:12.179735 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2532961-adc0-45f1-a74d-028975ba651f None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:12.180293 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2532961-adc0-45f1-a74d-028975ba651f None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:12.180428 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2532961-adc0-45f1-a74d-028975ba651f None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:12.186026 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 650/1294] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:30:12 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:30:12.197810 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09998b-8a06-4051-9f96-7b2a27970f2a None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:12.198273 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09998b-8a06-4051-9f96-7b2a27970f2a None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:12.198422 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09998b-8a06-4051-9f96-7b2a27970f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:12.217348 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-bf09998b-8a06-4051-9f96-7b2a27970f2a None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:30:12.218598 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-bf09998b-8a06-4051-9f96-7b2a27970f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:30:12.226748 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 645/1295] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:30:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:30:12.279082 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2532961-adc0-45f1-a74d-028975ba651f None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:12.299404 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2532961-adc0-45f1-a74d-028975ba651f None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:12.307344 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc815b19-0a49-4101-98ac-ff0ff9690127 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:12.308264 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc815b19-0a49-4101-98ac-ff0ff9690127 service nova] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:12.308618 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc815b19-0a49-4101-98ac-ff0ff9690127 service nova] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:12.308887 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc815b19-0a49-4101-98ac-ff0ff9690127 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:12.320759 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc815b19-0a49-4101-98ac-ff0ff9690127 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:12.323257 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc815b19-0a49-4101-98ac-ff0ff9690127 service nova] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:12.336174 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 651/1296] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:30:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:30:14.820560 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f2979-cd42-4ad5-9025-4f2d9cea89d4 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:14.821168 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f2979-cd42-4ad5-9025-4f2d9cea89d4 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:14.821168 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f2979-cd42-4ad5-9025-4f2d9cea89d4 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:14.822963 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 646/1297] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:30:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:30:14.829021 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bbf94-2c48-459a-b66c-2b3dfac108d7 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:14.829484 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bbf94-2c48-459a-b66c-2b3dfac108d7 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:14.829584 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bbf94-2c48-459a-b66c-2b3dfac108d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:14.848399 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-626bbf94-2c48-459a-b66c-2b3dfac108d7 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:30:14.849575 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-626bbf94-2c48-459a-b66c-2b3dfac108d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:30:14.857962 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 652/1298] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:30:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:30:14.905763 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f2979-cd42-4ad5-9025-4f2d9cea89d4 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:14.921005 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f2979-cd42-4ad5-9025-4f2d9cea89d4 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:14.926706 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba127f2-1c37-4154-987d-8b78521b5c97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:14.927372 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba127f2-1c37-4154-987d-8b78521b5c97 service nova] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:14.927646 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba127f2-1c37-4154-987d-8b78521b5c97 service nova] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:14.927913 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba127f2-1c37-4154-987d-8b78521b5c97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:14.936243 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba127f2-1c37-4154-987d-8b78521b5c97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:14.937819 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba127f2-1c37-4154-987d-8b78521b5c97 service nova] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:14.946943 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 647/1299] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:30:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:30:15.711991 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640add02-154c-41cd-8837-46bc4c974f65 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:15.712234 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640add02-154c-41cd-8837-46bc4c974f65 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:15.712499 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640add02-154c-41cd-8837-46bc4c974f65 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:15.714368 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 653/1300] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:30:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:30:15.720611 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf5dcd-0496-43e6-b5b3-08981216242c None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:15.720896 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf5dcd-0496-43e6-b5b3-08981216242c None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:15.721165 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf5dcd-0496-43e6-b5b3-08981216242c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:15.740165 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-f2cf5dcd-0496-43e6-b5b3-08981216242c None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:30:15.741365 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-f2cf5dcd-0496-43e6-b5b3-08981216242c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:30:15.750377 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 648/1301] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:30:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:30:15.808686 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907c7b1-4cb4-4c2a-9f38-bb812f81202e None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:15.808971 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907c7b1-4cb4-4c2a-9f38-bb812f81202e None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:15.809240 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907c7b1-4cb4-4c2a-9f38-bb812f81202e None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:15.811078 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 654/1302] 10.222.0.79 () {54 vars in 962 bytes} [Thu Oct 28 14:30:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:30:15.816877 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee7f4c-3a19-4f17-9817-76c141f248b1 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:15.817185 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee7f4c-3a19-4f17-9817-76c141f248b1 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:15.817453 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee7f4c-3a19-4f17-9817-76c141f248b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:15.867586 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-b0ee7f4c-3a19-4f17-9817-76c141f248b1 None None] MFA Rules not processed for user `73a98d6cf23e4710bfbf71b960f81a9e`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:30:15.868768 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-b0ee7f4c-3a19-4f17-9817-76c141f248b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:30:15.929482 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 649/1303] 10.222.0.79 () {58 vars in 1059 bytes} [Thu Oct 28 14:30:15 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:30:15.937904 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907c7b1-4cb4-4c2a-9f38-bb812f81202e None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:15.949104 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907c7b1-4cb4-4c2a-9f38-bb812f81202e None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:15.953151 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b13ef-50a2-4908-a2ec-284b4c91e169 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a98d6cf23e4710bfbf71b960f81a9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:15.953784 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b13ef-50a2-4908-a2ec-284b4c91e169 service glance] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:15.954059 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b13ef-50a2-4908-a2ec-284b4c91e169 service glance] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:15.954325 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b13ef-50a2-4908-a2ec-284b4c91e169 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:15.963563 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b13ef-50a2-4908-a2ec-284b4c91e169 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:15.964942 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b13ef-50a2-4908-a2ec-284b4c91e169 service glance] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:15.974010 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 655/1304] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:30:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:30:16.407808 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55135f28-a65b-44d4-b332-72e9af831575 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:16.408106 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55135f28-a65b-44d4-b332-72e9af831575 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:16.408370 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55135f28-a65b-44d4-b332-72e9af831575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:16.458218 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-55135f28-a65b-44d4-b332-72e9af831575 None None] MFA Rules not processed for user `62cc0165aee14b449c8a49233001f631`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:30:16.459441 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-55135f28-a65b-44d4-b332-72e9af831575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:30:16.526338 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 650/1305] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Oct 28 14:30:16 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:30:16.574628 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bcad3-026f-411f-82ad-139a59dea06e None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:16.574957 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bcad3-026f-411f-82ad-139a59dea06e None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:16.575163 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bcad3-026f-411f-82ad-139a59dea06e None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:16.576964 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 656/1306] 10.222.0.79 () {54 vars in 942 bytes} [Thu Oct 28 14:30:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:30:16.583552 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f1b49-15e1-4fca-b382-414744671b6b None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:16.583926 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f1b49-15e1-4fca-b382-414744671b6b None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:16.584267 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f1b49-15e1-4fca-b382-414744671b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:16.634904 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-584f1b49-15e1-4fca-b382-414744671b6b None None] MFA Rules not processed for user `889e7be1dcaf47f599af9c9b7ad33042`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:30:16.636119 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-584f1b49-15e1-4fca-b382-414744671b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:30:16.707893 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 651/1307] 10.222.0.79 () {58 vars in 1039 bytes} [Thu Oct 28 14:30:16 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:30:16.717522 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bcad3-026f-411f-82ad-139a59dea06e None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:16.731102 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bcad3-026f-411f-82ad-139a59dea06e None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:16.736245 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f249c-4b16-4100-9871-8e3e71d28f3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889e7be1dcaf47f599af9c9b7ad33042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:16.736850 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f249c-4b16-4100-9871-8e3e71d28f3c service swift] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:16.737123 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f249c-4b16-4100-9871-8e3e71d28f3c service swift] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:16.737393 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f249c-4b16-4100-9871-8e3e71d28f3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:16.746051 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f249c-4b16-4100-9871-8e3e71d28f3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:16.747739 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f249c-4b16-4100-9871-8e3e71d28f3c service swift] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:16.755808 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 657/1308] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Oct 28 14:30:16 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 14:30:17.228103 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deae3fc-3fdc-49d3-b004-430be1a658fc None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:17.228697 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deae3fc-3fdc-49d3-b004-430be1a658fc None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:17.228697 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deae3fc-3fdc-49d3-b004-430be1a658fc None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:17.230579 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 652/1309] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:30:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:30:17.236755 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78d3db-cc50-4c36-a8de-c799e3ee1111 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:17.237181 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78d3db-cc50-4c36-a8de-c799e3ee1111 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:17.237432 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78d3db-cc50-4c36-a8de-c799e3ee1111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:17.255817 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-3f78d3db-cc50-4c36-a8de-c799e3ee1111 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:30:17.257345 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-3f78d3db-cc50-4c36-a8de-c799e3ee1111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:30:17.265712 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 658/1310] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:30:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:30:17.312620 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deae3fc-3fdc-49d3-b004-430be1a658fc None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:17.331171 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deae3fc-3fdc-49d3-b004-430be1a658fc None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:17.336706 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ab9f6-fa49-494c-9d27-66e0cc84a1ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:17.337373 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ab9f6-fa49-494c-9d27-66e0cc84a1ed service nova] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:17.337634 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ab9f6-fa49-494c-9d27-66e0cc84a1ed service nova] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:17.337916 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ab9f6-fa49-494c-9d27-66e0cc84a1ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:17.349261 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ab9f6-fa49-494c-9d27-66e0cc84a1ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:17.352198 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ab9f6-fa49-494c-9d27-66e0cc84a1ed service nova] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:17.361931 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 653/1311] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:30:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:30:33.805154 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08c803-6484-422b-a932-fcddf1ad85df None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:33.805775 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08c803-6484-422b-a932-fcddf1ad85df None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:33.805775 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08c803-6484-422b-a932-fcddf1ad85df None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:33.807757 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 659/1312] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:30:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:30:33.814387 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de69bca-ada8-464f-b567-d39f4e8bf24c None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:33.814845 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de69bca-ada8-464f-b567-d39f4e8bf24c None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:33.814953 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de69bca-ada8-464f-b567-d39f4e8bf24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:33.834840 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-2de69bca-ada8-464f-b567-d39f4e8bf24c None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:30:33.836033 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-2de69bca-ada8-464f-b567-d39f4e8bf24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:30:33.844902 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 654/1313] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:30:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:30:33.869455 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08c803-6484-422b-a932-fcddf1ad85df None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:33.883706 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08c803-6484-422b-a932-fcddf1ad85df None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:33.888969 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4512009-dee6-46c8-b96e-b0a7e0cb938b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:33.889625 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4512009-dee6-46c8-b96e-b0a7e0cb938b admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:33.889903 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4512009-dee6-46c8-b96e-b0a7e0cb938b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:33.890179 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4512009-dee6-46c8-b96e-b0a7e0cb938b admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:33.890953 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4512009-dee6-46c8-b96e-b0a7e0cb938b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:33.892808 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4512009-dee6-46c8-b96e-b0a7e0cb938b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:33.907287 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 660/1314] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Oct 28 14:30:33 2021] GET /identity/v3/projects => generated 2553 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:30:36.111423 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df0cd8-ba1a-4a59-9562-a01579d411d2 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:36.112340 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df0cd8-ba1a-4a59-9562-a01579d411d2 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:36.112340 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df0cd8-ba1a-4a59-9562-a01579d411d2 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:36.115297 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 655/1315] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:30:36 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:30:36.121861 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2110d4-b8e0-4db1-809a-851b268a6d7f None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:36.122341 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2110d4-b8e0-4db1-809a-851b268a6d7f None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:36.122459 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2110d4-b8e0-4db1-809a-851b268a6d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:36.143806 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-0e2110d4-b8e0-4db1-809a-851b268a6d7f None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:30:36.145025 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-0e2110d4-b8e0-4db1-809a-851b268a6d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:30:36.153444 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 661/1316] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:30:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:30:36.178364 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df0cd8-ba1a-4a59-9562-a01579d411d2 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:36.199034 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df0cd8-ba1a-4a59-9562-a01579d411d2 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:36.204470 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a852a8-2bc9-416c-88d8-278c70ae3230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:36.205325 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a852a8-2bc9-416c-88d8-278c70ae3230 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:36.205597 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a852a8-2bc9-416c-88d8-278c70ae3230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:36.205864 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a852a8-2bc9-416c-88d8-278c70ae3230 admin admin] PATH_INFO: `/v3/projects/5205feeae8054c9facedbfd314ab1248` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:36.216501 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a852a8-2bc9-416c-88d8-278c70ae3230 admin admin] RBAC: Authorizing `identity:get_project(project_id=5205feeae8054c9facedbfd314ab1248)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:36.218561 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a852a8-2bc9-416c-88d8-278c70ae3230 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:36.220290 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 656/1317] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:30:36 2021] GET /identity/v3/projects/5205feeae8054c9facedbfd314ab1248 => generated 361 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:30:36.226857 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2110d4-b8e0-4db1-809a-851b268a6d7f None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:36.236150 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2110d4-b8e0-4db1-809a-851b268a6d7f None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:36.241213 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02fcb4-28c1-403a-aca6-1af34e2fcd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:36.241853 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02fcb4-28c1-403a-aca6-1af34e2fcd3f admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:36.242128 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02fcb4-28c1-403a-aca6-1af34e2fcd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:36.242402 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02fcb4-28c1-403a-aca6-1af34e2fcd3f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:36.243223 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02fcb4-28c1-403a-aca6-1af34e2fcd3f admin admin] RBAC: Adding query filter params (scope.project.id=5205feeae8054c9facedbfd314ab1248) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:30:36.243517 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02fcb4-28c1-403a-aca6-1af34e2fcd3f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:36.245327 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02fcb4-28c1-403a-aca6-1af34e2fcd3f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:36.251963 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 662/1318] 10.222.0.79 () {56 vars in 1231 bytes} [Thu Oct 28 14:30:36 2021] GET /identity/v3/role_assignments?scope.project.id=5205feeae8054c9facedbfd314ab1248 => generated 526 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:30:36.258337 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a852a8-2bc9-416c-88d8-278c70ae3230 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:36.269140 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a852a8-2bc9-416c-88d8-278c70ae3230 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:36.274103 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed449b-bd25-4b33-92ad-8ad59cfae3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:36.274991 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed449b-bd25-4b33-92ad-8ad59cfae3ab admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:36.275264 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed449b-bd25-4b33-92ad-8ad59cfae3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:36.275523 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed449b-bd25-4b33-92ad-8ad59cfae3ab admin admin] PATH_INFO: `/v3/users/dce34e6e6eba47e88b70fb1dceab3dbf` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:36.290884 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed449b-bd25-4b33-92ad-8ad59cfae3ab admin admin] RBAC: Authorizing `identity:get_user(user_id=dce34e6e6eba47e88b70fb1dceab3dbf)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:36.293415 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed449b-bd25-4b33-92ad-8ad59cfae3ab admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:36.295078 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 657/1319] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:30:36 2021] GET /identity/v3/users/dce34e6e6eba47e88b70fb1dceab3dbf => generated 311 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:30:38.536620 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12300f32-da84-4017-bcb9-b8076c30c2aa None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:38.537201 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12300f32-da84-4017-bcb9-b8076c30c2aa None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:38.537201 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12300f32-da84-4017-bcb9-b8076c30c2aa None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:38.538975 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 663/1320] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:30:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:30:38.546364 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a9130-0e78-446c-a4b9-0817a78152d5 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:38.546828 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a9130-0e78-446c-a4b9-0817a78152d5 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:38.546933 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a9130-0e78-446c-a4b9-0817a78152d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:38.573775 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-026a9130-0e78-446c-a4b9-0817a78152d5 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:30:38.575021 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-026a9130-0e78-446c-a4b9-0817a78152d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:30:38.583788 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 658/1321] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:30:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:30:38.607608 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12300f32-da84-4017-bcb9-b8076c30c2aa None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:38.622836 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12300f32-da84-4017-bcb9-b8076c30c2aa None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:38.628915 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905da66-bc87-47ae-8acb-53a33e0e364f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:38.629766 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905da66-bc87-47ae-8acb-53a33e0e364f admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:38.630046 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905da66-bc87-47ae-8acb-53a33e0e364f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:38.630309 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905da66-bc87-47ae-8acb-53a33e0e364f admin admin] PATH_INFO: `/v3/projects/5e1386d4324444cb827c395a1115a38e` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:38.641717 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905da66-bc87-47ae-8acb-53a33e0e364f admin admin] RBAC: Authorizing `identity:get_project(project_id=5e1386d4324444cb827c395a1115a38e)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:38.643789 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905da66-bc87-47ae-8acb-53a33e0e364f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:38.645453 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 664/1322] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:30:38 2021] GET /identity/v3/projects/5e1386d4324444cb827c395a1115a38e => generated 312 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:30:38.652131 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a9130-0e78-446c-a4b9-0817a78152d5 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:38.661705 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a9130-0e78-446c-a4b9-0817a78152d5 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:38.668048 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a8493-ce2c-4255-9481-68ed379843df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:38.668710 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a8493-ce2c-4255-9481-68ed379843df admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:38.669007 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a8493-ce2c-4255-9481-68ed379843df admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:38.669279 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a8493-ce2c-4255-9481-68ed379843df admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:38.670039 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a8493-ce2c-4255-9481-68ed379843df admin admin] RBAC: Adding query filter params (scope.project.id=5e1386d4324444cb827c395a1115a38e) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:30:38.670342 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a8493-ce2c-4255-9481-68ed379843df admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:38.672274 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a8493-ce2c-4255-9481-68ed379843df admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:38.679551 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 659/1323] 10.222.0.79 () {56 vars in 1231 bytes} [Thu Oct 28 14:30:38 2021] GET /identity/v3/role_assignments?scope.project.id=5e1386d4324444cb827c395a1115a38e => generated 526 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:30:38.686891 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905da66-bc87-47ae-8acb-53a33e0e364f admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:38.701380 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905da66-bc87-47ae-8acb-53a33e0e364f admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:38.707231 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045845a-4f7c-4f97-9779-fa38da629ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:38.708094 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045845a-4f7c-4f97-9779-fa38da629ded admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:38.708365 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045845a-4f7c-4f97-9779-fa38da629ded admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:38.708629 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045845a-4f7c-4f97-9779-fa38da629ded admin admin] PATH_INFO: `/v3/users/1ae941093e1c476bb4677c74721b18ab` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:38.723706 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045845a-4f7c-4f97-9779-fa38da629ded admin admin] RBAC: Authorizing `identity:get_user(user_id=1ae941093e1c476bb4677c74721b18ab)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:38.725829 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045845a-4f7c-4f97-9779-fa38da629ded admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:38.727470 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 665/1324] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:30:38 2021] GET /identity/v3/users/1ae941093e1c476bb4677c74721b18ab => generated 275 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:30:40.988881 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75da8d-28b3-44cd-993a-3d80e793632f None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:40.989764 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75da8d-28b3-44cd-993a-3d80e793632f None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:40.989764 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75da8d-28b3-44cd-993a-3d80e793632f None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:40.992692 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 660/1325] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:30:40 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:30:40.998982 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c947e8e-7fb3-451f-be82-a7d414eeabba None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:40.999421 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c947e8e-7fb3-451f-be82-a7d414eeabba None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:40.999538 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c947e8e-7fb3-451f-be82-a7d414eeabba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:41.017947 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-1c947e8e-7fb3-451f-be82-a7d414eeabba None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:30:41.019426 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-1c947e8e-7fb3-451f-be82-a7d414eeabba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:30:41.028354 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 666/1326] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:30:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:30:41.052781 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75da8d-28b3-44cd-993a-3d80e793632f None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:41.072731 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75da8d-28b3-44cd-993a-3d80e793632f None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:41.081175 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e5f22-63c2-4f13-b203-f605004eafdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:41.082406 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e5f22-63c2-4f13-b203-f605004eafdb admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:41.082747 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e5f22-63c2-4f13-b203-f605004eafdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:41.083213 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e5f22-63c2-4f13-b203-f605004eafdb admin admin] PATH_INFO: `/v3/projects/7760de20f300416cbabf0f95c42b2e83` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:41.085396 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e5f22-63c2-4f13-b203-f605004eafdb admin admin] RBAC: Authorizing `identity:get_project(project_id=7760de20f300416cbabf0f95c42b2e83)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:41.087875 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e5f22-63c2-4f13-b203-f605004eafdb admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:41.089574 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 661/1327] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:30:41 2021] GET /identity/v3/projects/7760de20f300416cbabf0f95c42b2e83 => generated 344 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:30:41.096381 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c947e8e-7fb3-451f-be82-a7d414eeabba None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:41.106563 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c947e8e-7fb3-451f-be82-a7d414eeabba None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:41.112380 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3d81b-a10e-4dda-a09b-a51ffe861d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:41.113012 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3d81b-a10e-4dda-a09b-a51ffe861d4c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:41.113286 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3d81b-a10e-4dda-a09b-a51ffe861d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:41.113550 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3d81b-a10e-4dda-a09b-a51ffe861d4c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:41.114326 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3d81b-a10e-4dda-a09b-a51ffe861d4c admin admin] RBAC: Adding query filter params (scope.project.id=7760de20f300416cbabf0f95c42b2e83) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:30:41.114621 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3d81b-a10e-4dda-a09b-a51ffe861d4c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:41.116490 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3d81b-a10e-4dda-a09b-a51ffe861d4c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:41.122769 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 667/1328] 10.222.0.79 () {56 vars in 1231 bytes} [Thu Oct 28 14:30:41 2021] GET /identity/v3/role_assignments?scope.project.id=7760de20f300416cbabf0f95c42b2e83 => generated 879 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:30:41.129274 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e5f22-63c2-4f13-b203-f605004eafdb admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:41.139739 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e5f22-63c2-4f13-b203-f605004eafdb admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:41.145492 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462ca00-2e13-4a87-b134-81e77481078f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:41.146347 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462ca00-2e13-4a87-b134-81e77481078f admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:41.146626 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462ca00-2e13-4a87-b134-81e77481078f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:41.146939 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462ca00-2e13-4a87-b134-81e77481078f admin admin] PATH_INFO: `/v3/users/04a56319092f4998a9d4cfc7569eb00c` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:41.148194 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462ca00-2e13-4a87-b134-81e77481078f admin admin] RBAC: Authorizing `identity:get_user(user_id=04a56319092f4998a9d4cfc7569eb00c)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:41.150210 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462ca00-2e13-4a87-b134-81e77481078f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:41.151895 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 662/1329] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:30:41 2021] GET /identity/v3/users/04a56319092f4998a9d4cfc7569eb00c => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:30:43.412358 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5821341-0fe8-46d3-b2ab-a3925445524c None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:43.412936 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5821341-0fe8-46d3-b2ab-a3925445524c None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:43.412936 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5821341-0fe8-46d3-b2ab-a3925445524c None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:43.414747 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 668/1330] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:30:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:30:43.421124 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a9f86-0277-4a98-b29d-32d9e3177a6b None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:43.421589 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a9f86-0277-4a98-b29d-32d9e3177a6b None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:43.421692 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a9f86-0277-4a98-b29d-32d9e3177a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:43.441136 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-3e2a9f86-0277-4a98-b29d-32d9e3177a6b None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:30:43.442324 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-3e2a9f86-0277-4a98-b29d-32d9e3177a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:30:43.450822 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 663/1331] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:30:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:30:43.474579 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5821341-0fe8-46d3-b2ab-a3925445524c None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:43.488220 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5821341-0fe8-46d3-b2ab-a3925445524c None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:43.494064 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115e47b-8f43-4632-b035-ec0e8429824c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:43.494960 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115e47b-8f43-4632-b035-ec0e8429824c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:43.495234 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115e47b-8f43-4632-b035-ec0e8429824c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:43.495498 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115e47b-8f43-4632-b035-ec0e8429824c admin admin] PATH_INFO: `/v3/projects/827891427e6b4c02918b6c82992d0bbb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:43.508558 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115e47b-8f43-4632-b035-ec0e8429824c admin admin] RBAC: Authorizing `identity:get_project(project_id=827891427e6b4c02918b6c82992d0bbb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:43.511780 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115e47b-8f43-4632-b035-ec0e8429824c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:43.514433 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 669/1332] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:30:43 2021] GET /identity/v3/projects/827891427e6b4c02918b6c82992d0bbb => generated 302 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:30:43.521573 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a9f86-0277-4a98-b29d-32d9e3177a6b None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:43.532251 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a9f86-0277-4a98-b29d-32d9e3177a6b None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:43.538149 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af36259-161a-4834-907f-038a16be9a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:43.538832 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af36259-161a-4834-907f-038a16be9a45 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:43.539110 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af36259-161a-4834-907f-038a16be9a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:43.539385 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af36259-161a-4834-907f-038a16be9a45 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:43.540148 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af36259-161a-4834-907f-038a16be9a45 admin admin] RBAC: Adding query filter params (scope.project.id=827891427e6b4c02918b6c82992d0bbb) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:30:43.540594 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af36259-161a-4834-907f-038a16be9a45 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:43.543181 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af36259-161a-4834-907f-038a16be9a45 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:43.550136 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 664/1333] 10.222.0.79 () {56 vars in 1231 bytes} [Thu Oct 28 14:30:43 2021] GET /identity/v3/role_assignments?scope.project.id=827891427e6b4c02918b6c82992d0bbb => generated 1934 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:30:43.558641 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115e47b-8f43-4632-b035-ec0e8429824c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:43.570720 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115e47b-8f43-4632-b035-ec0e8429824c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:43.576706 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee98736-24e7-49f2-b52a-c1e4feb1ef89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:43.577758 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee98736-24e7-49f2-b52a-c1e4feb1ef89 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:43.578036 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee98736-24e7-49f2-b52a-c1e4feb1ef89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:43.578305 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee98736-24e7-49f2-b52a-c1e4feb1ef89 admin admin] PATH_INFO: `/v3/users/04a56319092f4998a9d4cfc7569eb00c` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:43.579697 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee98736-24e7-49f2-b52a-c1e4feb1ef89 admin admin] RBAC: Authorizing `identity:get_user(user_id=04a56319092f4998a9d4cfc7569eb00c)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:43.581499 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee98736-24e7-49f2-b52a-c1e4feb1ef89 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:43.583148 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 670/1334] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:30:43 2021] GET /identity/v3/users/04a56319092f4998a9d4cfc7569eb00c => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:30:43.589631 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af36259-161a-4834-907f-038a16be9a45 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:43.599470 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af36259-161a-4834-907f-038a16be9a45 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:43.605849 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6f339-8260-4c76-8036-d36b91003e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:43.607157 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6f339-8260-4c76-8036-d36b91003e2f admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:43.607500 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6f339-8260-4c76-8036-d36b91003e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:43.607790 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6f339-8260-4c76-8036-d36b91003e2f admin admin] PATH_INFO: `/v3/users/c926f34dc68845d0b756bbde4b6f9d46` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:43.630385 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6f339-8260-4c76-8036-d36b91003e2f admin admin] RBAC: Authorizing `identity:get_user(user_id=c926f34dc68845d0b756bbde4b6f9d46)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:43.633920 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6f339-8260-4c76-8036-d36b91003e2f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:43.635614 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 665/1335] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:30:43 2021] GET /identity/v3/users/c926f34dc68845d0b756bbde4b6f9d46 => generated 283 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:30:45.984621 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202fda7-7bab-49f6-aa06-019f6741c36d None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:45.985473 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202fda7-7bab-49f6-aa06-019f6741c36d None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:45.985473 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202fda7-7bab-49f6-aa06-019f6741c36d None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:45.988371 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 671/1336] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:30:45 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:30:45.995504 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98f3fe-fd9a-4f3a-b951-f95318dac172 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:45.996259 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98f3fe-fd9a-4f3a-b951-f95318dac172 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:45.996394 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98f3fe-fd9a-4f3a-b951-f95318dac172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:46.019761 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-bf98f3fe-fd9a-4f3a-b951-f95318dac172 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:30:46.020972 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-bf98f3fe-fd9a-4f3a-b951-f95318dac172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:30:46.030321 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 666/1337] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:30:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:30:46.059604 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202fda7-7bab-49f6-aa06-019f6741c36d None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:46.073735 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202fda7-7bab-49f6-aa06-019f6741c36d None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:46.079470 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ba2a7-843e-4b99-802c-b2acf3ac407f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:46.080347 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ba2a7-843e-4b99-802c-b2acf3ac407f admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:46.080626 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ba2a7-843e-4b99-802c-b2acf3ac407f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:46.080895 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ba2a7-843e-4b99-802c-b2acf3ac407f admin admin] PATH_INFO: `/v3/projects/89d93f57c0064a11934e16c4d4eee581` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:46.094722 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ba2a7-843e-4b99-802c-b2acf3ac407f admin admin] RBAC: Authorizing `identity:get_project(project_id=89d93f57c0064a11934e16c4d4eee581)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:46.097831 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ba2a7-843e-4b99-802c-b2acf3ac407f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:46.100105 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 672/1338] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:30:46 2021] GET /identity/v3/projects/89d93f57c0064a11934e16c4d4eee581 => generated 311 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:30:46.107627 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98f3fe-fd9a-4f3a-b951-f95318dac172 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:46.117044 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98f3fe-fd9a-4f3a-b951-f95318dac172 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:46.122890 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67834712-3ae8-4e36-ae26-ec9f6e5f9e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:46.123532 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67834712-3ae8-4e36-ae26-ec9f6e5f9e60 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:46.123803 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67834712-3ae8-4e36-ae26-ec9f6e5f9e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:46.124069 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67834712-3ae8-4e36-ae26-ec9f6e5f9e60 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:46.124841 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67834712-3ae8-4e36-ae26-ec9f6e5f9e60 admin admin] RBAC: Adding query filter params (scope.project.id=89d93f57c0064a11934e16c4d4eee581) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:30:46.125138 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67834712-3ae8-4e36-ae26-ec9f6e5f9e60 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:46.127008 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67834712-3ae8-4e36-ae26-ec9f6e5f9e60 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:46.133136 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 667/1339] 10.222.0.79 () {56 vars in 1231 bytes} [Thu Oct 28 14:30:46 2021] GET /identity/v3/role_assignments?scope.project.id=89d93f57c0064a11934e16c4d4eee581 => generated 877 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:30:46.139584 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ba2a7-843e-4b99-802c-b2acf3ac407f admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:46.149741 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ba2a7-843e-4b99-802c-b2acf3ac407f admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:46.155527 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284fb9cf-0b57-46ee-9b94-508333d475f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:46.156313 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fb9cf-0b57-46ee-9b94-508333d475f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:46.156586 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fb9cf-0b57-46ee-9b94-508333d475f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:46.156828 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fb9cf-0b57-46ee-9b94-508333d475f5 admin admin] PATH_INFO: `/v3/users/46e92527362443fda56a0f53259813d1` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:46.176159 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284fb9cf-0b57-46ee-9b94-508333d475f5 admin admin] RBAC: Authorizing `identity:get_user(user_id=46e92527362443fda56a0f53259813d1)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:46.179086 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284fb9cf-0b57-46ee-9b94-508333d475f5 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:46.181807 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 673/1340] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:30:46 2021] GET /identity/v3/users/46e92527362443fda56a0f53259813d1 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:30:46.188954 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67834712-3ae8-4e36-ae26-ec9f6e5f9e60 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:46.202050 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67834712-3ae8-4e36-ae26-ec9f6e5f9e60 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:46.207950 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6bdad0-451c-4373-99b5-ca357cb231cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:46.208803 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bdad0-451c-4373-99b5-ca357cb231cb admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:46.209079 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bdad0-451c-4373-99b5-ca357cb231cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:46.209349 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bdad0-451c-4373-99b5-ca357cb231cb admin admin] PATH_INFO: `/v3/users/dadd8ecbfb0b4a7ebdca6fc3e0c989b1` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:46.224288 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6bdad0-451c-4373-99b5-ca357cb231cb admin admin] RBAC: Authorizing `identity:get_user(user_id=dadd8ecbfb0b4a7ebdca6fc3e0c989b1)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:46.226422 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6bdad0-451c-4373-99b5-ca357cb231cb admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:46.228180 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 668/1341] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:30:46 2021] GET /identity/v3/users/dadd8ecbfb0b4a7ebdca6fc3e0c989b1 => generated 285 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:30:48.689946 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5cd43-ad66-459d-9bca-2ff6dfb842c7 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:48.690552 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5cd43-ad66-459d-9bca-2ff6dfb842c7 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:48.690552 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5cd43-ad66-459d-9bca-2ff6dfb842c7 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:48.692296 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 674/1342] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:30:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:30:48.699444 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980ad80-9e3c-41ce-bf9b-849aa5e2fd04 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:48.700156 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980ad80-9e3c-41ce-bf9b-849aa5e2fd04 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:48.700324 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980ad80-9e3c-41ce-bf9b-849aa5e2fd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:48.722721 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-f980ad80-9e3c-41ce-bf9b-849aa5e2fd04 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:30:48.723927 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-f980ad80-9e3c-41ce-bf9b-849aa5e2fd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:30:48.732747 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 669/1343] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:30:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:30:48.756215 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5cd43-ad66-459d-9bca-2ff6dfb842c7 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:48.770825 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5cd43-ad66-459d-9bca-2ff6dfb842c7 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:48.777176 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c65e26-35fb-4b32-b3f5-a25ded815652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:48.778031 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c65e26-35fb-4b32-b3f5-a25ded815652 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:48.778307 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c65e26-35fb-4b32-b3f5-a25ded815652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:48.778545 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c65e26-35fb-4b32-b3f5-a25ded815652 admin admin] PATH_INFO: `/v3/projects/c0fc8be7ace747daba1f61a78ad61736` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:48.793874 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c65e26-35fb-4b32-b3f5-a25ded815652 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0fc8be7ace747daba1f61a78ad61736)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:48.796290 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c65e26-35fb-4b32-b3f5-a25ded815652 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:48.798111 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 675/1344] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:30:48 2021] GET /identity/v3/projects/c0fc8be7ace747daba1f61a78ad61736 => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:30:48.805903 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980ad80-9e3c-41ce-bf9b-849aa5e2fd04 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:48.816206 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980ad80-9e3c-41ce-bf9b-849aa5e2fd04 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:48.821918 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7f41f-f6cd-4753-8c9b-e75d4d6053eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:48.822585 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7f41f-f6cd-4753-8c9b-e75d4d6053eb admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:48.822885 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7f41f-f6cd-4753-8c9b-e75d4d6053eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:48.823158 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7f41f-f6cd-4753-8c9b-e75d4d6053eb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:48.823945 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7f41f-f6cd-4753-8c9b-e75d4d6053eb admin admin] RBAC: Adding query filter params (scope.project.id=c0fc8be7ace747daba1f61a78ad61736) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:30:48.824243 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7f41f-f6cd-4753-8c9b-e75d4d6053eb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:48.826205 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7f41f-f6cd-4753-8c9b-e75d4d6053eb admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:48.833393 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 670/1345] 10.222.0.79 () {56 vars in 1231 bytes} [Thu Oct 28 14:30:48 2021] GET /identity/v3/role_assignments?scope.project.id=c0fc8be7ace747daba1f61a78ad61736 => generated 1934 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:30:48.840304 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c65e26-35fb-4b32-b3f5-a25ded815652 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:48.850387 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c65e26-35fb-4b32-b3f5-a25ded815652 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:48.855706 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01bdc6-e680-4226-a839-bcafa56072a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:48.856596 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01bdc6-e680-4226-a839-bcafa56072a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:48.856867 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01bdc6-e680-4226-a839-bcafa56072a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:48.857138 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01bdc6-e680-4226-a839-bcafa56072a2 admin admin] PATH_INFO: `/v3/users/1ae941093e1c476bb4677c74721b18ab` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:48.858362 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01bdc6-e680-4226-a839-bcafa56072a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=1ae941093e1c476bb4677c74721b18ab)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:48.860474 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01bdc6-e680-4226-a839-bcafa56072a2 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:48.862007 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 676/1346] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:30:48 2021] GET /identity/v3/users/1ae941093e1c476bb4677c74721b18ab => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:30:48.868165 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7f41f-f6cd-4753-8c9b-e75d4d6053eb admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:48.878303 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7f41f-f6cd-4753-8c9b-e75d4d6053eb admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:48.884030 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9897d6-5c68-4659-9b91-753a26d5df9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:48.884871 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9897d6-5c68-4659-9b91-753a26d5df9a admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:48.885140 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9897d6-5c68-4659-9b91-753a26d5df9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:48.885407 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9897d6-5c68-4659-9b91-753a26d5df9a admin admin] PATH_INFO: `/v3/users/04a56319092f4998a9d4cfc7569eb00c` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:48.886714 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9897d6-5c68-4659-9b91-753a26d5df9a admin admin] RBAC: Authorizing `identity:get_user(user_id=04a56319092f4998a9d4cfc7569eb00c)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:48.888539 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9897d6-5c68-4659-9b91-753a26d5df9a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:48.890146 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 671/1347] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:30:48 2021] GET /identity/v3/users/04a56319092f4998a9d4cfc7569eb00c => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:30:51.207636 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59566e49-b7df-4ce9-8dfc-046495905bc1 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:51.208185 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59566e49-b7df-4ce9-8dfc-046495905bc1 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:51.208185 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59566e49-b7df-4ce9-8dfc-046495905bc1 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:51.210061 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 677/1348] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:30:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:30:51.216250 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a2265-1daa-4847-ab79-9dfc5224a3f9 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:51.216680 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a2265-1daa-4847-ab79-9dfc5224a3f9 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:51.216782 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a2265-1daa-4847-ab79-9dfc5224a3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:51.238710 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-124a2265-1daa-4847-ab79-9dfc5224a3f9 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:30:51.239933 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-124a2265-1daa-4847-ab79-9dfc5224a3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:30:51.249821 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 672/1349] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:30:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:30:51.273974 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59566e49-b7df-4ce9-8dfc-046495905bc1 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:51.288446 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59566e49-b7df-4ce9-8dfc-046495905bc1 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:51.294151 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdafbbe-430e-461e-9a1d-09cf64175111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:51.295024 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdafbbe-430e-461e-9a1d-09cf64175111 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:51.295300 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdafbbe-430e-461e-9a1d-09cf64175111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:51.295565 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdafbbe-430e-461e-9a1d-09cf64175111 admin admin] PATH_INFO: `/v3/projects/e297121334bb408f923eb48a2aa9f230` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:51.307422 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdafbbe-430e-461e-9a1d-09cf64175111 admin admin] RBAC: Authorizing `identity:get_project(project_id=e297121334bb408f923eb48a2aa9f230)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:51.309500 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdafbbe-430e-461e-9a1d-09cf64175111 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:51.311231 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 678/1350] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Oct 28 14:30:51 2021] GET /identity/v3/projects/e297121334bb408f923eb48a2aa9f230 => generated 311 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:30:51.317901 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a2265-1daa-4847-ab79-9dfc5224a3f9 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:51.327435 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a2265-1daa-4847-ab79-9dfc5224a3f9 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:51.332968 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf8bad-0fc4-4535-aa23-7d155a0ebd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:51.333609 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf8bad-0fc4-4535-aa23-7d155a0ebd42 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:51.333881 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf8bad-0fc4-4535-aa23-7d155a0ebd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:51.334144 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf8bad-0fc4-4535-aa23-7d155a0ebd42 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:51.334957 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf8bad-0fc4-4535-aa23-7d155a0ebd42 admin admin] RBAC: Adding query filter params (scope.project.id=e297121334bb408f923eb48a2aa9f230) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:30:51.335253 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf8bad-0fc4-4535-aa23-7d155a0ebd42 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:51.337099 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf8bad-0fc4-4535-aa23-7d155a0ebd42 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:51.342704 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 673/1351] 10.222.0.79 () {56 vars in 1231 bytes} [Thu Oct 28 14:30:51 2021] GET /identity/v3/role_assignments?scope.project.id=e297121334bb408f923eb48a2aa9f230 => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:30:51.348888 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdafbbe-430e-461e-9a1d-09cf64175111 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:51.358718 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdafbbe-430e-461e-9a1d-09cf64175111 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:51.363735 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb42ea-1ff8-4dfd-ad09-781e8074be83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:51.364574 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb42ea-1ff8-4dfd-ad09-781e8074be83 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:51.364843 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb42ea-1ff8-4dfd-ad09-781e8074be83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:51.365107 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb42ea-1ff8-4dfd-ad09-781e8074be83 admin admin] PATH_INFO: `/v3/users/eaffa85288f148eb9290b7d1f03d54fa` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:51.380754 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb42ea-1ff8-4dfd-ad09-781e8074be83 admin admin] RBAC: Authorizing `identity:get_user(user_id=eaffa85288f148eb9290b7d1f03d54fa)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:51.382879 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb42ea-1ff8-4dfd-ad09-781e8074be83 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:51.384553 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 679/1352] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Oct 28 14:30:51 2021] GET /identity/v3/users/eaffa85288f148eb9290b7d1f03d54fa => generated 286 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:30:56.676497 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262129d9-a2d4-4933-bba3-90e8951d9ea8 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:56.677106 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262129d9-a2d4-4933-bba3-90e8951d9ea8 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:56.677106 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262129d9-a2d4-4933-bba3-90e8951d9ea8 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:56.678850 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 674/1353] 10.222.0.79 () {54 vars in 918 bytes} [Thu Oct 28 14:30:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:30:56.685738 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7c716-6e67-467d-922c-dfc2c4960369 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:56.686192 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7c716-6e67-467d-922c-dfc2c4960369 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:56.686294 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7c716-6e67-467d-922c-dfc2c4960369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:56.704984 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-ecb7c716-6e67-467d-922c-dfc2c4960369 None None] MFA Rules not processed for user `8bf32a6fafb7458788a47e4774cb7bc8`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:30:56.706209 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-ecb7c716-6e67-467d-922c-dfc2c4960369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:30:56.715766 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 680/1354] 10.222.0.79 () {58 vars in 1015 bytes} [Thu Oct 28 14:30:56 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:30:56.737894 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f905913-cd51-4f63-8782-116d655eba7c None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:56.738260 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f905913-cd51-4f63-8782-116d655eba7c None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:56.738585 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f905913-cd51-4f63-8782-116d655eba7c None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:56.741235 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 675/1355] 10.222.0.79 () {54 vars in 918 bytes} [Thu Oct 28 14:30:56 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:30:56.747092 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c07d1-f5ca-4867-8a43-f9c8eafc2374 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:56.747379 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c07d1-f5ca-4867-8a43-f9c8eafc2374 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:56.747651 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c07d1-f5ca-4867-8a43-f9c8eafc2374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:56.765991 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-0f4c07d1-f5ca-4867-8a43-f9c8eafc2374 None None] MFA Rules not processed for user `18cd6636ae7847c78be910824410d295`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:30:56.767202 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-0f4c07d1-f5ca-4867-8a43-f9c8eafc2374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:30:56.776469 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 681/1356] 10.222.0.79 () {58 vars in 1015 bytes} [Thu Oct 28 14:30:56 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:30:59.653718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fa330-ace4-4b2a-9a84-77847b0bcfb4 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:59.654604 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fa330-ace4-4b2a-9a84-77847b0bcfb4 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:59.654604 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fa330-ace4-4b2a-9a84-77847b0bcfb4 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:59.657351 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 676/1357] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:30:59 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:30:59.664098 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c5e77-f0bb-4a7f-9e22-6ed3aba43cb1 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:59.664591 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c5e77-f0bb-4a7f-9e22-6ed3aba43cb1 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:59.664591 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c5e77-f0bb-4a7f-9e22-6ed3aba43cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:59.683570 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-d16c5e77-f0bb-4a7f-9e22-6ed3aba43cb1 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:30:59.684774 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-d16c5e77-f0bb-4a7f-9e22-6ed3aba43cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:30:59.693450 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 682/1358] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:30:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:30:59.747687 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fa330-ace4-4b2a-9a84-77847b0bcfb4 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:30:59.763930 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fa330-ace4-4b2a-9a84-77847b0bcfb4 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:30:59.770827 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44253236-ae29-473d-ab9a-6c388e78c233 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:30:59.771464 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44253236-ae29-473d-ab9a-6c388e78c233 service nova] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:30:59.771737 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44253236-ae29-473d-ab9a-6c388e78c233 service nova] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:30:59.772000 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44253236-ae29-473d-ab9a-6c388e78c233 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:30:59.781114 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44253236-ae29-473d-ab9a-6c388e78c233 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:30:59.782895 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44253236-ae29-473d-ab9a-6c388e78c233 service nova] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:30:59.793240 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 677/1359] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:30:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:31:01.313600 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576bda9-67eb-4958-8613-8df5b2b0f299 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:01.314434 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576bda9-67eb-4958-8613-8df5b2b0f299 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:01.314434 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576bda9-67eb-4958-8613-8df5b2b0f299 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:01.317232 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 683/1360] 10.222.0.79 () {54 vars in 911 bytes} [Thu Oct 28 14:31:01 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:31:01.326433 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58123182-b1c7-44da-b646-57a9ca0e5404 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:01.326921 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58123182-b1c7-44da-b646-57a9ca0e5404 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:01.327025 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58123182-b1c7-44da-b646-57a9ca0e5404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:01.349554 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-58123182-b1c7-44da-b646-57a9ca0e5404 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:31:01.350807 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-58123182-b1c7-44da-b646-57a9ca0e5404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:31:01.359434 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 678/1361] 10.222.0.79 () {58 vars in 1008 bytes} [Thu Oct 28 14:31:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:31:01.512392 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576bda9-67eb-4958-8613-8df5b2b0f299 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:31:01.528970 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576bda9-67eb-4958-8613-8df5b2b0f299 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:31:01.535752 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e04f8-5972-44a3-a33e-9780ed5b8bfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:31:01.536382 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e04f8-5972-44a3-a33e-9780ed5b8bfd service nova] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:01.536656 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e04f8-5972-44a3-a33e-9780ed5b8bfd service nova] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:01.536921 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e04f8-5972-44a3-a33e-9780ed5b8bfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:01.546412 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e04f8-5972-44a3-a33e-9780ed5b8bfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:31:01.548011 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e04f8-5972-44a3-a33e-9780ed5b8bfd service nova] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:31:01.558084 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 684/1362] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:31:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:31:03.003613 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe80d83-39cd-49c2-8667-30a81d5fef65 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:03.004167 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe80d83-39cd-49c2-8667-30a81d5fef65 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:03.004167 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe80d83-39cd-49c2-8667-30a81d5fef65 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:03.005966 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 679/1363] 10.222.0.79 () {54 vars in 911 bytes} [Thu Oct 28 14:31:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 14:31:03.011904 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0e39e-70e6-454c-be0e-ebe6435f66eb None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:03.012351 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0e39e-70e6-454c-be0e-ebe6435f66eb None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:03.012549 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0e39e-70e6-454c-be0e-ebe6435f66eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:03.031630 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-efd0e39e-70e6-454c-be0e-ebe6435f66eb None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:31:03.032813 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-efd0e39e-70e6-454c-be0e-ebe6435f66eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:31:03.041899 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 685/1364] 10.222.0.79 () {58 vars in 1008 bytes} [Thu Oct 28 14:31:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:31:03.194856 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe80d83-39cd-49c2-8667-30a81d5fef65 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:31:03.214877 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe80d83-39cd-49c2-8667-30a81d5fef65 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:31:03.224165 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94971c-964f-424f-8e01-0a0f2ae54317 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:31:03.225067 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94971c-964f-424f-8e01-0a0f2ae54317 service nova] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:03.225499 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94971c-964f-424f-8e01-0a0f2ae54317 service nova] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:03.225940 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94971c-964f-424f-8e01-0a0f2ae54317 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:03.235508 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94971c-964f-424f-8e01-0a0f2ae54317 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:31:03.237104 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94971c-964f-424f-8e01-0a0f2ae54317 service nova] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:31:03.246606 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 680/1365] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:31:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:31:04.708489 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163067b-ba42-498f-bf67-35ecbfae7438 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:04.709413 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163067b-ba42-498f-bf67-35ecbfae7438 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:04.709413 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163067b-ba42-498f-bf67-35ecbfae7438 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:04.712249 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 686/1366] 10.222.0.79 () {54 vars in 911 bytes} [Thu Oct 28 14:31:04 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:31:04.719132 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b95ca4-864c-4ae6-81e1-8ee3f411b09a None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:04.719846 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b95ca4-864c-4ae6-81e1-8ee3f411b09a None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:04.719992 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b95ca4-864c-4ae6-81e1-8ee3f411b09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:04.742378 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-c4b95ca4-864c-4ae6-81e1-8ee3f411b09a None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:31:04.743678 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-c4b95ca4-864c-4ae6-81e1-8ee3f411b09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:31:04.753037 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 681/1367] 10.222.0.79 () {58 vars in 1008 bytes} [Thu Oct 28 14:31:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:31:04.910411 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163067b-ba42-498f-bf67-35ecbfae7438 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:31:04.928087 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163067b-ba42-498f-bf67-35ecbfae7438 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:31:04.934976 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e761b-bf1c-4cf8-8b2f-a91378da7a3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:31:04.935634 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e761b-bf1c-4cf8-8b2f-a91378da7a3e service nova] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:04.935918 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e761b-bf1c-4cf8-8b2f-a91378da7a3e service nova] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:04.936223 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e761b-bf1c-4cf8-8b2f-a91378da7a3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:04.944803 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e761b-bf1c-4cf8-8b2f-a91378da7a3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:31:04.946510 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e761b-bf1c-4cf8-8b2f-a91378da7a3e service nova] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:31:04.955922 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 687/1368] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:31:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:31:06.418087 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf1b71-c68c-44f9-a2db-661c1bd01e01 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:06.419020 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf1b71-c68c-44f9-a2db-661c1bd01e01 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:06.419020 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf1b71-c68c-44f9-a2db-661c1bd01e01 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:06.421926 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 682/1369] 10.222.0.79 () {54 vars in 911 bytes} [Thu Oct 28 14:31:06 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:31:06.428567 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb9038-c807-4a02-aaef-c5c4b7a6cea7 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:06.429330 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb9038-c807-4a02-aaef-c5c4b7a6cea7 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:06.429463 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb9038-c807-4a02-aaef-c5c4b7a6cea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:06.454352 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-29cb9038-c807-4a02-aaef-c5c4b7a6cea7 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:31:06.455587 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-29cb9038-c807-4a02-aaef-c5c4b7a6cea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:31:06.463831 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 688/1370] 10.222.0.79 () {58 vars in 1008 bytes} [Thu Oct 28 14:31:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:31:06.627063 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf1b71-c68c-44f9-a2db-661c1bd01e01 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:31:06.650515 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf1b71-c68c-44f9-a2db-661c1bd01e01 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:31:06.656953 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e621d-72eb-4096-8cac-09e1736455ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:31:06.657764 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e621d-72eb-4096-8cac-09e1736455ab service nova] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:06.658109 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e621d-72eb-4096-8cac-09e1736455ab service nova] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:06.658385 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e621d-72eb-4096-8cac-09e1736455ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:06.667517 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e621d-72eb-4096-8cac-09e1736455ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:31:06.669183 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e621d-72eb-4096-8cac-09e1736455ab service nova] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:31:06.678969 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 683/1371] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:31:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:31:08.058131 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f84c6b-b4eb-411a-9c2f-63ca5472b3db None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:08.059098 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f84c6b-b4eb-411a-9c2f-63ca5472b3db None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:08.059098 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f84c6b-b4eb-411a-9c2f-63ca5472b3db None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:08.061683 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 689/1372] 10.222.0.79 () {54 vars in 911 bytes} [Thu Oct 28 14:31:08 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:31:08.067541 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3c297-400c-41a2-bbbd-db1dfbcf37eb None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:08.067979 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3c297-400c-41a2-bbbd-db1dfbcf37eb None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:08.068088 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3c297-400c-41a2-bbbd-db1dfbcf37eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:08.092924 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-4ac3c297-400c-41a2-bbbd-db1dfbcf37eb None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:31:08.094111 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-4ac3c297-400c-41a2-bbbd-db1dfbcf37eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:31:08.103486 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 684/1373] 10.222.0.79 () {58 vars in 1008 bytes} [Thu Oct 28 14:31:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:31:08.256581 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f84c6b-b4eb-411a-9c2f-63ca5472b3db None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:31:08.275824 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f84c6b-b4eb-411a-9c2f-63ca5472b3db None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:31:08.282839 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82713e9-bc24-49d4-8ccb-919dd8417aca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:31:08.283513 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82713e9-bc24-49d4-8ccb-919dd8417aca service nova] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:08.283791 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82713e9-bc24-49d4-8ccb-919dd8417aca service nova] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:08.284057 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82713e9-bc24-49d4-8ccb-919dd8417aca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:08.293353 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82713e9-bc24-49d4-8ccb-919dd8417aca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:31:08.294979 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82713e9-bc24-49d4-8ccb-919dd8417aca service nova] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:31:08.304393 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 690/1374] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:31:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:31:09.702838 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a618f-d5cc-43bf-9637-814c7ab1327e None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:09.703638 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a618f-d5cc-43bf-9637-814c7ab1327e None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:09.703638 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a618f-d5cc-43bf-9637-814c7ab1327e None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:09.706447 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 685/1375] 10.222.0.79 () {54 vars in 911 bytes} [Thu Oct 28 14:31:09 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:31:09.712232 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b699e4d-2bce-4338-9799-a3a2cfa2b116 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:09.712680 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b699e4d-2bce-4338-9799-a3a2cfa2b116 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:09.712775 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b699e4d-2bce-4338-9799-a3a2cfa2b116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:09.734808 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-0b699e4d-2bce-4338-9799-a3a2cfa2b116 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:31:09.736003 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-0b699e4d-2bce-4338-9799-a3a2cfa2b116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:31:09.744240 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 691/1376] 10.222.0.79 () {58 vars in 1008 bytes} [Thu Oct 28 14:31:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:31:09.896565 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a618f-d5cc-43bf-9637-814c7ab1327e None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:31:09.918650 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a618f-d5cc-43bf-9637-814c7ab1327e None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:31:09.925068 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a707fe1-766a-4877-b56c-b653c9f2c2fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:31:09.925723 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a707fe1-766a-4877-b56c-b653c9f2c2fc service nova] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:09.926004 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a707fe1-766a-4877-b56c-b653c9f2c2fc service nova] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:09.926280 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a707fe1-766a-4877-b56c-b653c9f2c2fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:09.934956 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a707fe1-766a-4877-b56c-b653c9f2c2fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:31:09.936549 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a707fe1-766a-4877-b56c-b653c9f2c2fc service nova] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:31:09.945990 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 686/1377] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:31:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:31:11.375101 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1df4c3-18a0-4017-8885-24a52350236d None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:11.375691 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1df4c3-18a0-4017-8885-24a52350236d None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:11.375691 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1df4c3-18a0-4017-8885-24a52350236d None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:11.377338 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 692/1378] 10.222.0.79 () {54 vars in 911 bytes} [Thu Oct 28 14:31:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:31:11.384105 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad6360-1952-403b-8302-41f15681ffae None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:11.384560 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad6360-1952-403b-8302-41f15681ffae None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:11.384664 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad6360-1952-403b-8302-41f15681ffae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:11.403304 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-21ad6360-1952-403b-8302-41f15681ffae None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:31:11.404510 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-21ad6360-1952-403b-8302-41f15681ffae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:31:11.413710 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 687/1379] 10.222.0.79 () {58 vars in 1008 bytes} [Thu Oct 28 14:31:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:31:11.570882 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1df4c3-18a0-4017-8885-24a52350236d None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:31:11.588825 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1df4c3-18a0-4017-8885-24a52350236d None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:31:11.595826 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3376d47-35bd-4677-b12c-e6bbe626083a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:31:11.596468 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3376d47-35bd-4677-b12c-e6bbe626083a service nova] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:11.596746 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3376d47-35bd-4677-b12c-e6bbe626083a service nova] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:11.597021 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3376d47-35bd-4677-b12c-e6bbe626083a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:11.605996 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3376d47-35bd-4677-b12c-e6bbe626083a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:31:11.607597 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3376d47-35bd-4677-b12c-e6bbe626083a service nova] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:31:11.618004 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 693/1380] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:31:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:31:13.030356 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb79f2-f6af-4b32-bc41-948f8da9ba35 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:13.030982 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb79f2-f6af-4b32-bc41-948f8da9ba35 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:13.030982 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb79f2-f6af-4b32-bc41-948f8da9ba35 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:13.032741 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 688/1381] 10.222.0.79 () {54 vars in 911 bytes} [Thu Oct 28 14:31:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:31:13.039447 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194f0ee-7437-4f2b-955c-6f04a858716e None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:13.040282 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194f0ee-7437-4f2b-955c-6f04a858716e None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:13.040551 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194f0ee-7437-4f2b-955c-6f04a858716e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:13.060074 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-5194f0ee-7437-4f2b-955c-6f04a858716e None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:31:13.061264 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-5194f0ee-7437-4f2b-955c-6f04a858716e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:31:13.071067 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 694/1382] 10.222.0.79 () {58 vars in 1008 bytes} [Thu Oct 28 14:31:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:31:13.224900 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb79f2-f6af-4b32-bc41-948f8da9ba35 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:31:13.242940 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb79f2-f6af-4b32-bc41-948f8da9ba35 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:31:13.250453 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff90fb-9d74-447d-ab8b-7b1898cc4398 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:31:13.251136 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff90fb-9d74-447d-ab8b-7b1898cc4398 service nova] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:13.251414 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff90fb-9d74-447d-ab8b-7b1898cc4398 service nova] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:13.251680 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff90fb-9d74-447d-ab8b-7b1898cc4398 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:13.260869 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff90fb-9d74-447d-ab8b-7b1898cc4398 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:31:13.262476 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff90fb-9d74-447d-ab8b-7b1898cc4398 service nova] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:31:13.272420 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 689/1383] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:31:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:31:15.391702 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85bce0-03fa-4d52-8c3e-af111e69a5fe None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:15.392563 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85bce0-03fa-4d52-8c3e-af111e69a5fe None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:15.392563 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85bce0-03fa-4d52-8c3e-af111e69a5fe None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:15.395336 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 695/1384] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:31:15 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:31:15.401675 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f935b4b-1d83-4e0c-b98d-b5a7e70fdada None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:15.402211 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f935b4b-1d83-4e0c-b98d-b5a7e70fdada None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:15.402211 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f935b4b-1d83-4e0c-b98d-b5a7e70fdada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:15.422859 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-4f935b4b-1d83-4e0c-b98d-b5a7e70fdada None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:31:15.424118 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-4f935b4b-1d83-4e0c-b98d-b5a7e70fdada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:31:15.433666 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 690/1385] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:31:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:31:15.477772 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85bce0-03fa-4d52-8c3e-af111e69a5fe None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:31:15.492599 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85bce0-03fa-4d52-8c3e-af111e69a5fe None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:31:15.497982 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b723e-3f8c-4d01-b25b-909f4e187c3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:31:15.498948 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b723e-3f8c-4d01-b25b-909f4e187c3e service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:15.499455 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b723e-3f8c-4d01-b25b-909f4e187c3e service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:15.499814 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b723e-3f8c-4d01-b25b-909f4e187c3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:15.514993 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b723e-3f8c-4d01-b25b-909f4e187c3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:31:15.516874 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b723e-3f8c-4d01-b25b-909f4e187c3e service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:31:15.529141 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 696/1386] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:31:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:31:18.049194 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52987397-1228-4fcc-8235-dea669158acd None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:18.049796 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52987397-1228-4fcc-8235-dea669158acd None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:18.049796 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52987397-1228-4fcc-8235-dea669158acd None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:18.051565 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 691/1387] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:31:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:31:18.057874 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13419f-72b5-40ea-9eae-24371d828baa None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:18.058330 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13419f-72b5-40ea-9eae-24371d828baa None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:18.058442 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13419f-72b5-40ea-9eae-24371d828baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:18.078633 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-6f13419f-72b5-40ea-9eae-24371d828baa None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:31:18.079871 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-6f13419f-72b5-40ea-9eae-24371d828baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:31:18.090711 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 697/1388] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:31:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:31:18.130952 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52987397-1228-4fcc-8235-dea669158acd None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:31:18.146015 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52987397-1228-4fcc-8235-dea669158acd None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:31:18.150090 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d9cdb-fc98-4b8c-8e06-b96796996fb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:31:18.150764 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d9cdb-fc98-4b8c-8e06-b96796996fb1 service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:18.151044 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d9cdb-fc98-4b8c-8e06-b96796996fb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:18.151314 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d9cdb-fc98-4b8c-8e06-b96796996fb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:18.164724 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d9cdb-fc98-4b8c-8e06-b96796996fb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:31:18.166152 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d9cdb-fc98-4b8c-8e06-b96796996fb1 service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:31:18.176203 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 692/1389] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:31:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:31:20.770463 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfea5ee-834a-4cc6-b538-58cb46bc5bff None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:20.771381 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfea5ee-834a-4cc6-b538-58cb46bc5bff None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:20.771381 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfea5ee-834a-4cc6-b538-58cb46bc5bff None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:20.773980 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 698/1390] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:31:20 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:31:20.780108 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5e0e4-912c-4c00-b026-9d31c06318f2 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:20.780682 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5e0e4-912c-4c00-b026-9d31c06318f2 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:20.780682 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5e0e4-912c-4c00-b026-9d31c06318f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:20.799903 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-19e5e0e4-912c-4c00-b026-9d31c06318f2 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:31:20.801114 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-19e5e0e4-912c-4c00-b026-9d31c06318f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:31:20.810572 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 693/1391] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:31:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:31:20.852866 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfea5ee-834a-4cc6-b538-58cb46bc5bff None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:31:20.866185 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfea5ee-834a-4cc6-b538-58cb46bc5bff None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:31:20.871268 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bddaa8-0a4a-4120-8845-0986308e3c61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:31:20.871910 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bddaa8-0a4a-4120-8845-0986308e3c61 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:20.872181 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bddaa8-0a4a-4120-8845-0986308e3c61 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:20.872447 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bddaa8-0a4a-4120-8845-0986308e3c61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:20.882420 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bddaa8-0a4a-4120-8845-0986308e3c61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:31:20.883883 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bddaa8-0a4a-4120-8845-0986308e3c61 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:31:20.893564 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 699/1392] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:31:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:31:23.305845 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc481a45-0786-4849-9eac-185a789ddb00 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:23.306462 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc481a45-0786-4849-9eac-185a789ddb00 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:23.306462 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc481a45-0786-4849-9eac-185a789ddb00 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:23.308234 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 694/1393] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:31:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:31:23.315345 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb10e3-9b5a-4302-850b-23d76c78f868 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:23.315796 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb10e3-9b5a-4302-850b-23d76c78f868 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:23.315919 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb10e3-9b5a-4302-850b-23d76c78f868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:23.336954 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-0ddb10e3-9b5a-4302-850b-23d76c78f868 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:31:23.338164 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-0ddb10e3-9b5a-4302-850b-23d76c78f868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:31:23.346886 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 700/1394] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:31:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:31:23.388920 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc481a45-0786-4849-9eac-185a789ddb00 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:31:23.401602 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc481a45-0786-4849-9eac-185a789ddb00 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:31:23.406079 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959b555-569b-47e1-b648-e03aa3e94774 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:31:23.406798 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959b555-569b-47e1-b648-e03aa3e94774 service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:23.407082 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959b555-569b-47e1-b648-e03aa3e94774 service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:23.407354 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959b555-569b-47e1-b648-e03aa3e94774 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:23.417066 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959b555-569b-47e1-b648-e03aa3e94774 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:31:23.418926 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959b555-569b-47e1-b648-e03aa3e94774 service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:31:23.428252 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 695/1395] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:31:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:31:25.803540 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d8669-7363-414e-a0b0-09e61793f1c0 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:25.804161 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d8669-7363-414e-a0b0-09e61793f1c0 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:25.804161 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d8669-7363-414e-a0b0-09e61793f1c0 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:25.805837 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 701/1396] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:31:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:31:25.813046 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5369a33-c22d-429c-992d-894ae1b1cb51 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:25.813539 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5369a33-c22d-429c-992d-894ae1b1cb51 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:25.813659 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5369a33-c22d-429c-992d-894ae1b1cb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:25.835486 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-b5369a33-c22d-429c-992d-894ae1b1cb51 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:31:25.836686 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-b5369a33-c22d-429c-992d-894ae1b1cb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:31:25.845840 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 696/1397] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:31:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:31:25.887416 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d8669-7363-414e-a0b0-09e61793f1c0 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:31:25.899978 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d8669-7363-414e-a0b0-09e61793f1c0 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:31:25.904929 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f2df2-1fa6-4597-b7ca-358f1fa6aace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:31:25.905352 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f2df2-1fa6-4597-b7ca-358f1fa6aace service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:25.905628 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f2df2-1fa6-4597-b7ca-358f1fa6aace service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:25.905895 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f2df2-1fa6-4597-b7ca-358f1fa6aace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:25.915836 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f2df2-1fa6-4597-b7ca-358f1fa6aace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:31:25.917283 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f2df2-1fa6-4597-b7ca-358f1fa6aace service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:31:25.927490 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 702/1398] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:31:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:31:28.243755 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6441318-e873-4b34-8112-96fbec8b57e2 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:28.243755 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6441318-e873-4b34-8112-96fbec8b57e2 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:28.244516 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6441318-e873-4b34-8112-96fbec8b57e2 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:28.246042 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 697/1399] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:31:28 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:31:28.252178 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c114a6-d7f8-45bb-982a-1a8ecc839e93 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:28.252621 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c114a6-d7f8-45bb-982a-1a8ecc839e93 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:28.252732 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c114a6-d7f8-45bb-982a-1a8ecc839e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:28.271552 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-c4c114a6-d7f8-45bb-982a-1a8ecc839e93 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:31:28.272749 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-c4c114a6-d7f8-45bb-982a-1a8ecc839e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:31:28.281704 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 703/1400] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:31:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:31:28.325514 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6441318-e873-4b34-8112-96fbec8b57e2 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:31:28.342990 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6441318-e873-4b34-8112-96fbec8b57e2 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:31:28.347745 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3210c-29e4-4df9-8620-0006205f7d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:31:28.348510 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3210c-29e4-4df9-8620-0006205f7d7d service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:28.348793 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3210c-29e4-4df9-8620-0006205f7d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:28.349089 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3210c-29e4-4df9-8620-0006205f7d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:28.359834 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3210c-29e4-4df9-8620-0006205f7d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:31:28.361286 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3210c-29e4-4df9-8620-0006205f7d7d service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:31:28.371086 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 698/1401] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:31:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:31:30.658556 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef54ecf-4878-44e9-985c-6995f8d9f6fd None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:30.659484 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef54ecf-4878-44e9-985c-6995f8d9f6fd None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:30.659484 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef54ecf-4878-44e9-985c-6995f8d9f6fd None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:30.661833 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 704/1402] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:31:30 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:31:30.669001 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef2a88-b419-46c5-9b31-79571e2cc2bb None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:30.669751 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef2a88-b419-46c5-9b31-79571e2cc2bb None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:30.669914 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef2a88-b419-46c5-9b31-79571e2cc2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:30.692290 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-baef2a88-b419-46c5-9b31-79571e2cc2bb None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:31:30.693492 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-baef2a88-b419-46c5-9b31-79571e2cc2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:31:30.702601 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 699/1403] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:31:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:31:30.741640 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef54ecf-4878-44e9-985c-6995f8d9f6fd None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:31:30.753707 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef54ecf-4878-44e9-985c-6995f8d9f6fd None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:31:30.757586 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23db01-9bfb-4a3a-97c9-2bde440cd689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:31:30.758266 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23db01-9bfb-4a3a-97c9-2bde440cd689 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:30.758545 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23db01-9bfb-4a3a-97c9-2bde440cd689 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:30.758848 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23db01-9bfb-4a3a-97c9-2bde440cd689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:30.768038 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23db01-9bfb-4a3a-97c9-2bde440cd689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:31:30.769468 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23db01-9bfb-4a3a-97c9-2bde440cd689 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:31:30.778950 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 705/1404] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:31:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:31:33.057319 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9adf0-3153-4a9a-a3ae-e810a3b26a69 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:33.058098 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9adf0-3153-4a9a-a3ae-e810a3b26a69 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:33.058195 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9adf0-3153-4a9a-a3ae-e810a3b26a69 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:33.061050 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 700/1405] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:31:33 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:31:33.068152 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b23fb-af34-42a4-9a46-39249572868d None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:33.068942 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b23fb-af34-42a4-9a46-39249572868d None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:33.069087 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b23fb-af34-42a4-9a46-39249572868d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:33.089000 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-d17b23fb-af34-42a4-9a46-39249572868d None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:31:33.090251 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-d17b23fb-af34-42a4-9a46-39249572868d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:31:33.099160 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 706/1406] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:31:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:31:33.138121 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9adf0-3153-4a9a-a3ae-e810a3b26a69 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:31:33.150161 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9adf0-3153-4a9a-a3ae-e810a3b26a69 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:31:33.154091 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54740df1-babc-451d-b3d5-64a30bff5238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:31:33.154819 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54740df1-babc-451d-b3d5-64a30bff5238 service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:33.155043 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54740df1-babc-451d-b3d5-64a30bff5238 service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:33.155296 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54740df1-babc-451d-b3d5-64a30bff5238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:33.164568 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54740df1-babc-451d-b3d5-64a30bff5238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:31:33.166099 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54740df1-babc-451d-b3d5-64a30bff5238 service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:31:33.176030 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 701/1407] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:31:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:31:35.427049 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b0f13-27de-4dfe-a3f0-da4467ddb712 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:35.427934 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b0f13-27de-4dfe-a3f0-da4467ddb712 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:35.427934 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b0f13-27de-4dfe-a3f0-da4467ddb712 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:35.430807 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 707/1408] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:31:35 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:31:35.438026 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daef48-e5ec-46cc-86e1-9289a1eac87c None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:35.438494 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daef48-e5ec-46cc-86e1-9289a1eac87c None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:35.438626 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daef48-e5ec-46cc-86e1-9289a1eac87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:35.460726 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-a4daef48-e5ec-46cc-86e1-9289a1eac87c None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:31:35.461938 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-a4daef48-e5ec-46cc-86e1-9289a1eac87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:31:35.470387 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 702/1409] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:31:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:31:35.509627 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b0f13-27de-4dfe-a3f0-da4467ddb712 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:31:35.521213 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b0f13-27de-4dfe-a3f0-da4467ddb712 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:31:35.525836 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d49ec-052f-4764-9849-b38ec8a8cd70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:31:35.526623 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d49ec-052f-4764-9849-b38ec8a8cd70 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:35.527016 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d49ec-052f-4764-9849-b38ec8a8cd70 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:35.527354 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d49ec-052f-4764-9849-b38ec8a8cd70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:35.536536 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d49ec-052f-4764-9849-b38ec8a8cd70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:31:35.538032 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d49ec-052f-4764-9849-b38ec8a8cd70 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:31:35.548600 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 708/1410] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:31:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:31:37.834318 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03b230-d675-4a80-b494-09d72aafdad7 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:37.835280 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03b230-d675-4a80-b494-09d72aafdad7 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:37.835280 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03b230-d675-4a80-b494-09d72aafdad7 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:37.838094 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 703/1411] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:31:37 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:31:37.848321 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3dda87-9a48-4ea7-85e0-5b69055510a7 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:37.848766 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3dda87-9a48-4ea7-85e0-5b69055510a7 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:37.848869 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3dda87-9a48-4ea7-85e0-5b69055510a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:37.869382 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-9f3dda87-9a48-4ea7-85e0-5b69055510a7 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:31:37.870575 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-9f3dda87-9a48-4ea7-85e0-5b69055510a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:31:37.879044 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 709/1412] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:31:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:31:37.920923 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03b230-d675-4a80-b494-09d72aafdad7 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:31:37.933437 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03b230-d675-4a80-b494-09d72aafdad7 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:31:37.938245 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d0050-580e-4503-ad0a-e236c47104ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:31:37.938923 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d0050-580e-4503-ad0a-e236c47104ca service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:37.939202 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d0050-580e-4503-ad0a-e236c47104ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:37.939469 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d0050-580e-4503-ad0a-e236c47104ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:37.949721 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d0050-580e-4503-ad0a-e236c47104ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:31:37.951206 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d0050-580e-4503-ad0a-e236c47104ca service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:31:37.960954 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 704/1413] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:31:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:31:54.809954 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9cec8-3e2e-45b0-9e66-0ea53537e625 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:54.810966 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9cec8-3e2e-45b0-9e66-0ea53537e625 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:54.810966 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9cec8-3e2e-45b0-9e66-0ea53537e625 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:54.813835 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 710/1414] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:31:54 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:31:54.820702 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a5e5a-5206-4197-8cab-dfc3823b3944 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:54.821179 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a5e5a-5206-4197-8cab-dfc3823b3944 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:54.821301 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a5e5a-5206-4197-8cab-dfc3823b3944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:54.841240 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-c28a5e5a-5206-4197-8cab-dfc3823b3944 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:31:54.842455 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-c28a5e5a-5206-4197-8cab-dfc3823b3944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:31:54.850949 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 705/1415] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:31:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:31:54.902463 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87b7ee-d0c0-4dfb-b7e8-5a8fcbb6aeec None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:54.902776 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87b7ee-d0c0-4dfb-b7e8-5a8fcbb6aeec None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:54.903055 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87b7ee-d0c0-4dfb-b7e8-5a8fcbb6aeec None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:54.904955 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 711/1416] 10.222.0.79 () {54 vars in 962 bytes} [Thu Oct 28 14:31:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:31:54.911579 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cd822-dd41-4e99-97ea-83a55561475b None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:54.911932 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cd822-dd41-4e99-97ea-83a55561475b None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:54.912291 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cd822-dd41-4e99-97ea-83a55561475b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:54.933745 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-3f8cd822-dd41-4e99-97ea-83a55561475b None None] MFA Rules not processed for user `73a98d6cf23e4710bfbf71b960f81a9e`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:31:54.935002 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-3f8cd822-dd41-4e99-97ea-83a55561475b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:31:54.942735 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 706/1417] 10.222.0.79 () {58 vars in 1059 bytes} [Thu Oct 28 14:31:54 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:31:54.951104 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87b7ee-d0c0-4dfb-b7e8-5a8fcbb6aeec None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:31:54.963128 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87b7ee-d0c0-4dfb-b7e8-5a8fcbb6aeec None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:31:54.967118 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5a0c9-e390-4949-844d-1b20eeef33ed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a98d6cf23e4710bfbf71b960f81a9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:31:54.967775 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5a0c9-e390-4949-844d-1b20eeef33ed service glance] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:54.968032 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5a0c9-e390-4949-844d-1b20eeef33ed service glance] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:54.968304 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5a0c9-e390-4949-844d-1b20eeef33ed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:54.977516 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5a0c9-e390-4949-844d-1b20eeef33ed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:31:54.979097 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5a0c9-e390-4949-844d-1b20eeef33ed service glance] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:31:54.988384 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 712/1418] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:31:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:31:57.328798 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eef07-7772-4104-8e3b-1ed2ab2950f4 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:57.329683 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eef07-7772-4104-8e3b-1ed2ab2950f4 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:57.329683 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eef07-7772-4104-8e3b-1ed2ab2950f4 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:57.332471 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 707/1419] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:31:57 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:31:57.339778 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81ef6c-a0b3-4c47-9340-c20137221d22 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:57.340553 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81ef6c-a0b3-4c47-9340-c20137221d22 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:57.340741 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81ef6c-a0b3-4c47-9340-c20137221d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:57.365154 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-1b81ef6c-a0b3-4c47-9340-c20137221d22 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:31:57.366370 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-1b81ef6c-a0b3-4c47-9340-c20137221d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:31:57.375678 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 713/1420] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:31:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:31:57.400848 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7eef07-7772-4104-8e3b-1ed2ab2950f4 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:31:57.420076 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7eef07-7772-4104-8e3b-1ed2ab2950f4 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:31:57.425999 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4093a04-e108-4a14-8c5a-802c92d71508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:31:57.426658 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4093a04-e108-4a14-8c5a-802c92d71508 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:57.427032 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4093a04-e108-4a14-8c5a-802c92d71508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:57.427297 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4093a04-e108-4a14-8c5a-802c92d71508 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:57.428030 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4093a04-e108-4a14-8c5a-802c92d71508 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:31:57.429991 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4093a04-e108-4a14-8c5a-802c92d71508 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:31:57.462407 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 708/1421] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Oct 28 14:31:57 2021] GET /identity/v3/projects => generated 2553 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:31:59.735240 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e63c7-3fbd-4f49-9190-fb0368fda340 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:59.736138 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e63c7-3fbd-4f49-9190-fb0368fda340 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:59.736138 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e63c7-3fbd-4f49-9190-fb0368fda340 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:59.739087 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 714/1422] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:31:59 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:31:59.745317 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e58415-fbea-474d-9910-c66e5009a043 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:59.745780 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e58415-fbea-474d-9910-c66e5009a043 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:59.745884 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e58415-fbea-474d-9910-c66e5009a043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:59.764852 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-c7e58415-fbea-474d-9910-c66e5009a043 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:31:59.766043 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-c7e58415-fbea-474d-9910-c66e5009a043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:31:59.774623 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 709/1423] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:31:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:31:59.819681 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e63c7-3fbd-4f49-9190-fb0368fda340 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:31:59.841023 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e63c7-3fbd-4f49-9190-fb0368fda340 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:31:59.851626 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d2ab8-9e68-4e71-8c5c-25fd621cba8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:31:59.852613 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d2ab8-9e68-4e71-8c5c-25fd621cba8b service nova] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:31:59.853048 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d2ab8-9e68-4e71-8c5c-25fd621cba8b service nova] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:31:59.853429 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d2ab8-9e68-4e71-8c5c-25fd621cba8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:31:59.866695 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d2ab8-9e68-4e71-8c5c-25fd621cba8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:31:59.869220 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d2ab8-9e68-4e71-8c5c-25fd621cba8b service nova] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:31:59.879099 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 715/1424] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:31:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:32:02.317783 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d83129-9a02-49f0-ab1c-6e660b2a8153 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:32:02.318650 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d83129-9a02-49f0-ab1c-6e660b2a8153 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:32:02.318650 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d83129-9a02-49f0-ab1c-6e660b2a8153 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:32:02.321404 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 710/1425] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:32:02 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:32:02.327907 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823823b-80f4-4d5a-beff-927be02c7e53 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:32:02.328355 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823823b-80f4-4d5a-beff-927be02c7e53 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:32:02.328451 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823823b-80f4-4d5a-beff-927be02c7e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:32:02.346536 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-9823823b-80f4-4d5a-beff-927be02c7e53 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:32:02.347755 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-9823823b-80f4-4d5a-beff-927be02c7e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:32:02.356443 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 716/1426] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:32:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:32:02.394226 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d83129-9a02-49f0-ab1c-6e660b2a8153 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:32:02.412427 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d83129-9a02-49f0-ab1c-6e660b2a8153 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:32:02.417876 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d509d-74f2-4412-974b-607f460a4613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:32:02.418511 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d509d-74f2-4412-974b-607f460a4613 service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:32:02.418813 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d509d-74f2-4412-974b-607f460a4613 service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:32:02.419436 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d509d-74f2-4412-974b-607f460a4613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:32:02.428802 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d509d-74f2-4412-974b-607f460a4613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:32:02.430228 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d509d-74f2-4412-974b-607f460a4613 service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:32:02.441887 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 711/1427] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:32:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:32:04.758464 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2c4a8-8c33-404b-9bb8-8a183ed51d1d None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:32:04.759478 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2c4a8-8c33-404b-9bb8-8a183ed51d1d None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:32:04.759478 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2c4a8-8c33-404b-9bb8-8a183ed51d1d None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:32:04.761410 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 717/1428] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:32:04 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:32:04.767740 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287d329-ed10-445f-916d-75c1ecd17314 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:32:04.768196 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287d329-ed10-445f-916d-75c1ecd17314 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:32:04.768317 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287d329-ed10-445f-916d-75c1ecd17314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:32:04.787083 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-f287d329-ed10-445f-916d-75c1ecd17314 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:32:04.788262 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-f287d329-ed10-445f-916d-75c1ecd17314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:32:04.797084 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 712/1429] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:32:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:32:04.840192 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2c4a8-8c33-404b-9bb8-8a183ed51d1d None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:32:04.856692 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2c4a8-8c33-404b-9bb8-8a183ed51d1d None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:32:04.861127 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23f3b1-8404-4264-806f-7bc7250d2e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:32:04.861762 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23f3b1-8404-4264-806f-7bc7250d2e61 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:32:04.862039 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23f3b1-8404-4264-806f-7bc7250d2e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:32:04.862305 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23f3b1-8404-4264-806f-7bc7250d2e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:32:04.871548 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23f3b1-8404-4264-806f-7bc7250d2e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:32:04.872976 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23f3b1-8404-4264-806f-7bc7250d2e61 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:32:04.882664 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 718/1430] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:32:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:32:07.227888 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c477f-9e3a-4188-81b8-0841e776b94f None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:32:07.228752 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c477f-9e3a-4188-81b8-0841e776b94f None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:32:07.228752 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c477f-9e3a-4188-81b8-0841e776b94f None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:32:07.231646 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 713/1431] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:32:07 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:32:07.238741 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553abac-46b0-46ff-929d-fb4cf644188d None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:32:07.239504 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553abac-46b0-46ff-929d-fb4cf644188d None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:32:07.239676 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553abac-46b0-46ff-929d-fb4cf644188d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:32:07.262602 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-2553abac-46b0-46ff-929d-fb4cf644188d None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:32:07.264449 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-2553abac-46b0-46ff-929d-fb4cf644188d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:32:07.277472 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 719/1432] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:32:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:32:07.323616 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c477f-9e3a-4188-81b8-0841e776b94f None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:32:07.339223 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c477f-9e3a-4188-81b8-0841e776b94f None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:32:07.343106 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8cd95-c907-4b94-bdc3-de197c9b07b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:32:07.343749 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8cd95-c907-4b94-bdc3-de197c9b07b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:32:07.344045 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8cd95-c907-4b94-bdc3-de197c9b07b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:32:07.344312 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8cd95-c907-4b94-bdc3-de197c9b07b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:32:07.353569 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8cd95-c907-4b94-bdc3-de197c9b07b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:32:07.355020 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8cd95-c907-4b94-bdc3-de197c9b07b6 service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:32:07.364268 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 714/1433] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:32:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:32:09.820824 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685490a-e94f-4cf9-bc99-471c55d47f82 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:32:09.821424 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685490a-e94f-4cf9-bc99-471c55d47f82 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:32:09.821424 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685490a-e94f-4cf9-bc99-471c55d47f82 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:32:09.823267 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 720/1434] 10.222.0.79 () {54 vars in 926 bytes} [Thu Oct 28 14:32:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:32:09.829532 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab78f3-cc70-48ca-bb91-d0524e359eaf None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:32:09.830016 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab78f3-cc70-48ca-bb91-d0524e359eaf None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:32:09.830129 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab78f3-cc70-48ca-bb91-d0524e359eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:32:09.854844 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-19ab78f3-cc70-48ca-bb91-d0524e359eaf None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:32:09.856040 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-19ab78f3-cc70-48ca-bb91-d0524e359eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:32:09.865437 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 715/1435] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Oct 28 14:32:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:32:09.914160 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685490a-e94f-4cf9-bc99-471c55d47f82 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:32:09.925973 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685490a-e94f-4cf9-bc99-471c55d47f82 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:32:09.929879 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd2925-47d1-405d-8b3d-5018ffa0897a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:32:09.930516 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd2925-47d1-405d-8b3d-5018ffa0897a service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:32:09.930839 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd2925-47d1-405d-8b3d-5018ffa0897a service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:32:09.931112 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd2925-47d1-405d-8b3d-5018ffa0897a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:32:09.940380 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd2925-47d1-405d-8b3d-5018ffa0897a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:32:09.941805 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd2925-47d1-405d-8b3d-5018ffa0897a service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:32:09.951233 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 721/1436] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:32:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:33:20.707425 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c893477-507f-403d-b955-fcac1702faff None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:33:20.708099 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c893477-507f-403d-b955-fcac1702faff None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:33:20.708099 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c893477-507f-403d-b955-fcac1702faff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:33:20.726196 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-9c893477-507f-403d-b955-fcac1702faff None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:33:20.727407 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-9c893477-507f-403d-b955-fcac1702faff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:33:20.737055 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 716/1437] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:33:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:33:20.745298 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ea1f3-6e52-43c7-857e-16ed9a7b5e98 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:33:20.745815 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ea1f3-6e52-43c7-857e-16ed9a7b5e98 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:33:20.745815 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ea1f3-6e52-43c7-857e-16ed9a7b5e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:33:20.765372 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-759ea1f3-6e52-43c7-857e-16ed9a7b5e98 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:33:20.766563 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-759ea1f3-6e52-43c7-857e-16ed9a7b5e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:33:20.775876 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 722/1438] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:33:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:33:20.782034 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c893477-507f-403d-b955-fcac1702faff None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:33:20.792397 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c893477-507f-403d-b955-fcac1702faff None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:33:20.797590 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d0cf3-188a-4680-8fdb-8937113f6e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:33:20.798251 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d0cf3-188a-4680-8fdb-8937113f6e94 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:33:20.798531 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d0cf3-188a-4680-8fdb-8937113f6e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:33:20.798864 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d0cf3-188a-4680-8fdb-8937113f6e94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:33:20.799564 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d0cf3-188a-4680-8fdb-8937113f6e94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:33:20.799870 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d0cf3-188a-4680-8fdb-8937113f6e94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:33:20.801452 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d0cf3-188a-4680-8fdb-8937113f6e94 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:33:20.814558 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 717/1439] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:33:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:33:20.822604 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ea1f3-6e52-43c7-857e-16ed9a7b5e98 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:33:20.831791 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ea1f3-6e52-43c7-857e-16ed9a7b5e98 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:33:20.837199 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23422f0-1805-4848-9670-1b0acccbb47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:33:20.838034 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23422f0-1805-4848-9670-1b0acccbb47d admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:33:20.838314 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23422f0-1805-4848-9670-1b0acccbb47d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:33:20.838582 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23422f0-1805-4848-9670-1b0acccbb47d admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:33:20.839335 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23422f0-1805-4848-9670-1b0acccbb47d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:33:20.841356 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23422f0-1805-4848-9670-1b0acccbb47d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:33:20.882975 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 723/1440] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:33:20 2021] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:33:20.888660 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d0cf3-188a-4680-8fdb-8937113f6e94 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:33:20.898908 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d0cf3-188a-4680-8fdb-8937113f6e94 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:33:20.959161 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3f097-4488-4e3c-a44d-cb51d2a926a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:33:20.959776 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3f097-4488-4e3c-a44d-cb51d2a926a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:33:20.960039 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3f097-4488-4e3c-a44d-cb51d2a926a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:33:20.960296 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3f097-4488-4e3c-a44d-cb51d2a926a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:33:20.961020 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3f097-4488-4e3c-a44d-cb51d2a926a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:33:20.963162 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3f097-4488-4e3c-a44d-cb51d2a926a0 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:33:20.990243 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 718/1441] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:33:20 2021] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:33:20.995069 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23422f0-1805-4848-9670-1b0acccbb47d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:33:21.005555 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23422f0-1805-4848-9670-1b0acccbb47d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:33:21.011070 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91438d92-db17-4af5-8bd3-124b318b0727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:33:21.011736 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91438d92-db17-4af5-8bd3-124b318b0727 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:33:21.011982 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91438d92-db17-4af5-8bd3-124b318b0727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:33:21.012262 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91438d92-db17-4af5-8bd3-124b318b0727 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:33:21.012985 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91438d92-db17-4af5-8bd3-124b318b0727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:33:21.014625 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91438d92-db17-4af5-8bd3-124b318b0727 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:33:21.029972 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 724/1442] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:33:20 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:33:21.034210 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3f097-4488-4e3c-a44d-cb51d2a926a0 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:33:21.044420 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3f097-4488-4e3c-a44d-cb51d2a926a0 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:33:21.050447 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b18da-2194-4526-8ced-e3d8305c94cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:33:21.051155 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b18da-2194-4526-8ced-e3d8305c94cc admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:33:21.051428 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b18da-2194-4526-8ced-e3d8305c94cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:33:21.051692 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b18da-2194-4526-8ced-e3d8305c94cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:33:21.052434 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b18da-2194-4526-8ced-e3d8305c94cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:33:21.054044 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b18da-2194-4526-8ced-e3d8305c94cc admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:33:21.068406 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 719/1443] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:33:21 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:33:21.072882 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91438d92-db17-4af5-8bd3-124b318b0727 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:33:21.083096 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91438d92-db17-4af5-8bd3-124b318b0727 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:33:21.088650 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86b219-7da3-490e-b098-9bb69634e5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:33:21.089548 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86b219-7da3-490e-b098-9bb69634e5c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:33:21.089827 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86b219-7da3-490e-b098-9bb69634e5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:33:21.090117 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86b219-7da3-490e-b098-9bb69634e5c1 admin admin] PATH_INFO: `/v3/projects/1e4e8e5821c540eba36480cb58fff7e8/users/83d2c89e064d4c69bd4860f84a22bfb2/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:33:21.105328 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86b219-7da3-490e-b098-9bb69634e5c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e4e8e5821c540eba36480cb58fff7e8, user_id=83d2c89e064d4c69bd4860f84a22bfb2, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:33:21.108020 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86b219-7da3-490e-b098-9bb69634e5c1 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:33:21.123040 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 725/1444] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:33:21 2021] PUT /identity/v3/projects/1e4e8e5821c540eba36480cb58fff7e8/users/83d2c89e064d4c69bd4860f84a22bfb2/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:33:21.139890 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0b469-c11b-4942-9257-559b568c0223 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:33:21.140174 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0b469-c11b-4942-9257-559b568c0223 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:33:21.140449 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0b469-c11b-4942-9257-559b568c0223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:33:21.168356 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-a4c0b469-c11b-4942-9257-559b568c0223 None None] MFA Rules not processed for user `83d2c89e064d4c69bd4860f84a22bfb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:33:21.169639 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-a4c0b469-c11b-4942-9257-559b568c0223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:33:21.241478 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 720/1445] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:33:21 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:33:21.254196 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86b219-7da3-490e-b098-9bb69634e5c1 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:33:21.335954 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86b219-7da3-490e-b098-9bb69634e5c1 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:33:21.343066 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c174f0-5438-4100-adcd-1f02abb2c60c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:33:21.343712 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c174f0-5438-4100-adcd-1f02abb2c60c service nova] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:33:21.343992 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c174f0-5438-4100-adcd-1f02abb2c60c service nova] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:33:21.344252 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c174f0-5438-4100-adcd-1f02abb2c60c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:33:21.352568 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c174f0-5438-4100-adcd-1f02abb2c60c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:33:21.354182 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c174f0-5438-4100-adcd-1f02abb2c60c service nova] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:33:21.362828 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 726/1446] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:33:21 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:33:21.439321 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea5f61-38c9-47c9-8b31-b2b71af409b4 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:33:21.439607 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea5f61-38c9-47c9-8b31-b2b71af409b4 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:33:21.439877 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea5f61-38c9-47c9-8b31-b2b71af409b4 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:33:21.441910 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 721/1447] 10.222.0.79 () {52 vars in 829 bytes} [Thu Oct 28 14:33:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:33:21.445841 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c174f0-5438-4100-adcd-1f02abb2c60c service nova] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:33:21.511746 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c174f0-5438-4100-adcd-1f02abb2c60c service nova] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:33:21.517184 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e08ed5-d8a2-48e1-9634-085ab16d341d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:33:21.518045 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e08ed5-d8a2-48e1-9634-085ab16d341d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:33:21.518327 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e08ed5-d8a2-48e1-9634-085ab16d341d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:33:21.518585 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e08ed5-d8a2-48e1-9634-085ab16d341d admin admin] PATH_INFO: `/v3/users/83d2c89e064d4c69bd4860f84a22bfb2` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:33:21.519891 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e08ed5-d8a2-48e1-9634-085ab16d341d admin admin] RBAC: Authorizing `identity:delete_user(user_id=83d2c89e064d4c69bd4860f84a22bfb2)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:33:21.520899 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING py.warnings [None req-48e08ed5-d8a2-48e1-9634-085ab16d341d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:33:21.520899 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: warnings.warn(msg) Oct 28 14:33:21.520899 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: Oct 28 14:33:21.522100 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e08ed5-d8a2-48e1-9634-085ab16d341d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:33:21.600299 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-48e08ed5-d8a2-48e1-9634-085ab16d341d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83d2c89e064d4c69bd4860f84a22bfb2'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:33:21.612582 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-48e08ed5-d8a2-48e1-9634-085ab16d341d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83d2c89e064d4c69bd4860f84a22bfb2'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:33:21.613455 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-48e08ed5-d8a2-48e1-9634-085ab16d341d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83d2c89e064d4c69bd4860f84a22bfb2'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:33:21.637042 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-48e08ed5-d8a2-48e1-9634-085ab16d341d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83d2c89e064d4c69bd4860f84a22bfb2'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:33:21.651895 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-48e08ed5-d8a2-48e1-9634-085ab16d341d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83d2c89e064d4c69bd4860f84a22bfb2'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:33:21.658798 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 727/1448] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:33:21 2021] DELETE /identity/v3/users/83d2c89e064d4c69bd4860f84a22bfb2 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:33:21.664509 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a4d2f-a616-4baf-a37f-1cf68d3cb2fa None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:33:21.664964 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a4d2f-a616-4baf-a37f-1cf68d3cb2fa None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:33:21.665361 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a4d2f-a616-4baf-a37f-1cf68d3cb2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:33:21.689356 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-e25a4d2f-a616-4baf-a37f-1cf68d3cb2fa None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:33:21.690572 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e25a4d2f-a616-4baf-a37f-1cf68d3cb2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:33:21.764981 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 722/1449] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:33:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:33:21.775610 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e08ed5-d8a2-48e1-9634-085ab16d341d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:33:21.777151 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-48e08ed5-d8a2-48e1-9634-085ab16d341d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:33:21.852459 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e08ed5-d8a2-48e1-9634-085ab16d341d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:33:21.857416 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e694a-83f8-443d-b552-2e329922ea2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:33:21.858080 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e694a-83f8-443d-b552-2e329922ea2b service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:33:21.858353 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e694a-83f8-443d-b552-2e329922ea2b service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:33:21.858616 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e694a-83f8-443d-b552-2e329922ea2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:33:21.868364 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e694a-83f8-443d-b552-2e329922ea2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:33:21.869811 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e694a-83f8-443d-b552-2e329922ea2b service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:33:21.879305 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 728/1450] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:33:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:33:22.243535 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a4d2f-a616-4baf-a37f-1cf68d3cb2fa None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:33:22.245247 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e25a4d2f-a616-4baf-a37f-1cf68d3cb2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:33:22.257043 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a4d2f-a616-4baf-a37f-1cf68d3cb2fa None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:33:22.267357 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fce43-2073-458e-b588-1325dee35e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:33:22.268285 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fce43-2073-458e-b588-1325dee35e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:33:22.268561 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fce43-2073-458e-b588-1325dee35e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:33:22.268814 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fce43-2073-458e-b588-1325dee35e71 admin admin] PATH_INFO: `/v3/projects/1e4e8e5821c540eba36480cb58fff7e8` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:33:22.270152 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0fce43-2073-458e-b588-1325dee35e71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e4e8e5821c540eba36480cb58fff7e8)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:33:22.271300 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING py.warnings [None req-ce0fce43-2073-458e-b588-1325dee35e71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:33:22.271300 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: warnings.warn(msg) Oct 28 14:33:22.271300 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: Oct 28 14:33:22.272438 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0fce43-2073-458e-b588-1325dee35e71 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:33:22.332615 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ce0fce43-2073-458e-b588-1325dee35e71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e4e8e5821c540eba36480cb58fff7e8', 'request_id': 'req-ce0fce43-2073-458e-b588-1325dee35e71'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:33:22.345844 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ce0fce43-2073-458e-b588-1325dee35e71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e4e8e5821c540eba36480cb58fff7e8', 'request_id': 'req-ce0fce43-2073-458e-b588-1325dee35e71'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:33:22.360378 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ce0fce43-2073-458e-b588-1325dee35e71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e4e8e5821c540eba36480cb58fff7e8', 'request_id': 'req-ce0fce43-2073-458e-b588-1325dee35e71'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:33:22.374371 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ce0fce43-2073-458e-b588-1325dee35e71 admin admin] The token cache is being invalidate because project 1e4e8e5821c540eba36480cb58fff7e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:33:22.374720 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ce0fce43-2073-458e-b588-1325dee35e71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:33:22.375364 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ce0fce43-2073-458e-b588-1325dee35e71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:33:22.377098 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 723/1451] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:33:22 2021] DELETE /identity/v3/projects/1e4e8e5821c540eba36480cb58fff7e8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:34:55.442650 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d1662-0cb7-4b10-8a24-05c5d784db18 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:34:55.443315 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d1662-0cb7-4b10-8a24-05c5d784db18 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:34:55.443315 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d1662-0cb7-4b10-8a24-05c5d784db18 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:34:55.444988 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 729/1452] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 28 14:34:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:34:55.450518 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2278d77-5fff-4910-9a2f-0b96e9c45669 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:34:55.451058 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2278d77-5fff-4910-9a2f-0b96e9c45669 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:34:55.451164 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2278d77-5fff-4910-9a2f-0b96e9c45669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:34:55.472079 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-d2278d77-5fff-4910-9a2f-0b96e9c45669 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:34:55.473330 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-d2278d77-5fff-4910-9a2f-0b96e9c45669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:34:55.554819 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 724/1453] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 28 14:34:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:34:55.718428 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d1662-0cb7-4b10-8a24-05c5d784db18 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:34:55.721183 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-383d1662-0cb7-4b10-8a24-05c5d784db18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:34:55.817537 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d1662-0cb7-4b10-8a24-05c5d784db18 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:34:55.824158 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05462c00-4ab6-4dda-9c78-28744a8d949e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:34:55.824814 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05462c00-4ab6-4dda-9c78-28744a8d949e service nova] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:34:55.825100 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05462c00-4ab6-4dda-9c78-28744a8d949e service nova] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:34:55.825356 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05462c00-4ab6-4dda-9c78-28744a8d949e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:34:55.835021 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05462c00-4ab6-4dda-9c78-28744a8d949e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:34:55.836781 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05462c00-4ab6-4dda-9c78-28744a8d949e service nova] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:34:55.847754 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 730/1454] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:34:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:34:56.318364 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b739e-1285-40ef-88d5-d5b1c12ac029 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:34:56.318736 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b739e-1285-40ef-88d5-d5b1c12ac029 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:34:56.319127 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b739e-1285-40ef-88d5-d5b1c12ac029 None None] PATH_INFO: `/v3` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:34:56.320565 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 725/1455] 10.222.0.72 () {54 vars in 925 bytes} [Thu Oct 28 14:34:56 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:34:56.329120 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ea8c2-8eea-4b2d-97ec-23e517258e57 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:34:56.329393 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ea8c2-8eea-4b2d-97ec-23e517258e57 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:34:56.329831 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ea8c2-8eea-4b2d-97ec-23e517258e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:34:56.349579 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-6e6ea8c2-8eea-4b2d-97ec-23e517258e57 None None] MFA Rules not processed for user `8bf32a6fafb7458788a47e4774cb7bc8`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:34:56.350819 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-6e6ea8c2-8eea-4b2d-97ec-23e517258e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:34:56.416023 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 731/1456] 10.222.0.72 () {58 vars in 1015 bytes} [Thu Oct 28 14:34:56 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:34:57.281845 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd47d6-f5a1-463d-ba42-cbdce5178a8d None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:34:57.282412 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd47d6-f5a1-463d-ba42-cbdce5178a8d None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:34:57.282412 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd47d6-f5a1-463d-ba42-cbdce5178a8d None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:34:57.284822 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 726/1457] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 28 14:34:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:34:57.290401 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c119fd-1754-4258-bc8c-3f897e393d16 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:34:57.290951 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c119fd-1754-4258-bc8c-3f897e393d16 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:34:57.291046 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c119fd-1754-4258-bc8c-3f897e393d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:34:57.311006 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-b3c119fd-1754-4258-bc8c-3f897e393d16 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:34:57.312278 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-b3c119fd-1754-4258-bc8c-3f897e393d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:34:57.320538 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 732/1458] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 28 14:34:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:34:57.473800 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd47d6-f5a1-463d-ba42-cbdce5178a8d None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:34:57.493448 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd47d6-f5a1-463d-ba42-cbdce5178a8d None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:34:57.502250 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430331c-c47a-49a4-b52a-4fea5494a75e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:34:57.502941 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430331c-c47a-49a4-b52a-4fea5494a75e service nova] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:34:57.503215 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430331c-c47a-49a4-b52a-4fea5494a75e service nova] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:34:57.503486 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430331c-c47a-49a4-b52a-4fea5494a75e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:34:57.511935 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430331c-c47a-49a4-b52a-4fea5494a75e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:34:57.513555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430331c-c47a-49a4-b52a-4fea5494a75e service nova] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:34:57.523056 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 727/1459] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:34:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:35:00.422938 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79268785-816b-49ab-9e68-1b468d5018e9 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:35:00.423420 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79268785-816b-49ab-9e68-1b468d5018e9 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:35:00.423539 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79268785-816b-49ab-9e68-1b468d5018e9 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:35:00.425298 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 733/1460] 10.222.0.79 () {54 vars in 960 bytes} [Thu Oct 28 14:35:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:35:00.430839 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b49e6-d747-4034-9a94-fdc2c3b4f831 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:35:00.431310 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b49e6-d747-4034-9a94-fdc2c3b4f831 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:35:00.431426 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b49e6-d747-4034-9a94-fdc2c3b4f831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:35:00.450723 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-518b49e6-d747-4034-9a94-fdc2c3b4f831 None None] MFA Rules not processed for user `8bf32a6fafb7458788a47e4774cb7bc8`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:35:00.451958 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-518b49e6-d747-4034-9a94-fdc2c3b4f831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:35:00.461735 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 728/1461] 10.222.0.79 () {58 vars in 1057 bytes} [Thu Oct 28 14:35:00 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:35:00.469588 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79268785-816b-49ab-9e68-1b468d5018e9 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:35:00.487672 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79268785-816b-49ab-9e68-1b468d5018e9 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:35:00.493683 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185acff-73dc-4b58-972b-5373ca13725c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bf32a6fafb7458788a47e4774cb7bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:35:00.494318 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185acff-73dc-4b58-972b-5373ca13725c service placement] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:35:00.494597 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185acff-73dc-4b58-972b-5373ca13725c service placement] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:35:00.494941 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185acff-73dc-4b58-972b-5373ca13725c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:35:00.503291 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185acff-73dc-4b58-972b-5373ca13725c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:35:00.504895 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185acff-73dc-4b58-972b-5373ca13725c service placement] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:35:00.514629 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 734/1462] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:35:00 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:35:09.394503 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd207fc7-9bf6-4379-ae23-a5f9eed7a0a3 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:35:09.395114 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd207fc7-9bf6-4379-ae23-a5f9eed7a0a3 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:35:09.395114 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd207fc7-9bf6-4379-ae23-a5f9eed7a0a3 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:35:09.396928 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 729/1463] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 28 14:35:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:35:09.403484 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a66cc1-96e0-4c63-8449-6858beaf3adc None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:35:09.404244 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a66cc1-96e0-4c63-8449-6858beaf3adc None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:35:09.404410 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a66cc1-96e0-4c63-8449-6858beaf3adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:35:09.425341 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-a7a66cc1-96e0-4c63-8449-6858beaf3adc None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:35:09.426551 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a7a66cc1-96e0-4c63-8449-6858beaf3adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:35:09.436062 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 735/1464] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 28 14:35:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:35:09.593999 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd207fc7-9bf6-4379-ae23-a5f9eed7a0a3 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:35:09.610233 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd207fc7-9bf6-4379-ae23-a5f9eed7a0a3 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:35:09.616344 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613f946-3418-475f-82e8-6ca6d6aca15d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:35:09.617094 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613f946-3418-475f-82e8-6ca6d6aca15d service nova] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:35:09.617361 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613f946-3418-475f-82e8-6ca6d6aca15d service nova] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:35:09.617701 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613f946-3418-475f-82e8-6ca6d6aca15d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:35:09.627010 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613f946-3418-475f-82e8-6ca6d6aca15d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:35:09.628792 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613f946-3418-475f-82e8-6ca6d6aca15d service nova] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:35:09.638345 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 730/1465] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:35:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:35:11.045630 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaf67a-ab94-472d-84ab-92b0e3878675 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:35:11.046995 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaf67a-ab94-472d-84ab-92b0e3878675 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:35:11.046995 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaf67a-ab94-472d-84ab-92b0e3878675 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:35:11.049884 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 736/1466] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 28 14:35:11 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:35:11.058933 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3e1cf-583b-4cba-b9b3-c90b34bfa37e None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:35:11.059364 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3e1cf-583b-4cba-b9b3-c90b34bfa37e None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:35:11.059499 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3e1cf-583b-4cba-b9b3-c90b34bfa37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:35:11.080940 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-34e3e1cf-583b-4cba-b9b3-c90b34bfa37e None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:35:11.082195 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-34e3e1cf-583b-4cba-b9b3-c90b34bfa37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:35:11.091039 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 731/1467] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 28 14:35:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:35:11.247379 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aaf67a-ab94-472d-84ab-92b0e3878675 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:35:11.270651 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aaf67a-ab94-472d-84ab-92b0e3878675 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:35:11.277282 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bb314-72d9-4730-8fd6-b33a548155a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:35:11.277923 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bb314-72d9-4730-8fd6-b33a548155a0 service nova] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:35:11.278201 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bb314-72d9-4730-8fd6-b33a548155a0 service nova] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:35:11.278471 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bb314-72d9-4730-8fd6-b33a548155a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:35:11.287390 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bb314-72d9-4730-8fd6-b33a548155a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:35:11.288969 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bb314-72d9-4730-8fd6-b33a548155a0 service nova] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:35:11.298885 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 737/1468] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:35:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:35:15.723943 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d196a76-0aa4-4337-880c-a4b67211eaf3 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:35:15.724921 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d196a76-0aa4-4337-880c-a4b67211eaf3 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:35:15.724921 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d196a76-0aa4-4337-880c-a4b67211eaf3 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:35:15.727849 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 732/1469] 127.0.0.1 () {54 vars in 916 bytes} [Thu Oct 28 14:35:15 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:35:15.737411 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d9388-e9f6-4cdf-88fb-617c586fb0db None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:35:15.737843 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d9388-e9f6-4cdf-88fb-617c586fb0db None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:35:15.737991 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d9388-e9f6-4cdf-88fb-617c586fb0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:35:15.758970 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-f01d9388-e9f6-4cdf-88fb-617c586fb0db None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:35:15.760170 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-f01d9388-e9f6-4cdf-88fb-617c586fb0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:35:15.772682 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 738/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Oct 28 14:35:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:35:15.814735 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d196a76-0aa4-4337-880c-a4b67211eaf3 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:35:15.817758 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-1d196a76-0aa4-4337-880c-a4b67211eaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:35:15.884231 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d196a76-0aa4-4337-880c-a4b67211eaf3 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:35:15.888196 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525de106-ddad-481f-845e-b6ece7e204ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:35:15.888840 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525de106-ddad-481f-845e-b6ece7e204ed service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:35:15.889116 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525de106-ddad-481f-845e-b6ece7e204ed service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:35:15.889393 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525de106-ddad-481f-845e-b6ece7e204ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:35:15.899377 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525de106-ddad-481f-845e-b6ece7e204ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:35:15.900821 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525de106-ddad-481f-845e-b6ece7e204ed service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:35:15.911043 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 733/1471] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:35:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:35:18.155068 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81646f93-f1d8-4cfa-919d-c91c46842abd None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:35:18.155616 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81646f93-f1d8-4cfa-919d-c91c46842abd None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:35:18.155616 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81646f93-f1d8-4cfa-919d-c91c46842abd None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:35:18.157287 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 739/1472] 127.0.0.1 () {54 vars in 916 bytes} [Thu Oct 28 14:35:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:35:18.164202 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569996bc-5e70-4330-bd91-364bbb1b11af None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:35:18.164646 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569996bc-5e70-4330-bd91-364bbb1b11af None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:35:18.164755 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569996bc-5e70-4330-bd91-364bbb1b11af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:35:18.189390 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-569996bc-5e70-4330-bd91-364bbb1b11af None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:35:18.190576 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-569996bc-5e70-4330-bd91-364bbb1b11af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:35:18.199049 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 734/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Oct 28 14:35:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:35:18.235935 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81646f93-f1d8-4cfa-919d-c91c46842abd None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:35:18.247662 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81646f93-f1d8-4cfa-919d-c91c46842abd None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:35:18.251632 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc8433-a834-4a86-8dcb-3f96ee129312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:35:18.252262 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc8433-a834-4a86-8dcb-3f96ee129312 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:35:18.252534 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc8433-a834-4a86-8dcb-3f96ee129312 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:35:18.252807 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc8433-a834-4a86-8dcb-3f96ee129312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:35:18.261976 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc8433-a834-4a86-8dcb-3f96ee129312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:35:18.263456 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc8433-a834-4a86-8dcb-3f96ee129312 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:35:18.272861 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 740/1474] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:35:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:35:22.196498 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3552a0-3df5-4e13-9276-db6345e185f1 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:35:22.197106 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3552a0-3df5-4e13-9276-db6345e185f1 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:35:22.197106 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3552a0-3df5-4e13-9276-db6345e185f1 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:35:22.198723 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 735/1475] 127.0.0.1 () {54 vars in 916 bytes} [Thu Oct 28 14:35:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:35:22.207741 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03bb06-8a9e-4f1a-9af3-87085c2c1699 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:35:22.208237 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03bb06-8a9e-4f1a-9af3-87085c2c1699 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:35:22.208237 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03bb06-8a9e-4f1a-9af3-87085c2c1699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:35:22.228480 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-3f03bb06-8a9e-4f1a-9af3-87085c2c1699 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:35:22.229657 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-3f03bb06-8a9e-4f1a-9af3-87085c2c1699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:35:22.241401 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 741/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Oct 28 14:35:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:35:22.297907 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3552a0-3df5-4e13-9276-db6345e185f1 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:35:22.301057 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-7c3552a0-3df5-4e13-9276-db6345e185f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:35:22.362332 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3552a0-3df5-4e13-9276-db6345e185f1 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:35:22.366915 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e142a-b658-4e7e-a0ef-df077de39470 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:35:22.367555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e142a-b658-4e7e-a0ef-df077de39470 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:35:22.367816 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e142a-b658-4e7e-a0ef-df077de39470 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:35:22.368098 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e142a-b658-4e7e-a0ef-df077de39470 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:35:22.378218 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e142a-b658-4e7e-a0ef-df077de39470 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:35:22.379692 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e142a-b658-4e7e-a0ef-df077de39470 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:35:22.389676 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 736/1477] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:35:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:35:24.654901 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51912218-2874-4063-ad4a-b15217483e72 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:35:24.655516 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51912218-2874-4063-ad4a-b15217483e72 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:35:24.655516 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51912218-2874-4063-ad4a-b15217483e72 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:35:24.657217 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 742/1478] 127.0.0.1 () {54 vars in 916 bytes} [Thu Oct 28 14:35:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:35:24.664298 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03982b-649a-4485-9f43-f342433aa7a7 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:35:24.665058 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03982b-649a-4485-9f43-f342433aa7a7 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:35:24.665201 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03982b-649a-4485-9f43-f342433aa7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:35:24.691376 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-df03982b-649a-4485-9f43-f342433aa7a7 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:35:24.692572 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-df03982b-649a-4485-9f43-f342433aa7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:35:24.701815 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 737/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Oct 28 14:35:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:35:24.753129 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e7b02-d8ee-4331-bc36-a64ff06f6af9 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:35:24.753385 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e7b02-d8ee-4331-bc36-a64ff06f6af9 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:35:24.753671 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e7b02-d8ee-4331-bc36-a64ff06f6af9 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:35:24.755542 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 743/1480] 10.222.0.79 () {54 vars in 962 bytes} [Thu Oct 28 14:35:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:35:24.761581 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba57e3-28df-4da7-8a72-456b15c90bda None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:35:24.761876 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba57e3-28df-4da7-8a72-456b15c90bda None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:35:24.762141 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba57e3-28df-4da7-8a72-456b15c90bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:35:24.784887 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-7eba57e3-28df-4da7-8a72-456b15c90bda None None] MFA Rules not processed for user `218708788ed447499b00de12cff0f6e5`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:35:24.786078 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-7eba57e3-28df-4da7-8a72-456b15c90bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:35:24.795907 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 738/1481] 10.222.0.79 () {58 vars in 1059 bytes} [Thu Oct 28 14:35:24 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:35:24.806477 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e7b02-d8ee-4331-bc36-a64ff06f6af9 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:35:24.818456 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e7b02-d8ee-4331-bc36-a64ff06f6af9 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:35:24.822622 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274a5db-ad46-4f82-b6a9-dcb500dedc90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:35:24.823293 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274a5db-ad46-4f82-b6a9-dcb500dedc90 service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:35:24.823565 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274a5db-ad46-4f82-b6a9-dcb500dedc90 service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:35:24.823828 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274a5db-ad46-4f82-b6a9-dcb500dedc90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:35:24.833151 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274a5db-ad46-4f82-b6a9-dcb500dedc90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:35:24.834571 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274a5db-ad46-4f82-b6a9-dcb500dedc90 service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:35:24.844174 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 744/1482] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:35:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:36:48.134484 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d90ca-dba1-41c3-86d8-03d6947502e4 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:48.135435 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d90ca-dba1-41c3-86d8-03d6947502e4 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:48.135435 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d90ca-dba1-41c3-86d8-03d6947502e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:48.158450 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-e86d90ca-dba1-41c3-86d8-03d6947502e4 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:48.159539 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e86d90ca-dba1-41c3-86d8-03d6947502e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:48.172243 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 739/1483] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:36:48.181146 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63588e85-de94-40ff-9c53-b406dcc80ba4 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:48.181934 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63588e85-de94-40ff-9c53-b406dcc80ba4 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:48.181934 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63588e85-de94-40ff-9c53-b406dcc80ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:48.208896 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-63588e85-de94-40ff-9c53-b406dcc80ba4 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:48.210116 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-63588e85-de94-40ff-9c53-b406dcc80ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:48.221553 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 745/1484] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:48.226011 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d90ca-dba1-41c3-86d8-03d6947502e4 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:48.239905 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d90ca-dba1-41c3-86d8-03d6947502e4 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:48.256141 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8901c15-5d4d-405e-9068-eba841b18c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:48.256837 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8901c15-5d4d-405e-9068-eba841b18c03 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:48.257120 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8901c15-5d4d-405e-9068-eba841b18c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:48.257394 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8901c15-5d4d-405e-9068-eba841b18c03 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:48.258130 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8901c15-5d4d-405e-9068-eba841b18c03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:36:48.258437 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8901c15-5d4d-405e-9068-eba841b18c03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:48.260296 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8901c15-5d4d-405e-9068-eba841b18c03 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:48.277206 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 740/1485] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:36:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:36:48.285321 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63588e85-de94-40ff-9c53-b406dcc80ba4 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:48.294849 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63588e85-de94-40ff-9c53-b406dcc80ba4 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:48.302932 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601dcbf-10a8-4378-90eb-4068b90d75cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:48.303613 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601dcbf-10a8-4378-90eb-4068b90d75cb admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:48.303891 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601dcbf-10a8-4378-90eb-4068b90d75cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:48.304160 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601dcbf-10a8-4378-90eb-4068b90d75cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:48.304877 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601dcbf-10a8-4378-90eb-4068b90d75cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:48.306811 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601dcbf-10a8-4378-90eb-4068b90d75cb admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:48.363231 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 746/1486] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:36:48 2021] POST /identity/v3/projects => generated 391 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:36:48.367007 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8901c15-5d4d-405e-9068-eba841b18c03 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:48.377773 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8901c15-5d4d-405e-9068-eba841b18c03 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:48.460571 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290d01f-9362-43e8-9e72-4a3a7a3cb5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:48.461181 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290d01f-9362-43e8-9e72-4a3a7a3cb5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:48.461457 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290d01f-9362-43e8-9e72-4a3a7a3cb5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:48.461735 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290d01f-9362-43e8-9e72-4a3a7a3cb5f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:48.462460 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290d01f-9362-43e8-9e72-4a3a7a3cb5f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:48.464737 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290d01f-9362-43e8-9e72-4a3a7a3cb5f2 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:48.504801 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 741/1487] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:36:48 2021] POST /identity/v3/users => generated 296 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:36:48.509276 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601dcbf-10a8-4378-90eb-4068b90d75cb admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:48.520160 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601dcbf-10a8-4378-90eb-4068b90d75cb admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:48.531293 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449e64d-7aff-46e7-8062-55d02cd58049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:48.531982 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449e64d-7aff-46e7-8062-55d02cd58049 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:48.532261 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449e64d-7aff-46e7-8062-55d02cd58049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:48.532534 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449e64d-7aff-46e7-8062-55d02cd58049 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:48.533287 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449e64d-7aff-46e7-8062-55d02cd58049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:48.534934 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449e64d-7aff-46e7-8062-55d02cd58049 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:48.546386 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 747/1488] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:36:48 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:36:48.550824 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290d01f-9362-43e8-9e72-4a3a7a3cb5f2 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:48.563941 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290d01f-9362-43e8-9e72-4a3a7a3cb5f2 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:48.568722 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb167f86-1860-4fd2-8940-b4f0272cf793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:48.569397 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb167f86-1860-4fd2-8940-b4f0272cf793 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:48.569679 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb167f86-1860-4fd2-8940-b4f0272cf793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:48.569957 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb167f86-1860-4fd2-8940-b4f0272cf793 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:48.570724 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb167f86-1860-4fd2-8940-b4f0272cf793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:48.572333 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb167f86-1860-4fd2-8940-b4f0272cf793 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:48.588476 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 742/1489] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:36:48 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:36:48.592721 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449e64d-7aff-46e7-8062-55d02cd58049 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:48.603005 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449e64d-7aff-46e7-8062-55d02cd58049 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:48.610962 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55989bc2-472b-41ff-9126-df9a4326213f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:48.611873 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55989bc2-472b-41ff-9126-df9a4326213f admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:48.612161 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55989bc2-472b-41ff-9126-df9a4326213f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:48.612419 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55989bc2-472b-41ff-9126-df9a4326213f admin admin] PATH_INFO: `/v3/projects/5dda0d6d1b084868853338165ea3601d/users/1389d849e741448abf4fdebd6d30845f/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:48.632164 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55989bc2-472b-41ff-9126-df9a4326213f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dda0d6d1b084868853338165ea3601d, user_id=1389d849e741448abf4fdebd6d30845f, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:48.636618 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55989bc2-472b-41ff-9126-df9a4326213f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:48.665451 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 748/1490] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:36:48 2021] PUT /identity/v3/projects/5dda0d6d1b084868853338165ea3601d/users/1389d849e741448abf4fdebd6d30845f/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:36:48.670636 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e74f5-e730-4ef1-a276-ae98f2c8ff5f None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:48.671314 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e74f5-e730-4ef1-a276-ae98f2c8ff5f None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:48.671594 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e74f5-e730-4ef1-a276-ae98f2c8ff5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:48.695738 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-c16e74f5-e730-4ef1-a276-ae98f2c8ff5f None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:48.696952 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-c16e74f5-e730-4ef1-a276-ae98f2c8ff5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:48.768357 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 743/1491] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:48.779602 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55989bc2-472b-41ff-9126-df9a4326213f admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:48.863868 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55989bc2-472b-41ff-9126-df9a4326213f admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:48.867749 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e2121-db92-48eb-bc44-6c7ba53c17ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:48.868412 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e2121-db92-48eb-bc44-6c7ba53c17ee service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:48.868690 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e2121-db92-48eb-bc44-6c7ba53c17ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:48.868959 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e2121-db92-48eb-bc44-6c7ba53c17ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:48.878950 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e2121-db92-48eb-bc44-6c7ba53c17ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:48.880397 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e2121-db92-48eb-bc44-6c7ba53c17ee service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:48.896932 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 749/1492] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:36:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:36:49.576218 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0988ef-e14b-4bdf-a64a-7638ad104771 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:49.576706 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0988ef-e14b-4bdf-a64a-7638ad104771 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:49.576808 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0988ef-e14b-4bdf-a64a-7638ad104771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:49.580572 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6942fd-91f6-4f2b-8d7d-2fa9ff0aa630 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:49.581439 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6942fd-91f6-4f2b-8d7d-2fa9ff0aa630 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:49.589634 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6942fd-91f6-4f2b-8d7d-2fa9ff0aa630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:49.648070 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-be6942fd-91f6-4f2b-8d7d-2fa9ff0aa630 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:49.648341 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-4c0988ef-e14b-4bdf-a64a-7638ad104771 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:49.649878 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-be6942fd-91f6-4f2b-8d7d-2fa9ff0aa630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:49.650076 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-4c0988ef-e14b-4bdf-a64a-7638ad104771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:49.665748 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 744/1493] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:49.666710 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 750/1494] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:49.668938 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8d5b7-a4b6-4e96-8f19-5f7135340ba1 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:49.669701 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5ff60-ed2c-41c4-a9c9-1991221c01ca None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:49.670207 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8d5b7-a4b6-4e96-8f19-5f7135340ba1 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:49.671069 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5ff60-ed2c-41c4-a9c9-1991221c01ca None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:49.671564 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8d5b7-a4b6-4e96-8f19-5f7135340ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:49.673211 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5ff60-ed2c-41c4-a9c9-1991221c01ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:49.713014 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-aca8d5b7-a4b6-4e96-8f19-5f7135340ba1 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:49.713923 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-b0b5ff60-ed2c-41c4-a9c9-1991221c01ca None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:49.720881 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-b0b5ff60-ed2c-41c4-a9c9-1991221c01ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:49.723384 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-aca8d5b7-a4b6-4e96-8f19-5f7135340ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:49.742731 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 751/1495] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:49.745110 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554287c-b34f-4150-96c3-8644ee8060c9 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:49.746810 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554287c-b34f-4150-96c3-8644ee8060c9 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:49.747264 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554287c-b34f-4150-96c3-8644ee8060c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:49.750250 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 745/1496] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:49.752466 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d2e30-1b9e-4b4e-a2b6-13f3de9b15a3 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:49.753419 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d2e30-1b9e-4b4e-a2b6-13f3de9b15a3 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:49.754404 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d2e30-1b9e-4b4e-a2b6-13f3de9b15a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:49.810703 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-a554287c-b34f-4150-96c3-8644ee8060c9 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:49.810703 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a554287c-b34f-4150-96c3-8644ee8060c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:49.818204 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-c61d2e30-1b9e-4b4e-a2b6-13f3de9b15a3 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:49.820089 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-c61d2e30-1b9e-4b4e-a2b6-13f3de9b15a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:49.834876 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 752/1497] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:49.837473 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cc49d-7c7f-4d54-8ddb-9316ac447238 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:49.838472 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cc49d-7c7f-4d54-8ddb-9316ac447238 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:49.846298 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cc49d-7c7f-4d54-8ddb-9316ac447238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:49.858712 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 746/1498] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:49.858712 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7d369-9646-44c8-b9c9-11e4ccd675ef None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:49.858712 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7d369-9646-44c8-b9c9-11e4ccd675ef None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:49.858712 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7d369-9646-44c8-b9c9-11e4ccd675ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:49.906279 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-ca7cc49d-7c7f-4d54-8ddb-9316ac447238 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:49.909899 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-ca7cc49d-7c7f-4d54-8ddb-9316ac447238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:49.918763 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-6fd7d369-9646-44c8-b9c9-11e4ccd675ef None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:49.920558 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-6fd7d369-9646-44c8-b9c9-11e4ccd675ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:49.933766 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 753/1499] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:49.935031 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cc49d-7c7f-4d54-8ddb-9316ac447238 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:49.943313 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 747/1500] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:49.944867 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7d369-9646-44c8-b9c9-11e4ccd675ef None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:49.961229 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cc49d-7c7f-4d54-8ddb-9316ac447238 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:49.970794 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7d369-9646-44c8-b9c9-11e4ccd675ef None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:49.972281 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9ca23-88ac-4083-9b81-5f57d378abc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:49.973816 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9ca23-88ac-4083-9b81-5f57d378abc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:49.975196 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9ca23-88ac-4083-9b81-5f57d378abc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:49.975988 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9ca23-88ac-4083-9b81-5f57d378abc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:49.977527 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9ca23-88ac-4083-9b81-5f57d378abc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:36:49.978986 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9ca23-88ac-4083-9b81-5f57d378abc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:49.980788 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9ca23-88ac-4083-9b81-5f57d378abc3 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:49.982567 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b7da4-5acc-46c7-a69f-7542c9e02959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:49.983616 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b7da4-5acc-46c7-a69f-7542c9e02959 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:49.985385 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b7da4-5acc-46c7-a69f-7542c9e02959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:49.985819 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b7da4-5acc-46c7-a69f-7542c9e02959 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:49.988712 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b7da4-5acc-46c7-a69f-7542c9e02959 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:36:49.989208 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b7da4-5acc-46c7-a69f-7542c9e02959 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:49.991041 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b7da4-5acc-46c7-a69f-7542c9e02959 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:50.013292 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 754/1501] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:36:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:36:50.014645 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9ca23-88ac-4083-9b81-5f57d378abc3 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:50.023762 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 748/1502] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:36:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:36:50.025187 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b7da4-5acc-46c7-a69f-7542c9e02959 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:50.040606 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9ca23-88ac-4083-9b81-5f57d378abc3 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:50.049665 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b7da4-5acc-46c7-a69f-7542c9e02959 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:50.051610 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a54ec7-102f-4c3d-9339-7ffaf1a4f434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:50.052482 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a54ec7-102f-4c3d-9339-7ffaf1a4f434 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.055676 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a54ec7-102f-4c3d-9339-7ffaf1a4f434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.056470 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a54ec7-102f-4c3d-9339-7ffaf1a4f434 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.058792 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a54ec7-102f-4c3d-9339-7ffaf1a4f434 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:36:50.059734 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a54ec7-102f-4c3d-9339-7ffaf1a4f434 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:50.061890 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a54ec7-102f-4c3d-9339-7ffaf1a4f434 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:50.063410 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba654325-8349-42df-9f9f-7e92d5d1f745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:50.064268 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba654325-8349-42df-9f9f-7e92d5d1f745 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.065863 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba654325-8349-42df-9f9f-7e92d5d1f745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.066309 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba654325-8349-42df-9f9f-7e92d5d1f745 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.069487 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba654325-8349-42df-9f9f-7e92d5d1f745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:36:50.070011 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba654325-8349-42df-9f9f-7e92d5d1f745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:50.071836 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba654325-8349-42df-9f9f-7e92d5d1f745 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:50.089698 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 755/1503] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:36:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:36:50.091150 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03306224-90fb-449c-b70e-0d02d9f3868e None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.091510 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03306224-90fb-449c-b70e-0d02d9f3868e None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.091847 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03306224-90fb-449c-b70e-0d02d9f3868e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.092842 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 749/1504] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:36:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:36:50.093871 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba654325-8349-42df-9f9f-7e92d5d1f745 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:50.111480 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba654325-8349-42df-9f9f-7e92d5d1f745 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:50.116784 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3efc34-a236-4286-ac4a-2cd1ea5501bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:50.117724 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3efc34-a236-4286-ac4a-2cd1ea5501bb admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.119336 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3efc34-a236-4286-ac4a-2cd1ea5501bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.119336 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3efc34-a236-4286-ac4a-2cd1ea5501bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.119542 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3efc34-a236-4286-ac4a-2cd1ea5501bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:50.121761 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-03306224-90fb-449c-b70e-0d02d9f3868e None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:50.121909 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3efc34-a236-4286-ac4a-2cd1ea5501bb admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:50.123153 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-03306224-90fb-449c-b70e-0d02d9f3868e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:50.140052 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 756/1505] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:50.142515 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60265e2c-2e20-4e3a-b345-c11ced45fdd8 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.142834 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60265e2c-2e20-4e3a-b345-c11ced45fdd8 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.143100 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60265e2c-2e20-4e3a-b345-c11ced45fdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.163375 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 750/1506] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:36:50 2021] POST /identity/v3/projects => generated 387 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:36:50.163927 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-60265e2c-2e20-4e3a-b345-c11ced45fdd8 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:50.164513 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3efc34-a236-4286-ac4a-2cd1ea5501bb admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:50.165283 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-60265e2c-2e20-4e3a-b345-c11ced45fdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:50.250911 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3efc34-a236-4286-ac4a-2cd1ea5501bb admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:50.256878 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971192b9-fcb4-4ec4-b010-46667f879ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:50.257562 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971192b9-fcb4-4ec4-b010-46667f879ecf admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.258048 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971192b9-fcb4-4ec4-b010-46667f879ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.258665 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 757/1507] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:50.260223 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96502a49-773b-4d03-b226-1ad5d0c6d267 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.260602 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96502a49-773b-4d03-b226-1ad5d0c6d267 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.260971 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96502a49-773b-4d03-b226-1ad5d0c6d267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.263027 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971192b9-fcb4-4ec4-b010-46667f879ecf admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.263950 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971192b9-fcb4-4ec4-b010-46667f879ecf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:50.266029 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971192b9-fcb4-4ec4-b010-46667f879ecf admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:50.281503 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-96502a49-773b-4d03-b226-1ad5d0c6d267 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:50.283562 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-96502a49-773b-4d03-b226-1ad5d0c6d267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:50.297981 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 758/1508] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:50.299416 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96502a49-773b-4d03-b226-1ad5d0c6d267 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:50.312169 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 751/1509] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:36:50 2021] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:36:50.313287 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971192b9-fcb4-4ec4-b010-46667f879ecf admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:50.314896 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96502a49-773b-4d03-b226-1ad5d0c6d267 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:50.374148 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971192b9-fcb4-4ec4-b010-46667f879ecf admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:50.375203 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad75d0e-734b-4450-8ac6-8d0551c9dd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:50.376024 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad75d0e-734b-4450-8ac6-8d0551c9dd9e admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.376308 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad75d0e-734b-4450-8ac6-8d0551c9dd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.376580 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad75d0e-734b-4450-8ac6-8d0551c9dd9e admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.377289 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad75d0e-734b-4450-8ac6-8d0551c9dd9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:50.379225 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad75d0e-734b-4450-8ac6-8d0551c9dd9e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:50.380280 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5638c01-bc22-4582-8624-2d76bdcc5161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:50.381117 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5638c01-bc22-4582-8624-2d76bdcc5161 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.381537 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5638c01-bc22-4582-8624-2d76bdcc5161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.382009 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5638c01-bc22-4582-8624-2d76bdcc5161 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.382893 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5638c01-bc22-4582-8624-2d76bdcc5161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:50.385009 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5638c01-bc22-4582-8624-2d76bdcc5161 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:50.407651 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 759/1510] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:36:50 2021] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:36:50.408981 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94105ceb-9cdb-4005-9d07-8cd19abe2341 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.409263 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94105ceb-9cdb-4005-9d07-8cd19abe2341 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.409532 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94105ceb-9cdb-4005-9d07-8cd19abe2341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.416753 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 752/1511] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:36:50 2021] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:36:50.417816 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5638c01-bc22-4582-8624-2d76bdcc5161 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:50.432458 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-94105ceb-9cdb-4005-9d07-8cd19abe2341 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:50.433884 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-94105ceb-9cdb-4005-9d07-8cd19abe2341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:50.481458 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5638c01-bc22-4582-8624-2d76bdcc5161 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:50.486377 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0fd73-31b8-498a-b49a-ce16f1dfe29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:50.487157 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0fd73-31b8-498a-b49a-ce16f1dfe29c admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.487503 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0fd73-31b8-498a-b49a-ce16f1dfe29c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.487845 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0fd73-31b8-498a-b49a-ce16f1dfe29c admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.488650 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0fd73-31b8-498a-b49a-ce16f1dfe29c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:50.490637 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0fd73-31b8-498a-b49a-ce16f1dfe29c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:50.494825 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 760/1512] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:50.496340 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83705d-d8f6-455d-b053-9a30e925f1dd None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.496782 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83705d-d8f6-455d-b053-9a30e925f1dd None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.497061 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83705d-d8f6-455d-b053-9a30e925f1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.512312 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 753/1513] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:36:50 2021] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:36:50.513609 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d00e9-d8f3-407d-82e4-45e0a27dec22 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.513936 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d00e9-d8f3-407d-82e4-45e0a27dec22 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.514317 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d00e9-d8f3-407d-82e4-45e0a27dec22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.520109 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-4f83705d-d8f6-455d-b053-9a30e925f1dd None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:50.521315 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-4f83705d-d8f6-455d-b053-9a30e925f1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:50.529636 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 761/1514] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:50.530186 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83705d-d8f6-455d-b053-9a30e925f1dd None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:50.534949 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-a04d00e9-d8f3-407d-82e4-45e0a27dec22 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:50.536194 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-a04d00e9-d8f3-407d-82e4-45e0a27dec22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:50.540204 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83705d-d8f6-455d-b053-9a30e925f1dd None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:50.544825 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed983c34-6df0-42cd-bbb6-00b62ff86868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:50.545416 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 754/1515] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:50.545562 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed983c34-6df0-42cd-bbb6-00b62ff86868 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.546185 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed983c34-6df0-42cd-bbb6-00b62ff86868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.546466 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed983c34-6df0-42cd-bbb6-00b62ff86868 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.546626 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d00e9-d8f3-407d-82e4-45e0a27dec22 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:50.547205 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed983c34-6df0-42cd-bbb6-00b62ff86868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:50.549157 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed983c34-6df0-42cd-bbb6-00b62ff86868 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:50.559129 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d00e9-d8f3-407d-82e4-45e0a27dec22 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:50.565051 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033d45d-9e9e-4399-ad92-2811ccca6235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:50.565649 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033d45d-9e9e-4399-ad92-2811ccca6235 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.566053 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033d45d-9e9e-4399-ad92-2811ccca6235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.566247 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033d45d-9e9e-4399-ad92-2811ccca6235 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.566988 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033d45d-9e9e-4399-ad92-2811ccca6235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:50.568941 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033d45d-9e9e-4399-ad92-2811ccca6235 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:50.574214 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 762/1516] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:36:50 2021] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:36:50.574214 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed983c34-6df0-42cd-bbb6-00b62ff86868 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:50.584968 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed983c34-6df0-42cd-bbb6-00b62ff86868 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:50.591556 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a159de-646f-4db0-a8b5-0f699139e8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:50.591836 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 755/1517] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:36:50 2021] POST /identity/v3/users => generated 292 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:36:50.592286 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a159de-646f-4db0-a8b5-0f699139e8ff admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.592495 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a159de-646f-4db0-a8b5-0f699139e8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.592766 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a159de-646f-4db0-a8b5-0f699139e8ff admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.593480 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a159de-646f-4db0-a8b5-0f699139e8ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:50.593789 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033d45d-9e9e-4399-ad92-2811ccca6235 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:50.595639 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a159de-646f-4db0-a8b5-0f699139e8ff admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:50.604301 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033d45d-9e9e-4399-ad92-2811ccca6235 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:50.609773 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f6278-11a9-4cd0-93a1-e06837f566ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:50.610774 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f6278-11a9-4cd0-93a1-e06837f566ab admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.610774 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f6278-11a9-4cd0-93a1-e06837f566ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.611039 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f6278-11a9-4cd0-93a1-e06837f566ab admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.611969 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f6278-11a9-4cd0-93a1-e06837f566ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:36:50.612187 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f6278-11a9-4cd0-93a1-e06837f566ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:50.613849 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f6278-11a9-4cd0-93a1-e06837f566ab admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:50.622089 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 763/1518] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:36:50 2021] POST /identity/v3/users => generated 288 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:36:50.622089 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a159de-646f-4db0-a8b5-0f699139e8ff admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:50.629291 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a159de-646f-4db0-a8b5-0f699139e8ff admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:50.631812 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 756/1519] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:36:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:36:50.633386 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f6278-11a9-4cd0-93a1-e06837f566ab admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:50.634126 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7b2a2-2d1a-4d3a-9d00-89e97af09baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:50.634897 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7b2a2-2d1a-4d3a-9d00-89e97af09baa admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.635180 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7b2a2-2d1a-4d3a-9d00-89e97af09baa admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.635457 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7b2a2-2d1a-4d3a-9d00-89e97af09baa admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.636252 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7b2a2-2d1a-4d3a-9d00-89e97af09baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:50.637873 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7b2a2-2d1a-4d3a-9d00-89e97af09baa admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:50.645228 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f6278-11a9-4cd0-93a1-e06837f566ab admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:50.649657 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 764/1520] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:36:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:36:50.650474 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7b2a2-2d1a-4d3a-9d00-89e97af09baa admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:50.653446 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750e8ac-433f-4a35-9bbe-d5b7aed7b0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:50.654126 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750e8ac-433f-4a35-9bbe-d5b7aed7b0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.654395 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750e8ac-433f-4a35-9bbe-d5b7aed7b0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.654671 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750e8ac-433f-4a35-9bbe-d5b7aed7b0e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.655432 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750e8ac-433f-4a35-9bbe-d5b7aed7b0e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:36:50.655740 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750e8ac-433f-4a35-9bbe-d5b7aed7b0e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:50.657329 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750e8ac-433f-4a35-9bbe-d5b7aed7b0e0 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:50.663155 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7b2a2-2d1a-4d3a-9d00-89e97af09baa admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:50.668798 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e7551-996d-494d-b859-2e9cc99eac7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:50.669450 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e7551-996d-494d-b859-2e9cc99eac7b admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.669564 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 757/1521] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:36:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:36:50.669815 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e7551-996d-494d-b859-2e9cc99eac7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.669964 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e7551-996d-494d-b859-2e9cc99eac7b admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.670501 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750e8ac-433f-4a35-9bbe-d5b7aed7b0e0 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:50.671539 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e7551-996d-494d-b859-2e9cc99eac7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:36:50.671886 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e7551-996d-494d-b859-2e9cc99eac7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:50.673412 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e7551-996d-494d-b859-2e9cc99eac7b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:50.680912 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750e8ac-433f-4a35-9bbe-d5b7aed7b0e0 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:50.685673 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34ecbc-cc99-42f5-a41a-837273458487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:50.685815 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 765/1522] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:36:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:36:50.686336 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34ecbc-cc99-42f5-a41a-837273458487 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.686557 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e7551-996d-494d-b859-2e9cc99eac7b admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:50.686662 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34ecbc-cc99-42f5-a41a-837273458487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.686929 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34ecbc-cc99-42f5-a41a-837273458487 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.687668 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34ecbc-cc99-42f5-a41a-837273458487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:50.689265 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34ecbc-cc99-42f5-a41a-837273458487 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:50.700104 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 758/1523] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:36:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:36:50.701122 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34ecbc-cc99-42f5-a41a-837273458487 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:50.701781 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e7551-996d-494d-b859-2e9cc99eac7b admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:50.706848 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c19e8-ef6b-4bc3-81e2-30bcbd0a52e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:50.707516 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c19e8-ef6b-4bc3-81e2-30bcbd0a52e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.707794 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c19e8-ef6b-4bc3-81e2-30bcbd0a52e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.708065 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c19e8-ef6b-4bc3-81e2-30bcbd0a52e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.709001 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c19e8-ef6b-4bc3-81e2-30bcbd0a52e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:50.710412 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c19e8-ef6b-4bc3-81e2-30bcbd0a52e7 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:50.712827 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34ecbc-cc99-42f5-a41a-837273458487 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:50.717582 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dd89c-3a60-4b50-a91d-7a2d4f8cc5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:50.718369 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dd89c-3a60-4b50-a91d-7a2d4f8cc5ff admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.718655 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dd89c-3a60-4b50-a91d-7a2d4f8cc5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.718963 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dd89c-3a60-4b50-a91d-7a2d4f8cc5ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.719706 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598dd89c-3a60-4b50-a91d-7a2d4f8cc5ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:50.720782 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 766/1524] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:36:50 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:36:50.721291 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598dd89c-3a60-4b50-a91d-7a2d4f8cc5ff admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:50.724823 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c19e8-ef6b-4bc3-81e2-30bcbd0a52e7 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:50.733555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 759/1525] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:36:50 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:36:50.734446 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dd89c-3a60-4b50-a91d-7a2d4f8cc5ff admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:50.737533 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c19e8-ef6b-4bc3-81e2-30bcbd0a52e7 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:50.743284 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeaf0ca-316d-47eb-b0c6-906c81b80d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:50.744067 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeaf0ca-316d-47eb-b0c6-906c81b80d3e admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.744481 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeaf0ca-316d-47eb-b0c6-906c81b80d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.744731 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dd89c-3a60-4b50-a91d-7a2d4f8cc5ff admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:50.745046 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeaf0ca-316d-47eb-b0c6-906c81b80d3e admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.746009 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeaf0ca-316d-47eb-b0c6-906c81b80d3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:50.748112 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeaf0ca-316d-47eb-b0c6-906c81b80d3e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:50.753103 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b507cf2-7ca7-446f-82a6-52d8c361a700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:50.753786 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b507cf2-7ca7-446f-82a6-52d8c361a700 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.754068 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b507cf2-7ca7-446f-82a6-52d8c361a700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.754339 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b507cf2-7ca7-446f-82a6-52d8c361a700 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.755127 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b507cf2-7ca7-446f-82a6-52d8c361a700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:50.756755 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b507cf2-7ca7-446f-82a6-52d8c361a700 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:50.767169 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 760/1526] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:36:50 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:36:50.768047 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b507cf2-7ca7-446f-82a6-52d8c361a700 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:50.778226 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b507cf2-7ca7-446f-82a6-52d8c361a700 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:50.780589 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 767/1527] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:36:50 2021] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:36:50.781576 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeaf0ca-316d-47eb-b0c6-906c81b80d3e admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:50.839301 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe16e65-7c35-4b01-85fe-ec15a0756f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:50.840014 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe16e65-7c35-4b01-85fe-ec15a0756f8d admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.840355 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe16e65-7c35-4b01-85fe-ec15a0756f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.840635 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe16e65-7c35-4b01-85fe-ec15a0756f8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.841521 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe16e65-7c35-4b01-85fe-ec15a0756f8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:50.843479 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe16e65-7c35-4b01-85fe-ec15a0756f8d admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:50.850437 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeaf0ca-316d-47eb-b0c6-906c81b80d3e admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:50.855576 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1b5ae-393a-4492-aa51-4813eed902ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:50.856295 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1b5ae-393a-4492-aa51-4813eed902ee admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.856575 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1b5ae-393a-4492-aa51-4813eed902ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.856849 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1b5ae-393a-4492-aa51-4813eed902ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.857553 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1b5ae-393a-4492-aa51-4813eed902ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:50.859736 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1b5ae-393a-4492-aa51-4813eed902ee admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:50.870471 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 761/1528] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:36:50 2021] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:36:50.871399 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe16e65-7c35-4b01-85fe-ec15a0756f8d admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:50.888860 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 768/1529] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:36:50 2021] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:36:50.888860 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1b5ae-393a-4492-aa51-4813eed902ee admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:50.937759 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe16e65-7c35-4b01-85fe-ec15a0756f8d admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:50.962628 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1b5ae-393a-4492-aa51-4813eed902ee admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:50.969913 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e1a85-3852-4633-8d2b-f852cd2b7f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:50.970599 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e1a85-3852-4633-8d2b-f852cd2b7f49 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:50.970904 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e1a85-3852-4633-8d2b-f852cd2b7f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:50.971169 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e1a85-3852-4633-8d2b-f852cd2b7f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:50.971916 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e1a85-3852-4633-8d2b-f852cd2b7f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:50.973538 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e1a85-3852-4633-8d2b-f852cd2b7f49 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:50.987303 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 769/1530] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:36:50 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:36:50.987303 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e1a85-3852-4633-8d2b-f852cd2b7f49 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:50.995105 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e1a85-3852-4633-8d2b-f852cd2b7f49 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:51.001570 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2dd90e-5723-4beb-9da4-c342e0d0f8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:51.002338 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2dd90e-5723-4beb-9da4-c342e0d0f8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:51.002848 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2dd90e-5723-4beb-9da4-c342e0d0f8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:51.003188 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2dd90e-5723-4beb-9da4-c342e0d0f8c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:51.004006 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2dd90e-5723-4beb-9da4-c342e0d0f8c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:51.005951 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2dd90e-5723-4beb-9da4-c342e0d0f8c8 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:51.007195 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22152292-4e79-400e-a2b8-df365f13c4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:51.008716 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22152292-4e79-400e-a2b8-df365f13c4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:51.009642 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22152292-4e79-400e-a2b8-df365f13c4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:51.010153 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22152292-4e79-400e-a2b8-df365f13c4c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:51.011253 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22152292-4e79-400e-a2b8-df365f13c4c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:51.013726 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22152292-4e79-400e-a2b8-df365f13c4c6 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:51.018821 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 762/1531] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:36:50 2021] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:36:51.019955 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2dd90e-5723-4beb-9da4-c342e0d0f8c8 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:51.029354 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 770/1532] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:36:50 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:36:51.033578 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22152292-4e79-400e-a2b8-df365f13c4c6 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:51.033931 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2dd90e-5723-4beb-9da4-c342e0d0f8c8 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:51.040148 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23930a68-290a-40da-b6d7-016aafd3fb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:51.043320 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23930a68-290a-40da-b6d7-016aafd3fb52 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:51.043320 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23930a68-290a-40da-b6d7-016aafd3fb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:51.043320 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23930a68-290a-40da-b6d7-016aafd3fb52 admin admin] PATH_INFO: `/v3/projects/89fb273f901845daa8cf52ed4beefe1d/users/8b1e077f454b471ba851db9431f1011d/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:51.046847 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22152292-4e79-400e-a2b8-df365f13c4c6 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:51.057446 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f5c2b-be9e-4675-abaa-771e22844f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:51.058462 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f5c2b-be9e-4675-abaa-771e22844f6e admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:51.058913 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f5c2b-be9e-4675-abaa-771e22844f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:51.059259 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f5c2b-be9e-4675-abaa-771e22844f6e admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:51.060166 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f5c2b-be9e-4675-abaa-771e22844f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:51.061430 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23930a68-290a-40da-b6d7-016aafd3fb52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89fb273f901845daa8cf52ed4beefe1d, user_id=8b1e077f454b471ba851db9431f1011d, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:51.062517 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f5c2b-be9e-4675-abaa-771e22844f6e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:51.064178 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23930a68-290a-40da-b6d7-016aafd3fb52 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:51.078956 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 763/1533] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:36:51 2021] PUT /identity/v3/projects/89fb273f901845daa8cf52ed4beefe1d/users/8b1e077f454b471ba851db9431f1011d/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:36:51.083374 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23930a68-290a-40da-b6d7-016aafd3fb52 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:51.085611 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 771/1534] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:36:51 2021] POST /identity/v3/users => generated 292 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:36:51.086468 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f5c2b-be9e-4675-abaa-771e22844f6e admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:51.096437 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f5c2b-be9e-4675-abaa-771e22844f6e admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:51.148662 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23930a68-290a-40da-b6d7-016aafd3fb52 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:51.153460 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656be71-350d-491a-bfff-51ed956ea38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:51.154308 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656be71-350d-491a-bfff-51ed956ea38c admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:51.154542 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656be71-350d-491a-bfff-51ed956ea38c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:51.154908 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656be71-350d-491a-bfff-51ed956ea38c admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:51.155670 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656be71-350d-491a-bfff-51ed956ea38c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:51.157649 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656be71-350d-491a-bfff-51ed956ea38c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:51.163636 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a84e1-470d-4155-8a73-9312806c5525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:51.164598 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a84e1-470d-4155-8a73-9312806c5525 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:51.164876 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a84e1-470d-4155-8a73-9312806c5525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:51.165152 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a84e1-470d-4155-8a73-9312806c5525 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:51.165857 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a84e1-470d-4155-8a73-9312806c5525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:51.167803 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a84e1-470d-4155-8a73-9312806c5525 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:51.181462 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 764/1535] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:36:51 2021] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:36:51.182597 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656be71-350d-491a-bfff-51ed956ea38c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:51.199158 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 772/1536] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:36:51 2021] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:36:51.200291 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a84e1-470d-4155-8a73-9312806c5525 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:51.203276 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656be71-350d-491a-bfff-51ed956ea38c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:51.208748 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab68a9-04da-4c01-ae7f-52030b98896f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:51.209657 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab68a9-04da-4c01-ae7f-52030b98896f admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:51.209931 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab68a9-04da-4c01-ae7f-52030b98896f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:51.210199 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab68a9-04da-4c01-ae7f-52030b98896f admin admin] PATH_INFO: `/v3/projects/9c4c6edcf3d040c89e37d0fbdea5c822/users/ce2e58e898cd4b27a2ed175e83cb54ea/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:51.213608 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a84e1-470d-4155-8a73-9312806c5525 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:51.220144 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7280cbc-1be5-4127-9a4e-c38b86fec094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:51.221056 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7280cbc-1be5-4127-9a4e-c38b86fec094 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:51.221335 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7280cbc-1be5-4127-9a4e-c38b86fec094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:51.221630 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7280cbc-1be5-4127-9a4e-c38b86fec094 admin admin] PATH_INFO: `/v3/projects/9d82e2b8f43e4ae1ac9d7014a692ee64/users/1fe4b8bb46f14e1a82728e66f8d27746/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:51.227493 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab68a9-04da-4c01-ae7f-52030b98896f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4c6edcf3d040c89e37d0fbdea5c822, user_id=ce2e58e898cd4b27a2ed175e83cb54ea, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:51.230256 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab68a9-04da-4c01-ae7f-52030b98896f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:51.239347 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7280cbc-1be5-4127-9a4e-c38b86fec094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d82e2b8f43e4ae1ac9d7014a692ee64, user_id=1fe4b8bb46f14e1a82728e66f8d27746, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:51.242249 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7280cbc-1be5-4127-9a4e-c38b86fec094 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:51.247823 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 765/1537] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:36:51 2021] PUT /identity/v3/projects/9c4c6edcf3d040c89e37d0fbdea5c822/users/ce2e58e898cd4b27a2ed175e83cb54ea/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:36:51.248763 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab68a9-04da-4c01-ae7f-52030b98896f admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:51.263037 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 773/1538] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:36:51 2021] PUT /identity/v3/projects/9d82e2b8f43e4ae1ac9d7014a692ee64/users/1fe4b8bb46f14e1a82728e66f8d27746/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:36:51.264361 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d903d7e-4c0d-420f-84fd-b3b70ee76a77 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:51.264657 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d903d7e-4c0d-420f-84fd-b3b70ee76a77 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:51.264919 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d903d7e-4c0d-420f-84fd-b3b70ee76a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:51.282181 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-8d903d7e-4c0d-420f-84fd-b3b70ee76a77 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:51.283426 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-8d903d7e-4c0d-420f-84fd-b3b70ee76a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:51.316325 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab68a9-04da-4c01-ae7f-52030b98896f admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:51.345062 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 774/1539] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:51.348488 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d903d7e-4c0d-420f-84fd-b3b70ee76a77 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:51.362050 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d903d7e-4c0d-420f-84fd-b3b70ee76a77 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:51.367034 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286aa16-0ed7-402b-9a79-8ba816844045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:51.367801 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286aa16-0ed7-402b-9a79-8ba816844045 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:51.368149 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286aa16-0ed7-402b-9a79-8ba816844045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:51.368517 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286aa16-0ed7-402b-9a79-8ba816844045 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:51.369357 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1286aa16-0ed7-402b-9a79-8ba816844045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:51.371204 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1286aa16-0ed7-402b-9a79-8ba816844045 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:51.376264 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8aa81-e473-4732-a319-8595d019f67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:51.377170 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8aa81-e473-4732-a319-8595d019f67f admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:51.377447 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8aa81-e473-4732-a319-8595d019f67f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:51.377720 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8aa81-e473-4732-a319-8595d019f67f admin admin] PATH_INFO: `/v3/projects/9e334a6e70ac4c2a882f287ce31d287e/users/fb71aef5ce61461b9c92f8bf4869af1d/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:51.385010 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 775/1540] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:36:51 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:36:51.385010 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286aa16-0ed7-402b-9a79-8ba816844045 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:51.393086 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8aa81-e473-4732-a319-8595d019f67f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e334a6e70ac4c2a882f287ce31d287e, user_id=fb71aef5ce61461b9c92f8bf4869af1d, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:51.394836 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286aa16-0ed7-402b-9a79-8ba816844045 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:51.396028 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8aa81-e473-4732-a319-8595d019f67f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:51.399636 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a279b3-290a-4584-833e-77b43089690f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:51.400271 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a279b3-290a-4584-833e-77b43089690f admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:51.400515 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a279b3-290a-4584-833e-77b43089690f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:51.400784 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a279b3-290a-4584-833e-77b43089690f admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:51.401556 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a279b3-290a-4584-833e-77b43089690f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:51.403439 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a279b3-290a-4584-833e-77b43089690f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:51.411752 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 766/1541] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:36:51 2021] PUT /identity/v3/projects/9e334a6e70ac4c2a882f287ce31d287e/users/fb71aef5ce61461b9c92f8bf4869af1d/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:36:51.415639 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 776/1542] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:36:51 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:36:51.415793 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a02708-b483-4184-a31c-f2e80a591680 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:51.416275 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a02708-b483-4184-a31c-f2e80a591680 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:51.416384 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a02708-b483-4184-a31c-f2e80a591680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:51.417238 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8aa81-e473-4732-a319-8595d019f67f admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:51.442520 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-74a02708-b483-4184-a31c-f2e80a591680 None None] MFA Rules not processed for user `ce2e58e898cd4b27a2ed175e83cb54ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:51.444110 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-74a02708-b483-4184-a31c-f2e80a591680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:51.482948 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8aa81-e473-4732-a319-8595d019f67f admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:51.487584 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d0605-2ef3-42d1-8660-edf366d45e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:51.488260 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d0605-2ef3-42d1-8660-edf366d45e7d admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:51.488540 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d0605-2ef3-42d1-8660-edf366d45e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:51.488810 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d0605-2ef3-42d1-8660-edf366d45e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:51.489560 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d0605-2ef3-42d1-8660-edf366d45e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:51.491461 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d0605-2ef3-42d1-8660-edf366d45e7d admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:51.504672 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 767/1543] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:36:51 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:36:51.504672 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd533b6-96c2-4578-990b-7256dfbda18c None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:51.504672 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd533b6-96c2-4578-990b-7256dfbda18c None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:51.504672 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd533b6-96c2-4578-990b-7256dfbda18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:51.515617 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 777/1544] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:51 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:51.515617 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a02708-b483-4184-a31c-f2e80a591680 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:51.525570 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-6cd533b6-96c2-4578-990b-7256dfbda18c None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:51.527369 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-6cd533b6-96c2-4578-990b-7256dfbda18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:51.541427 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 768/1545] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:51.543658 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd533b6-96c2-4578-990b-7256dfbda18c None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:51.555099 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd533b6-96c2-4578-990b-7256dfbda18c None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:51.560970 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ff1ac-0b4c-4f03-978b-03bb5febdf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:51.561821 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ff1ac-0b4c-4f03-978b-03bb5febdf7e admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:51.562244 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ff1ac-0b4c-4f03-978b-03bb5febdf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:51.563075 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ff1ac-0b4c-4f03-978b-03bb5febdf7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:51.563848 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ff1ac-0b4c-4f03-978b-03bb5febdf7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:51.565583 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ff1ac-0b4c-4f03-978b-03bb5febdf7e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:51.575969 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 769/1546] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:36:51 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:36:51.577167 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9de30-95e1-44ab-b9ff-b791f48203b8 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:51.577449 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9de30-95e1-44ab-b9ff-b791f48203b8 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:51.577722 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9de30-95e1-44ab-b9ff-b791f48203b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:51.582764 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a02708-b483-4184-a31c-f2e80a591680 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:51.586446 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b54c1c-61cb-4a5b-8134-63acb0f4ad10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:51.587307 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b54c1c-61cb-4a5b-8134-63acb0f4ad10 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:51.587688 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b54c1c-61cb-4a5b-8134-63acb0f4ad10 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:51.588060 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b54c1c-61cb-4a5b-8134-63acb0f4ad10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:51.596162 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-36a9de30-95e1-44ab-b9ff-b791f48203b8 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:51.597335 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-36a9de30-95e1-44ab-b9ff-b791f48203b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:51.598357 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b54c1c-61cb-4a5b-8134-63acb0f4ad10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:51.599944 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b54c1c-61cb-4a5b-8134-63acb0f4ad10 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:51.608612 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 770/1547] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:51.608612 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9de30-95e1-44ab-b9ff-b791f48203b8 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:51.610503 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 778/1548] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:36:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:36:51.611388 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b54c1c-61cb-4a5b-8134-63acb0f4ad10 service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:51.622506 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b54c1c-61cb-4a5b-8134-63acb0f4ad10 service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:51.628785 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805fad2-85d3-4eef-b55d-abe9a415439a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:51.629314 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9de30-95e1-44ab-b9ff-b791f48203b8 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:51.630407 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805fad2-85d3-4eef-b55d-abe9a415439a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:51.631000 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805fad2-85d3-4eef-b55d-abe9a415439a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:51.631742 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805fad2-85d3-4eef-b55d-abe9a415439a admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:51.633136 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805fad2-85d3-4eef-b55d-abe9a415439a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:51.635395 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805fad2-85d3-4eef-b55d-abe9a415439a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:51.636496 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dd52b-9157-4af5-9fd0-e95550369a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:51.637629 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dd52b-9157-4af5-9fd0-e95550369a17 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:51.638270 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dd52b-9157-4af5-9fd0-e95550369a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:51.638872 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dd52b-9157-4af5-9fd0-e95550369a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:51.640024 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2dd52b-9157-4af5-9fd0-e95550369a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:51.642193 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2dd52b-9157-4af5-9fd0-e95550369a17 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:51.648610 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 779/1549] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:36:51 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:36:51.653851 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddd1c8-aad3-433a-bffd-e169b534d8d4 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:51.654137 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddd1c8-aad3-433a-bffd-e169b534d8d4 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:51.654408 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddd1c8-aad3-433a-bffd-e169b534d8d4 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:51.656249 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 780/1550] 10.222.0.79 () {54 vars in 960 bytes} [Thu Oct 28 14:36:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:36:51.660924 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 771/1551] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:36:51 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:36:51.662062 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dd52b-9157-4af5-9fd0-e95550369a17 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:51.662434 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddd1c8-aad3-433a-bffd-e169b534d8d4 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:51.664556 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a0ddd1c8-aad3-433a-bffd-e169b534d8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:51.674189 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dd52b-9157-4af5-9fd0-e95550369a17 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:51.680058 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddd1c8-aad3-433a-bffd-e169b534d8d4 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:51.680399 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068d78e-31e0-4c0b-9235-b620a2ff87b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:51.681685 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068d78e-31e0-4c0b-9235-b620a2ff87b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:51.682070 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068d78e-31e0-4c0b-9235-b620a2ff87b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:51.682447 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068d78e-31e0-4c0b-9235-b620a2ff87b6 admin admin] PATH_INFO: `/v3/projects/568d16c23053469dad2cfede8da540d0/users/478109e21b1a4f3cb9690aed2d967faa/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:51.684156 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb1f14-270f-474d-a64b-e72dfc8e6bc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:51.684990 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb1f14-270f-474d-a64b-e72dfc8e6bc0 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:51.685267 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb1f14-270f-474d-a64b-e72dfc8e6bc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:51.685538 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb1f14-270f-474d-a64b-e72dfc8e6bc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:51.697998 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb1f14-270f-474d-a64b-e72dfc8e6bc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:51.699483 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb1f14-270f-474d-a64b-e72dfc8e6bc0 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:51.705424 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068d78e-31e0-4c0b-9235-b620a2ff87b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=568d16c23053469dad2cfede8da540d0, user_id=478109e21b1a4f3cb9690aed2d967faa, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:51.707904 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068d78e-31e0-4c0b-9235-b620a2ff87b6 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:51.713129 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 781/1552] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:36:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:36:51.714065 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb1f14-270f-474d-a64b-e72dfc8e6bc0 service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:51.722772 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb1f14-270f-474d-a64b-e72dfc8e6bc0 service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:51.728814 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 772/1553] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:36:51 2021] PUT /identity/v3/projects/568d16c23053469dad2cfede8da540d0/users/478109e21b1a4f3cb9690aed2d967faa/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:36:51.730261 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068d78e-31e0-4c0b-9235-b620a2ff87b6 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:51.830972 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d1e50-c0b8-415b-98b9-3e5b75299cf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:51.831751 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d1e50-c0b8-415b-98b9-3e5b75299cf3 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:51.832769 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d1e50-c0b8-415b-98b9-3e5b75299cf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:51.833113 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d1e50-c0b8-415b-98b9-3e5b75299cf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:51.885055 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068d78e-31e0-4c0b-9235-b620a2ff87b6 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:51.901697 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be8813-5e4e-4973-b6c7-3cc37a02dee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:51.903075 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be8813-5e4e-4973-b6c7-3cc37a02dee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:51.903559 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be8813-5e4e-4973-b6c7-3cc37a02dee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:51.904064 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be8813-5e4e-4973-b6c7-3cc37a02dee1 admin admin] PATH_INFO: `/v3/projects/a831c7f0645c4f14b50eef0b24792fa1/users/d2800047e9df40fe808c13deb56b0f99/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:51.936284 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be8813-5e4e-4973-b6c7-3cc37a02dee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a831c7f0645c4f14b50eef0b24792fa1, user_id=d2800047e9df40fe808c13deb56b0f99, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:51.943166 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be8813-5e4e-4973-b6c7-3cc37a02dee1 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:51.968959 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 773/1554] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:36:51 2021] PUT /identity/v3/projects/a831c7f0645c4f14b50eef0b24792fa1/users/d2800047e9df40fe808c13deb56b0f99/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:36:51.971512 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be8813-5e4e-4973-b6c7-3cc37a02dee1 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:51.991349 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d1e50-c0b8-415b-98b9-3e5b75299cf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:51.994188 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d1e50-c0b8-415b-98b9-3e5b75299cf3 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:52.018491 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 782/1555] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:36:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:36:52.020129 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbc3e6-8996-4546-87ff-de881171c39d None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:52.022347 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbc3e6-8996-4546-87ff-de881171c39d None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:52.022772 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbc3e6-8996-4546-87ff-de881171c39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:52.075277 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-44fbc3e6-8996-4546-87ff-de881171c39d None None] MFA Rules not processed for user `18cd6636ae7847c78be910824410d295`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:52.077251 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-44fbc3e6-8996-4546-87ff-de881171c39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:52.105402 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be8813-5e4e-4973-b6c7-3cc37a02dee1 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:52.117348 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6009e-02a4-4258-9b48-26b801e40256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:52.118333 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6009e-02a4-4258-9b48-26b801e40256 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:52.118625 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6009e-02a4-4258-9b48-26b801e40256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:52.118948 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6009e-02a4-4258-9b48-26b801e40256 admin admin] PATH_INFO: `/v3/projects/96080e48afc7493f8daee47d749b3698/users/7c4f9bb3753a4db3929bf8a4345e2b83/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:52.150928 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6009e-02a4-4258-9b48-26b801e40256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96080e48afc7493f8daee47d749b3698, user_id=7c4f9bb3753a4db3929bf8a4345e2b83, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:52.159248 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6009e-02a4-4258-9b48-26b801e40256 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:52.188965 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 774/1556] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:36:51 2021] PUT /identity/v3/projects/96080e48afc7493f8daee47d749b3698/users/7c4f9bb3753a4db3929bf8a4345e2b83/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:36:52.198991 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9083e3-fe4b-42c1-9ee7-fafd6c2ac394 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:52.198991 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9083e3-fe4b-42c1-9ee7-fafd6c2ac394 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:52.198991 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9083e3-fe4b-42c1-9ee7-fafd6c2ac394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:52.231510 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-af9083e3-fe4b-42c1-9ee7-fafd6c2ac394 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:52.232808 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-af9083e3-fe4b-42c1-9ee7-fafd6c2ac394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:52.239687 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 783/1557] 10.222.0.79 () {58 vars in 1057 bytes} [Thu Oct 28 14:36:52 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:52.242216 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e78d3-98a0-4d7c-9829-1ea3b3f5eb75 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:52.242695 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e78d3-98a0-4d7c-9829-1ea3b3f5eb75 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:52.243121 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e78d3-98a0-4d7c-9829-1ea3b3f5eb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:52.276779 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-3c0e78d3-98a0-4d7c-9829-1ea3b3f5eb75 None None] MFA Rules not processed for user `d2800047e9df40fe808c13deb56b0f99`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:52.278912 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-3c0e78d3-98a0-4d7c-9829-1ea3b3f5eb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:52.406106 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 775/1558] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:52.410127 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da312b84-9ae6-4f27-bb49-fbc7b4735f84 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:52.410354 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da312b84-9ae6-4f27-bb49-fbc7b4735f84 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:52.412799 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da312b84-9ae6-4f27-bb49-fbc7b4735f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:52.453778 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 784/1559] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:52 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:52.455328 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e78d3-98a0-4d7c-9829-1ea3b3f5eb75 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:52.491871 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-da312b84-9ae6-4f27-bb49-fbc7b4735f84 None None] MFA Rules not processed for user `7c4f9bb3753a4db3929bf8a4345e2b83`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:52.493596 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-da312b84-9ae6-4f27-bb49-fbc7b4735f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:52.614646 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 776/1560] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:52 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:52.618801 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da312b84-9ae6-4f27-bb49-fbc7b4735f84 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:52.642628 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e78d3-98a0-4d7c-9829-1ea3b3f5eb75 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:52.651451 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e243085-a27d-490a-a683-08b80f191142 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:52.653441 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e243085-a27d-490a-a683-08b80f191142 service nova] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:52.654106 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e243085-a27d-490a-a683-08b80f191142 service nova] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:52.655757 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e243085-a27d-490a-a683-08b80f191142 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:52.734044 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e243085-a27d-490a-a683-08b80f191142 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:52.737618 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e243085-a27d-490a-a683-08b80f191142 service nova] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:52.741547 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da312b84-9ae6-4f27-bb49-fbc7b4735f84 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:52.752992 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d88596-187e-4b60-89c4-c9478c65877a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:52.753680 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d88596-187e-4b60-89c4-c9478c65877a service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:52.753994 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d88596-187e-4b60-89c4-c9478c65877a service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:52.754229 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d88596-187e-4b60-89c4-c9478c65877a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:52.771817 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 785/1561] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:36:52 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:36:52.772095 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d88596-187e-4b60-89c4-c9478c65877a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:52.773460 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d88596-187e-4b60-89c4-c9478c65877a service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:52.774323 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a0125-e191-45a8-880f-e39acf3aa79d None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:52.774913 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a0125-e191-45a8-880f-e39acf3aa79d None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:52.775819 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a0125-e191-45a8-880f-e39acf3aa79d None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:52.778566 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 786/1562] 10.222.0.79 () {54 vars in 960 bytes} [Thu Oct 28 14:36:52 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:36:52.788656 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a0125-e191-45a8-880f-e39acf3aa79d None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:52.799265 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 777/1563] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:36:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:36:52.800931 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c30d7b-ce0b-4d8d-84b6-ac0c40e4754b None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:52.800931 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c30d7b-ce0b-4d8d-84b6-ac0c40e4754b None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:52.801167 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c30d7b-ce0b-4d8d-84b6-ac0c40e4754b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:52.808594 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a0125-e191-45a8-880f-e39acf3aa79d None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:52.815439 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddd303-bda4-46d8-aa99-dff63b26f4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:52.816973 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddd303-bda4-46d8-aa99-dff63b26f4e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:52.818057 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddd303-bda4-46d8-aa99-dff63b26f4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:52.818731 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddd303-bda4-46d8-aa99-dff63b26f4e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:52.820153 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddd303-bda4-46d8-aa99-dff63b26f4e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:52.823241 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddd303-bda4-46d8-aa99-dff63b26f4e4 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:52.848963 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-a5c30d7b-ce0b-4d8d-84b6-ac0c40e4754b None None] MFA Rules not processed for user `18cd6636ae7847c78be910824410d295`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:52.852469 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-a5c30d7b-ce0b-4d8d-84b6-ac0c40e4754b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:52.878896 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 787/1564] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:36:52 2021] POST /identity/v3/projects => generated 365 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:36:52.880051 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddd303-bda4-46d8-aa99-dff63b26f4e4 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:52.889936 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 778/1565] 10.222.0.79 () {58 vars in 1057 bytes} [Thu Oct 28 14:36:52 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:52.907135 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c30d7b-ce0b-4d8d-84b6-ac0c40e4754b None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:52.930838 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c30d7b-ce0b-4d8d-84b6-ac0c40e4754b None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:53.033122 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddd303-bda4-46d8-aa99-dff63b26f4e4 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:53.060784 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdd284-f79e-434d-930c-28cdad7f7f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:53.061665 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdd284-f79e-434d-930c-28cdad7f7f9e admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:53.061945 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdd284-f79e-434d-930c-28cdad7f7f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:53.062215 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdd284-f79e-434d-930c-28cdad7f7f9e admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:53.064498 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cdd284-f79e-434d-930c-28cdad7f7f9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:53.072177 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cdd284-f79e-434d-930c-28cdad7f7f9e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:53.092490 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d561af-941c-4351-9595-064a860c5c07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:53.093177 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d561af-941c-4351-9595-064a860c5c07 service nova] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:53.093454 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d561af-941c-4351-9595-064a860c5c07 service nova] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:53.093726 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d561af-941c-4351-9595-064a860c5c07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:53.123503 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 788/1566] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:36:52 2021] POST /identity/v3/users => generated 289 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:36:53.131691 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdd284-f79e-434d-930c-28cdad7f7f9e admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:53.149767 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdd284-f79e-434d-930c-28cdad7f7f9e admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:53.165152 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4f864-0950-4d83-99b1-20b40e511cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:53.166045 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4f864-0950-4d83-99b1-20b40e511cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:53.167370 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4f864-0950-4d83-99b1-20b40e511cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:53.168629 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4f864-0950-4d83-99b1-20b40e511cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:53.169976 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4f864-0950-4d83-99b1-20b40e511cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:53.176191 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4f864-0950-4d83-99b1-20b40e511cc9 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:53.217888 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 789/1567] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:36:53 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:36:53.218737 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d561af-941c-4351-9595-064a860c5c07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:53.221003 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d561af-941c-4351-9595-064a860c5c07 service nova] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:53.221655 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4f864-0950-4d83-99b1-20b40e511cc9 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:53.242364 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4f864-0950-4d83-99b1-20b40e511cc9 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:53.247016 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 779/1568] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:36:52 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:36:53.267404 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38502cc0-b2c8-46e4-8057-73c96f9855a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:53.269881 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38502cc0-b2c8-46e4-8057-73c96f9855a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:53.270740 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38502cc0-b2c8-46e4-8057-73c96f9855a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:53.271729 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38502cc0-b2c8-46e4-8057-73c96f9855a8 admin admin] PATH_INFO: `/v3/projects/348ccc5270b9421ab528faab41802b86/users/113bbe26e7fb4a318ad3e6727f544e4b/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:53.310062 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38502cc0-b2c8-46e4-8057-73c96f9855a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=348ccc5270b9421ab528faab41802b86, user_id=113bbe26e7fb4a318ad3e6727f544e4b, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:53.312766 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38502cc0-b2c8-46e4-8057-73c96f9855a8 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:53.345728 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 790/1569] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:36:53 2021] PUT /identity/v3/projects/348ccc5270b9421ab528faab41802b86/users/113bbe26e7fb4a318ad3e6727f544e4b/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:36:53.346988 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d561af-941c-4351-9595-064a860c5c07 service nova] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:53.364329 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d561af-941c-4351-9595-064a860c5c07 service nova] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:53.376891 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3889c-d03e-49cb-b850-8c39dde22d6c None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:53.377175 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3889c-d03e-49cb-b850-8c39dde22d6c None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:53.377495 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3889c-d03e-49cb-b850-8c39dde22d6c None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:53.380033 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 791/1570] 10.222.0.79 () {54 vars in 912 bytes} [Thu Oct 28 14:36:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 14:36:53.395852 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785755eb-f8e9-4441-8ed4-9021e74af9b9 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:53.396117 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785755eb-f8e9-4441-8ed4-9021e74af9b9 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:53.396608 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785755eb-f8e9-4441-8ed4-9021e74af9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:53.455525 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-785755eb-f8e9-4441-8ed4-9021e74af9b9 None None] MFA Rules not processed for user `18cd6636ae7847c78be910824410d295`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:53.456745 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-785755eb-f8e9-4441-8ed4-9021e74af9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:53.549330 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7b274-3d65-4766-83f4-119a32df1efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:53.550016 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7b274-3d65-4766-83f4-119a32df1efc admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:53.550295 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7b274-3d65-4766-83f4-119a32df1efc admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:53.550566 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7b274-3d65-4766-83f4-119a32df1efc admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:53.552816 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7b274-3d65-4766-83f4-119a32df1efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:53.554518 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7b274-3d65-4766-83f4-119a32df1efc admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:53.578967 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 780/1571] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:36:53 2021] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:36:53.581981 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7b274-3d65-4766-83f4-119a32df1efc admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:53.609142 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7b274-3d65-4766-83f4-119a32df1efc admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:53.620056 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cde344-0427-4bc1-a924-9db2b9cbb7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:53.622276 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cde344-0427-4bc1-a924-9db2b9cbb7f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:53.622560 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cde344-0427-4bc1-a924-9db2b9cbb7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:53.622858 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cde344-0427-4bc1-a924-9db2b9cbb7f3 admin admin] PATH_INFO: `/v3/projects/348ccc5270b9421ab528faab41802b86/users/113bbe26e7fb4a318ad3e6727f544e4b/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:53.627843 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cde344-0427-4bc1-a924-9db2b9cbb7f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=348ccc5270b9421ab528faab41802b86, user_id=113bbe26e7fb4a318ad3e6727f544e4b, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:53.631752 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cde344-0427-4bc1-a924-9db2b9cbb7f3 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:53.636577 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 792/1572] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Oct 28 14:36:53 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:53.647391 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 781/1573] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:36:53 2021] PUT /identity/v3/projects/348ccc5270b9421ab528faab41802b86/users/113bbe26e7fb4a318ad3e6727f544e4b/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:36:53.649801 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785755eb-f8e9-4441-8ed4-9021e74af9b9 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:53.664494 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c3850-b70f-4f27-99b9-12d344ef60c3 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:53.664995 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c3850-b70f-4f27-99b9-12d344ef60c3 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:53.666293 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c3850-b70f-4f27-99b9-12d344ef60c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:53.701072 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-611c3850-b70f-4f27-99b9-12d344ef60c3 None None] MFA Rules not processed for user `113bbe26e7fb4a318ad3e6727f544e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:53.702653 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-611c3850-b70f-4f27-99b9-12d344ef60c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:53.733351 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785755eb-f8e9-4441-8ed4-9021e74af9b9 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:53.791175 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 782/1574] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:53 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:53.793040 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d29e02-6ee9-48f5-8168-07b558252ac6 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:53.793979 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d29e02-6ee9-48f5-8168-07b558252ac6 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:53.794440 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d29e02-6ee9-48f5-8168-07b558252ac6 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:53.797127 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 783/1575] 10.222.0.79 () {54 vars in 912 bytes} [Thu Oct 28 14:36:53 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:36:53.803216 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665d8b5-f23e-44ba-a114-8f2b55ae7c12 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:53.803791 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665d8b5-f23e-44ba-a114-8f2b55ae7c12 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:53.804247 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665d8b5-f23e-44ba-a114-8f2b55ae7c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:53.810834 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633934a-81a5-43d5-9001-6e8642b07296 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:53.811754 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633934a-81a5-43d5-9001-6e8642b07296 service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:53.812488 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633934a-81a5-43d5-9001-6e8642b07296 service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:53.812488 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633934a-81a5-43d5-9001-6e8642b07296 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:53.849610 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-2665d8b5-f23e-44ba-a114-8f2b55ae7c12 None None] MFA Rules not processed for user `18cd6636ae7847c78be910824410d295`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:53.853126 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-2665d8b5-f23e-44ba-a114-8f2b55ae7c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:53.935932 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633934a-81a5-43d5-9001-6e8642b07296 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:53.940843 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633934a-81a5-43d5-9001-6e8642b07296 service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:53.971505 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 793/1576] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:36:53 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:36:53.972893 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633934a-81a5-43d5-9001-6e8642b07296 service cinder] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:53.988898 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633934a-81a5-43d5-9001-6e8642b07296 service cinder] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:53.998131 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692e62a-82ab-4d7a-b389-85811ca058bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:53.998846 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692e62a-82ab-4d7a-b389-85811ca058bb service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:53.999985 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692e62a-82ab-4d7a-b389-85811ca058bb service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:53.999985 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692e62a-82ab-4d7a-b389-85811ca058bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:54.019639 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 784/1577] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Oct 28 14:36:53 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:54.021137 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692e62a-82ab-4d7a-b389-85811ca058bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:54.022546 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692e62a-82ab-4d7a-b389-85811ca058bb service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:54.034425 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 794/1578] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:36:53 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:36:54.126378 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665d8b5-f23e-44ba-a114-8f2b55ae7c12 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:54.145456 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665d8b5-f23e-44ba-a114-8f2b55ae7c12 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:54.154042 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e71f9-206e-47b4-9f4f-a92ab4980a96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:54.154755 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e71f9-206e-47b4-9f4f-a92ab4980a96 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:54.155040 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e71f9-206e-47b4-9f4f-a92ab4980a96 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:54.155364 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e71f9-206e-47b4-9f4f-a92ab4980a96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:54.172861 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e71f9-206e-47b4-9f4f-a92ab4980a96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:54.174763 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e71f9-206e-47b4-9f4f-a92ab4980a96 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:54.209577 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 785/1579] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:36:54 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:36:54.517518 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692e62a-82ab-4d7a-b389-85811ca058bb service cinder] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:54.640549 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e71f9-206e-47b4-9f4f-a92ab4980a96 service cinder] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:54.659014 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e71f9-206e-47b4-9f4f-a92ab4980a96 service cinder] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:54.667596 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e3878-8006-41b0-b155-6801658f832a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:54.669133 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e3878-8006-41b0-b155-6801658f832a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:54.669294 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e3878-8006-41b0-b155-6801658f832a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:54.674097 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692e62a-82ab-4d7a-b389-85811ca058bb service cinder] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:54.676527 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e3878-8006-41b0-b155-6801658f832a admin admin] PATH_INFO: `/v3/users/7c4f9bb3753a4db3929bf8a4345e2b83` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:54.681022 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c958d-2ef8-4eae-9a93-eb201d05146b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:54.683326 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c958d-2ef8-4eae-9a93-eb201d05146b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:54.684055 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c958d-2ef8-4eae-9a93-eb201d05146b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:54.684524 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c958d-2ef8-4eae-9a93-eb201d05146b admin admin] PATH_INFO: `/v3/users/d2800047e9df40fe808c13deb56b0f99` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:54.686147 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c958d-2ef8-4eae-9a93-eb201d05146b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2800047e9df40fe808c13deb56b0f99)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:54.690149 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c958d-2ef8-4eae-9a93-eb201d05146b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:54.693824 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e3878-8006-41b0-b155-6801658f832a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c4f9bb3753a4db3929bf8a4345e2b83)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:54.709060 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: WARNING py.warnings [None req-e33e3878-8006-41b0-b155-6801658f832a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:36:54.709060 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: warnings.warn(msg) Oct 28 14:36:54.709060 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: Oct 28 14:36:54.727935 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e3878-8006-41b0-b155-6801658f832a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:54.760970 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-209c958d-2ef8-4eae-9a93-eb201d05146b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2800047e9df40fe808c13deb56b0f99'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:54.789188 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-209c958d-2ef8-4eae-9a93-eb201d05146b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2800047e9df40fe808c13deb56b0f99'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:54.789974 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-209c958d-2ef8-4eae-9a93-eb201d05146b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2800047e9df40fe808c13deb56b0f99'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:54.820728 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-209c958d-2ef8-4eae-9a93-eb201d05146b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2800047e9df40fe808c13deb56b0f99'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:54.833216 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-209c958d-2ef8-4eae-9a93-eb201d05146b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2800047e9df40fe808c13deb56b0f99'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:54.861090 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 795/1580] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:36:54 2021] DELETE /identity/v3/users/d2800047e9df40fe808c13deb56b0f99 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:36:54.865323 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f91c16-8c7a-4b35-9be2-f9773ca8b0f7 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:54.865871 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f91c16-8c7a-4b35-9be2-f9773ca8b0f7 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:54.866300 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f91c16-8c7a-4b35-9be2-f9773ca8b0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:54.916452 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-56f91c16-8c7a-4b35-9be2-f9773ca8b0f7 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:54.920294 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e33e3878-8006-41b0-b155-6801658f832a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c4f9bb3753a4db3929bf8a4345e2b83'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:54.921515 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-56f91c16-8c7a-4b35-9be2-f9773ca8b0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:54.923012 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e33e3878-8006-41b0-b155-6801658f832a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c4f9bb3753a4db3929bf8a4345e2b83'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:55.004734 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e33e3878-8006-41b0-b155-6801658f832a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c4f9bb3753a4db3929bf8a4345e2b83'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:55.008963 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e33e3878-8006-41b0-b155-6801658f832a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c4f9bb3753a4db3929bf8a4345e2b83'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:55.036611 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e33e3878-8006-41b0-b155-6801658f832a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c4f9bb3753a4db3929bf8a4345e2b83'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:55.072982 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 786/1581] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:36:54 2021] DELETE /identity/v3/users/7c4f9bb3753a4db3929bf8a4345e2b83 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:36:55.074958 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7d21a-90f3-4d68-a999-867e164b4672 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:55.075437 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7d21a-90f3-4d68-a999-867e164b4672 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:55.075868 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7d21a-90f3-4d68-a999-867e164b4672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:55.116696 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-32e7d21a-90f3-4d68-a999-867e164b4672 None None] MFA Rules not processed for user `1fe4b8bb46f14e1a82728e66f8d27746`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:55.118264 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-32e7d21a-90f3-4d68-a999-867e164b4672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:55.222277 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 787/1582] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:55 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:55.223928 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bda53-0611-441f-abaf-158459a39135 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:55.224524 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bda53-0611-441f-abaf-158459a39135 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:55.224954 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bda53-0611-441f-abaf-158459a39135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:55.234651 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 796/1583] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:55.243400 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f607d-f57a-47d0-9136-9c50eda7ff31 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:55.246707 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f607d-f57a-47d0-9136-9c50eda7ff31 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:55.247262 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f607d-f57a-47d0-9136-9c50eda7ff31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:55.276056 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-da9bda53-0611-441f-abaf-158459a39135 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:55.277885 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-da9bda53-0611-441f-abaf-158459a39135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:55.303080 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-f12f607d-f57a-47d0-9136-9c50eda7ff31 None None] MFA Rules not processed for user `1fe4b8bb46f14e1a82728e66f8d27746`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:55.309729 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-f12f607d-f57a-47d0-9136-9c50eda7ff31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:55.357767 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 797/1584] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:55 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:55.358884 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f607d-f57a-47d0-9136-9c50eda7ff31 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:55.365411 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-f12f607d-f57a-47d0-9136-9c50eda7ff31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:55.479235 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 788/1585] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:55.481105 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bda53-0611-441f-abaf-158459a39135 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:55.483919 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-da9bda53-0611-441f-abaf-158459a39135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:55.560562 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f607d-f57a-47d0-9136-9c50eda7ff31 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:55.569557 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566eb70-d022-4a08-9cd8-b08b528bd98c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:55.570247 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566eb70-d022-4a08-9cd8-b08b528bd98c service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:55.570542 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566eb70-d022-4a08-9cd8-b08b528bd98c service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:55.570941 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566eb70-d022-4a08-9cd8-b08b528bd98c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:55.592632 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566eb70-d022-4a08-9cd8-b08b528bd98c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:55.594100 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566eb70-d022-4a08-9cd8-b08b528bd98c service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:55.641705 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 798/1586] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:36:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:36:55.643433 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566eb70-d022-4a08-9cd8-b08b528bd98c service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:55.645036 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-7566eb70-d022-4a08-9cd8-b08b528bd98c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:55.669067 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566eb70-d022-4a08-9cd8-b08b528bd98c service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:55.674211 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb19793-216f-4e1c-893f-6a8c8aa7d025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:55.684634 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb19793-216f-4e1c-893f-6a8c8aa7d025 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:55.684899 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb19793-216f-4e1c-893f-6a8c8aa7d025 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:55.685291 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb19793-216f-4e1c-893f-6a8c8aa7d025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:55.698972 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb19793-216f-4e1c-893f-6a8c8aa7d025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:55.701179 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb19793-216f-4e1c-893f-6a8c8aa7d025 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:55.707755 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bda53-0611-441f-abaf-158459a39135 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:55.722483 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 799/1587] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:36:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:36:55.726630 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd21a30-3b9e-42be-9987-a060f85465af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:55.727430 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd21a30-3b9e-42be-9987-a060f85465af service nova] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:55.728189 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd21a30-3b9e-42be-9987-a060f85465af service nova] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:55.728668 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd21a30-3b9e-42be-9987-a060f85465af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:55.744493 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd21a30-3b9e-42be-9987-a060f85465af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:55.747236 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd21a30-3b9e-42be-9987-a060f85465af service nova] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:55.788711 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 789/1588] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:36:55 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:36:55.932824 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb32bc4-e8ff-452c-970d-e2b9112b8b36 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:55.933117 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb32bc4-e8ff-452c-970d-e2b9112b8b36 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:55.933425 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb32bc4-e8ff-452c-970d-e2b9112b8b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:56.032762 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-8cb32bc4-e8ff-452c-970d-e2b9112b8b36 None None] MFA Rules not processed for user `1389d849e741448abf4fdebd6d30845f`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:56.035034 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-8cb32bc4-e8ff-452c-970d-e2b9112b8b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:56.184069 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 800/1589] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:55 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:56.185209 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b07672-c3f1-4845-82a3-2c1d918ed370 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:56.185595 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b07672-c3f1-4845-82a3-2c1d918ed370 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:56.185970 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b07672-c3f1-4845-82a3-2c1d918ed370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:56.226211 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-59b07672-c3f1-4845-82a3-2c1d918ed370 None None] MFA Rules not processed for user `1389d849e741448abf4fdebd6d30845f`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:56.228118 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-59b07672-c3f1-4845-82a3-2c1d918ed370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:56.270071 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 790/1590] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:56 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:56.276582 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb32bc4-e8ff-452c-970d-e2b9112b8b36 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:56.278867 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-8cb32bc4-e8ff-452c-970d-e2b9112b8b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:56.291567 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dc4e0-474c-4bd4-ac41-3ea4e45cf7a2 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:56.292057 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dc4e0-474c-4bd4-ac41-3ea4e45cf7a2 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:56.292493 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dc4e0-474c-4bd4-ac41-3ea4e45cf7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:56.311947 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb32bc4-e8ff-452c-970d-e2b9112b8b36 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:56.328512 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b490d-e206-4440-9421-f516b3284cc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:56.329415 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b490d-e206-4440-9421-f516b3284cc3 service nova] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:56.329538 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b490d-e206-4440-9421-f516b3284cc3 service nova] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:56.329861 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b490d-e206-4440-9421-f516b3284cc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:56.335494 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-4c8dc4e0-474c-4bd4-ac41-3ea4e45cf7a2 None None] MFA Rules not processed for user `478109e21b1a4f3cb9690aed2d967faa`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:56.336766 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-4c8dc4e0-474c-4bd4-ac41-3ea4e45cf7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:56.349524 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b490d-e206-4440-9421-f516b3284cc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:56.355196 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b490d-e206-4440-9421-f516b3284cc3 service nova] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:56.381128 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 801/1591] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:36:56 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:36:56.449333 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 791/1592] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:56 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:36:56.451631 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ed2b3-6c17-46e3-8f93-cc868a31b039 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:56.451924 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ed2b3-6c17-46e3-8f93-cc868a31b039 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:56.452201 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ed2b3-6c17-46e3-8f93-cc868a31b039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:56.497421 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-802ed2b3-6c17-46e3-8f93-cc868a31b039 None None] MFA Rules not processed for user `478109e21b1a4f3cb9690aed2d967faa`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:56.499853 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-802ed2b3-6c17-46e3-8f93-cc868a31b039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:56.522918 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 802/1593] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:56 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:56.528389 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e952d8-5df7-42b1-8fc2-95890efeeb83 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:56.528910 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e952d8-5df7-42b1-8fc2-95890efeeb83 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:56.529294 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e952d8-5df7-42b1-8fc2-95890efeeb83 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:56.531842 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 792/1594] 10.222.0.79 () {54 vars in 912 bytes} [Thu Oct 28 14:36:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:36:56.537979 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d611b-7883-47ce-94bd-7b239d738236 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:56.538266 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d611b-7883-47ce-94bd-7b239d738236 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:56.538546 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d611b-7883-47ce-94bd-7b239d738236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:56.590999 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-107d611b-7883-47ce-94bd-7b239d738236 None None] MFA Rules not processed for user `a689fc75b37b4557a682f6cad357df6c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:56.592598 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-107d611b-7883-47ce-94bd-7b239d738236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:56.613605 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 803/1595] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Oct 28 14:36:56 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:56.646319 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e952d8-5df7-42b1-8fc2-95890efeeb83 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:56.662193 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e952d8-5df7-42b1-8fc2-95890efeeb83 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:56.672861 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f835a80-af20-408f-a32b-0acfa8e996da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:56.673632 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f835a80-af20-408f-a32b-0acfa8e996da service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:56.673918 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f835a80-af20-408f-a32b-0acfa8e996da service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:56.674368 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f835a80-af20-408f-a32b-0acfa8e996da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:56.690289 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f835a80-af20-408f-a32b-0acfa8e996da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:56.691816 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f835a80-af20-408f-a32b-0acfa8e996da service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:56.710951 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 793/1596] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:36:56 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:36:56.960710 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d611b-7883-47ce-94bd-7b239d738236 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:56.962940 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-107d611b-7883-47ce-94bd-7b239d738236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:56.995627 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d611b-7883-47ce-94bd-7b239d738236 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:57.004534 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ace99-90d1-47c3-b27c-4bec7aacf8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:57.005437 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ace99-90d1-47c3-b27c-4bec7aacf8d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:57.005714 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ace99-90d1-47c3-b27c-4bec7aacf8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:57.005984 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ace99-90d1-47c3-b27c-4bec7aacf8d0 admin admin] PATH_INFO: `/v3/projects/a831c7f0645c4f14b50eef0b24792fa1` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:57.012379 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ace99-90d1-47c3-b27c-4bec7aacf8d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a831c7f0645c4f14b50eef0b24792fa1)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:57.014797 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: WARNING py.warnings [None req-e25ace99-90d1-47c3-b27c-4bec7aacf8d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 14:36:57.014797 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: warnings.warn(msg) Oct 28 14:36:57.014797 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: Oct 28 14:36:57.019310 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ace99-90d1-47c3-b27c-4bec7aacf8d0 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:57.085434 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c5ecb-ef32-43a3-8ff0-ad0d098fd824 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:57.085973 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c5ecb-ef32-43a3-8ff0-ad0d098fd824 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:57.086428 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c5ecb-ef32-43a3-8ff0-ad0d098fd824 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:57.088886 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 794/1597] 10.222.0.79 () {54 vars in 912 bytes} [Thu Oct 28 14:36:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:36:57.108879 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a579ab-cf46-4518-b917-75322b28e801 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:57.110259 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a579ab-cf46-4518-b917-75322b28e801 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:57.110784 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a579ab-cf46-4518-b917-75322b28e801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:57.159714 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-78a579ab-cf46-4518-b917-75322b28e801 None None] MFA Rules not processed for user `a689fc75b37b4557a682f6cad357df6c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:57.161020 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-e25ace99-90d1-47c3-b27c-4bec7aacf8d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a831c7f0645c4f14b50eef0b24792fa1', 'request_id': 'req-e25ace99-90d1-47c3-b27c-4bec7aacf8d0'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:57.165079 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-78a579ab-cf46-4518-b917-75322b28e801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:57.209929 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-e25ace99-90d1-47c3-b27c-4bec7aacf8d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a831c7f0645c4f14b50eef0b24792fa1', 'request_id': 'req-e25ace99-90d1-47c3-b27c-4bec7aacf8d0'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:57.240694 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-e25ace99-90d1-47c3-b27c-4bec7aacf8d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a831c7f0645c4f14b50eef0b24792fa1', 'request_id': 'req-e25ace99-90d1-47c3-b27c-4bec7aacf8d0'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:57.273270 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-e25ace99-90d1-47c3-b27c-4bec7aacf8d0 admin admin] The token cache is being invalidate because project a831c7f0645c4f14b50eef0b24792fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:36:57.274058 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-e25ace99-90d1-47c3-b27c-4bec7aacf8d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:57.276157 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-e25ace99-90d1-47c3-b27c-4bec7aacf8d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:57.284111 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 804/1598] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:36:56 2021] DELETE /identity/v3/projects/a831c7f0645c4f14b50eef0b24792fa1 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:36:57.288448 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7197454-a89d-45ee-9a94-c3c9c4710fbe None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:57.288811 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7197454-a89d-45ee-9a94-c3c9c4710fbe None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:57.289298 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7197454-a89d-45ee-9a94-c3c9c4710fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:57.337049 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 795/1599] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Oct 28 14:36:57 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:36:57.338293 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-c7197454-a89d-45ee-9a94-c3c9c4710fbe None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:57.339869 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-c7197454-a89d-45ee-9a94-c3c9c4710fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:57.357805 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a579ab-cf46-4518-b917-75322b28e801 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:57.359870 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-78a579ab-cf46-4518-b917-75322b28e801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:57.458416 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 805/1600] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:57.459351 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7197454-a89d-45ee-9a94-c3c9c4710fbe None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:57.460671 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-c7197454-a89d-45ee-9a94-c3c9c4710fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:57.482188 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a579ab-cf46-4518-b917-75322b28e801 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:57.492353 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7197454-a89d-45ee-9a94-c3c9c4710fbe None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:57.497020 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03da1fb-cab4-449f-968f-0ffe3c4e89b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:57.498311 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03da1fb-cab4-449f-968f-0ffe3c4e89b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:57.499531 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03da1fb-cab4-449f-968f-0ffe3c4e89b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:57.499812 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03da1fb-cab4-449f-968f-0ffe3c4e89b2 admin admin] PATH_INFO: `/v3/projects/96080e48afc7493f8daee47d749b3698` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:57.503467 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b20ec-0d22-48d2-8182-a29f29aca4a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:57.504561 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03da1fb-cab4-449f-968f-0ffe3c4e89b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96080e48afc7493f8daee47d749b3698)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:57.506321 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b20ec-0d22-48d2-8182-a29f29aca4a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:57.506605 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b20ec-0d22-48d2-8182-a29f29aca4a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:57.506903 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b20ec-0d22-48d2-8182-a29f29aca4a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:57.508952 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03da1fb-cab4-449f-968f-0ffe3c4e89b2 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:57.522869 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b20ec-0d22-48d2-8182-a29f29aca4a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:57.526084 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b20ec-0d22-48d2-8182-a29f29aca4a3 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:57.543925 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 806/1601] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:36:57 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:36:57.550706 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40843838-1dde-4536-ac1c-4dfc60394fd0 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:57.551042 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40843838-1dde-4536-ac1c-4dfc60394fd0 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:57.551314 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40843838-1dde-4536-ac1c-4dfc60394fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:57.587856 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-40843838-1dde-4536-ac1c-4dfc60394fd0 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:57.591779 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-40843838-1dde-4536-ac1c-4dfc60394fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:57.601816 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d03da1fb-cab4-449f-968f-0ffe3c4e89b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96080e48afc7493f8daee47d749b3698', 'request_id': 'req-d03da1fb-cab4-449f-968f-0ffe3c4e89b2'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:57.613344 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d03da1fb-cab4-449f-968f-0ffe3c4e89b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96080e48afc7493f8daee47d749b3698', 'request_id': 'req-d03da1fb-cab4-449f-968f-0ffe3c4e89b2'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:57.631347 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d03da1fb-cab4-449f-968f-0ffe3c4e89b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96080e48afc7493f8daee47d749b3698', 'request_id': 'req-d03da1fb-cab4-449f-968f-0ffe3c4e89b2'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:57.648739 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d03da1fb-cab4-449f-968f-0ffe3c4e89b2 admin admin] The token cache is being invalidate because project 96080e48afc7493f8daee47d749b3698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:36:57.649098 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d03da1fb-cab4-449f-968f-0ffe3c4e89b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:57.649980 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d03da1fb-cab4-449f-968f-0ffe3c4e89b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:57.652389 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 796/1602] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:36:57 2021] DELETE /identity/v3/projects/96080e48afc7493f8daee47d749b3698 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:36:57.653177 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03da1fb-cab4-449f-968f-0ffe3c4e89b2 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:57.657729 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-d03da1fb-cab4-449f-968f-0ffe3c4e89b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:57.727461 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 807/1603] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:57.727950 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40843838-1dde-4536-ac1c-4dfc60394fd0 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:57.731145 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-40843838-1dde-4536-ac1c-4dfc60394fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:57.744092 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40843838-1dde-4536-ac1c-4dfc60394fd0 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:57.749138 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f90140-bb6b-4266-9716-8c3bd54d96bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:57.750042 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f90140-bb6b-4266-9716-8c3bd54d96bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:57.750369 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f90140-bb6b-4266-9716-8c3bd54d96bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:57.750831 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f90140-bb6b-4266-9716-8c3bd54d96bf admin admin] PATH_INFO: `/v3/users/113bbe26e7fb4a318ad3e6727f544e4b` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:57.752140 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f90140-bb6b-4266-9716-8c3bd54d96bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=113bbe26e7fb4a318ad3e6727f544e4b)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:57.754495 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f90140-bb6b-4266-9716-8c3bd54d96bf admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:57.810461 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03da1fb-cab4-449f-968f-0ffe3c4e89b2 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:57.822082 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905265e-4d7d-4230-acb4-8ce29a3771d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:57.822808 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905265e-4d7d-4230-acb4-8ce29a3771d9 service nova] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:57.823038 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905265e-4d7d-4230-acb4-8ce29a3771d9 service nova] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:57.823309 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905265e-4d7d-4230-acb4-8ce29a3771d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:57.825411 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-5905265e-4d7d-4230-acb4-8ce29a3771d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:57.832902 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a3f90140-bb6b-4266-9716-8c3bd54d96bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '113bbe26e7fb4a318ad3e6727f544e4b'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:57.846649 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a3f90140-bb6b-4266-9716-8c3bd54d96bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '113bbe26e7fb4a318ad3e6727f544e4b'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:57.847587 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a3f90140-bb6b-4266-9716-8c3bd54d96bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '113bbe26e7fb4a318ad3e6727f544e4b'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:57.867767 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a3f90140-bb6b-4266-9716-8c3bd54d96bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '113bbe26e7fb4a318ad3e6727f544e4b'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:57.878593 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a3f90140-bb6b-4266-9716-8c3bd54d96bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '113bbe26e7fb4a318ad3e6727f544e4b'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:57.886463 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 808/1604] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:36:57 2021] DELETE /identity/v3/users/113bbe26e7fb4a318ad3e6727f544e4b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:36:57.889018 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f90140-bb6b-4266-9716-8c3bd54d96bf admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:57.892176 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a3f90140-bb6b-4266-9716-8c3bd54d96bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:57.950998 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905265e-4d7d-4230-acb4-8ce29a3771d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:57.952911 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905265e-4d7d-4230-acb4-8ce29a3771d9 service nova] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:57.995463 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f90140-bb6b-4266-9716-8c3bd54d96bf admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:58.001558 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 797/1605] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:36:57 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:36:58.002939 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398956d-6ee8-45ae-9c8f-3379edff7ee0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bf32a6fafb7458788a47e4774cb7bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:58.003339 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398956d-6ee8-45ae-9c8f-3379edff7ee0 service placement] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:58.003658 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398956d-6ee8-45ae-9c8f-3379edff7ee0 service placement] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:58.004007 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398956d-6ee8-45ae-9c8f-3379edff7ee0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:58.004600 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905265e-4d7d-4230-acb4-8ce29a3771d9 service nova] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:58.006060 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-1398956d-6ee8-45ae-9c8f-3379edff7ee0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:58.024767 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398956d-6ee8-45ae-9c8f-3379edff7ee0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:58.026729 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398956d-6ee8-45ae-9c8f-3379edff7ee0 service placement] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:58.041694 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905265e-4d7d-4230-acb4-8ce29a3771d9 service nova] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:58.044721 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 809/1606] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:36:57 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:36:58.226252 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44aa28-0622-4e74-bbc1-4a09966597b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:58.227837 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44aa28-0622-4e74-bbc1-4a09966597b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:58.228332 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44aa28-0622-4e74-bbc1-4a09966597b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:58.228810 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44aa28-0622-4e74-bbc1-4a09966597b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:58.229795 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44aa28-0622-4e74-bbc1-4a09966597b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:36:58.230534 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44aa28-0622-4e74-bbc1-4a09966597b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:58.233541 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44aa28-0622-4e74-bbc1-4a09966597b0 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:58.247588 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 798/1607] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:36:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:36:58.251632 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398956d-6ee8-45ae-9c8f-3379edff7ee0 service placement] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:58.253080 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-1398956d-6ee8-45ae-9c8f-3379edff7ee0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:58.274737 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398956d-6ee8-45ae-9c8f-3379edff7ee0 service placement] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:58.280224 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af86c09-5cc7-4d15-8360-b592b276db8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:58.292100 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af86c09-5cc7-4d15-8360-b592b276db8e admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:58.292565 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af86c09-5cc7-4d15-8360-b592b276db8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:58.293652 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af86c09-5cc7-4d15-8360-b592b276db8e admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:58.295333 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af86c09-5cc7-4d15-8360-b592b276db8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:58.298286 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af86c09-5cc7-4d15-8360-b592b276db8e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:58.361578 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 810/1608] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:36:58 2021] POST /identity/v3/projects => generated 405 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:36:58.366507 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44aa28-0622-4e74-bbc1-4a09966597b0 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:58.388585 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44aa28-0622-4e74-bbc1-4a09966597b0 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:58.558491 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3354d15-54d6-4553-9118-0cbf92400308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:58.559471 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3354d15-54d6-4553-9118-0cbf92400308 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:58.560107 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3354d15-54d6-4553-9118-0cbf92400308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:58.561311 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3354d15-54d6-4553-9118-0cbf92400308 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:58.562266 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3354d15-54d6-4553-9118-0cbf92400308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:58.568239 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3354d15-54d6-4553-9118-0cbf92400308 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:58.626790 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 799/1609] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:36:58 2021] POST /identity/v3/users => generated 303 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:36:58.632052 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af86c09-5cc7-4d15-8360-b592b276db8e admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:58.655428 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af86c09-5cc7-4d15-8360-b592b276db8e admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:58.669740 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785a94e-edb7-44f2-9bd3-9a1788702279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:58.675513 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785a94e-edb7-44f2-9bd3-9a1788702279 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:58.681441 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785a94e-edb7-44f2-9bd3-9a1788702279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:58.683452 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785a94e-edb7-44f2-9bd3-9a1788702279 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:58.685008 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785a94e-edb7-44f2-9bd3-9a1788702279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:58.688783 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785a94e-edb7-44f2-9bd3-9a1788702279 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:58.733186 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 811/1610] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:36:58 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:36:58.737124 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3354d15-54d6-4553-9118-0cbf92400308 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:58.762157 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3354d15-54d6-4553-9118-0cbf92400308 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:58.772941 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272ec3f-035d-4adf-a63e-7620810dc2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:58.773657 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272ec3f-035d-4adf-a63e-7620810dc2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:58.779522 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272ec3f-035d-4adf-a63e-7620810dc2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:58.782904 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272ec3f-035d-4adf-a63e-7620810dc2f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:58.782904 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272ec3f-035d-4adf-a63e-7620810dc2f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:58.788589 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272ec3f-035d-4adf-a63e-7620810dc2f9 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:58.836736 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 800/1611] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:36:58 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:36:58.839209 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785a94e-edb7-44f2-9bd3-9a1788702279 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:58.850655 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785a94e-edb7-44f2-9bd3-9a1788702279 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:58.868866 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5b970-3fea-4330-bdb2-a6b13deded5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:58.870105 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5b970-3fea-4330-bdb2-a6b13deded5c admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:58.870583 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5b970-3fea-4330-bdb2-a6b13deded5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:58.871261 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5b970-3fea-4330-bdb2-a6b13deded5c admin admin] PATH_INFO: `/v3/projects/54e4e7c603ba42e285d3c9edbefd35e6/users/e0a8d07e6a35408889aaef5f409ba273/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:58.921985 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5b970-3fea-4330-bdb2-a6b13deded5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e4e7c603ba42e285d3c9edbefd35e6, user_id=e0a8d07e6a35408889aaef5f409ba273, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:58.924048 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5b970-3fea-4330-bdb2-a6b13deded5c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:58.984837 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 812/1612] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:36:58 2021] PUT /identity/v3/projects/54e4e7c603ba42e285d3c9edbefd35e6/users/e0a8d07e6a35408889aaef5f409ba273/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:36:58.988134 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336a129-42da-401f-89fd-df5dffe6f5a5 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:58.988521 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336a129-42da-401f-89fd-df5dffe6f5a5 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:58.989031 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336a129-42da-401f-89fd-df5dffe6f5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:59.049082 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-e336a129-42da-401f-89fd-df5dffe6f5a5 None None] MFA Rules not processed for user `e0a8d07e6a35408889aaef5f409ba273`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:59.052961 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e336a129-42da-401f-89fd-df5dffe6f5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:59.171046 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5b970-3fea-4330-bdb2-a6b13deded5c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:59.173421 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-c8d5b970-3fea-4330-bdb2-a6b13deded5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:59.278427 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 801/1613] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:58 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:59.282650 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336a129-42da-401f-89fd-df5dffe6f5a5 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:59.355264 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5b970-3fea-4330-bdb2-a6b13deded5c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:59.384362 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d6b83-086d-4058-93fd-dddfb434bed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:59.385571 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d6b83-086d-4058-93fd-dddfb434bed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:59.386013 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d6b83-086d-4058-93fd-dddfb434bed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:59.386571 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d6b83-086d-4058-93fd-dddfb434bed4 admin admin] PATH_INFO: `/v3/projects/348ccc5270b9421ab528faab41802b86` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:59.390614 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d6b83-086d-4058-93fd-dddfb434bed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=348ccc5270b9421ab528faab41802b86)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:59.392840 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d6b83-086d-4058-93fd-dddfb434bed4 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:59.443310 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336a129-42da-401f-89fd-df5dffe6f5a5 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:59.464384 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200bb59-e402-45fa-bbe9-e82cfaae232e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:36:59.465059 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200bb59-e402-45fa-bbe9-e82cfaae232e admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:59.465336 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200bb59-e402-45fa-bbe9-e82cfaae232e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:59.465603 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200bb59-e402-45fa-bbe9-e82cfaae232e admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:59.467249 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0200bb59-e402-45fa-bbe9-e82cfaae232e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:36:59.468500 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0200bb59-e402-45fa-bbe9-e82cfaae232e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:36:59.522627 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 802/1614] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:36:59 2021] POST /identity/v3/projects => generated 403 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:36:59.526440 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c56c6-488b-45e1-820d-35eb514329fd None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:59.526836 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c56c6-488b-45e1-820d-35eb514329fd None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:59.527361 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c56c6-488b-45e1-820d-35eb514329fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:59.541353 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a56d6b83-086d-4058-93fd-dddfb434bed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '348ccc5270b9421ab528faab41802b86', 'request_id': 'req-a56d6b83-086d-4058-93fd-dddfb434bed4'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:59.555161 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a56d6b83-086d-4058-93fd-dddfb434bed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '348ccc5270b9421ab528faab41802b86', 'request_id': 'req-a56d6b83-086d-4058-93fd-dddfb434bed4'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:59.580586 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a56d6b83-086d-4058-93fd-dddfb434bed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '348ccc5270b9421ab528faab41802b86', 'request_id': 'req-a56d6b83-086d-4058-93fd-dddfb434bed4'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:59.586601 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-aa8c56c6-488b-45e1-820d-35eb514329fd None None] MFA Rules not processed for user `1389d849e741448abf4fdebd6d30845f`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:59.588698 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-aa8c56c6-488b-45e1-820d-35eb514329fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:59.613264 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a56d6b83-086d-4058-93fd-dddfb434bed4 admin admin] The token cache is being invalidate because project 348ccc5270b9421ab528faab41802b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:36:59.613633 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a56d6b83-086d-4058-93fd-dddfb434bed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:59.614924 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a56d6b83-086d-4058-93fd-dddfb434bed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:36:59.630668 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 813/1615] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:36:59 2021] DELETE /identity/v3/projects/348ccc5270b9421ab528faab41802b86 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:36:59.630668 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d6b83-086d-4058-93fd-dddfb434bed4 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:36:59.635318 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a56d6b83-086d-4058-93fd-dddfb434bed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:36:59.816471 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 803/1616] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:59 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:36:59.817898 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08238c7d-556c-4815-acc3-99e921fdfe41 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:36:59.818182 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08238c7d-556c-4815-acc3-99e921fdfe41 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:36:59.819744 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08238c7d-556c-4815-acc3-99e921fdfe41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:36:59.908911 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d6b83-086d-4058-93fd-dddfb434bed4 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:36:59.985744 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-08238c7d-556c-4815-acc3-99e921fdfe41 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:36:59.991315 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-08238c7d-556c-4815-acc3-99e921fdfe41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:00.042426 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78568f67-84c1-4eeb-ad3c-753cf6e36148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:00.043636 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78568f67-84c1-4eeb-ad3c-753cf6e36148 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:00.044107 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78568f67-84c1-4eeb-ad3c-753cf6e36148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:00.046061 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78568f67-84c1-4eeb-ad3c-753cf6e36148 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:00.047501 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78568f67-84c1-4eeb-ad3c-753cf6e36148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:00.054125 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78568f67-84c1-4eeb-ad3c-753cf6e36148 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:00.098554 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 814/1617] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:36:59 2021] POST /identity/v3/users => generated 308 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:00.102567 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78568f67-84c1-4eeb-ad3c-753cf6e36148 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:00.130540 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78568f67-84c1-4eeb-ad3c-753cf6e36148 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:00.149994 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e62fd-e694-44da-85d1-3342f4775180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:00.150931 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e62fd-e694-44da-85d1-3342f4775180 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:00.151403 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e62fd-e694-44da-85d1-3342f4775180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:00.151840 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e62fd-e694-44da-85d1-3342f4775180 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:00.152780 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e62fd-e694-44da-85d1-3342f4775180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:00.164621 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e62fd-e694-44da-85d1-3342f4775180 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:00.198944 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 815/1618] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:00 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:37:00.206018 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e62fd-e694-44da-85d1-3342f4775180 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:00.228660 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 804/1619] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:36:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:00.232815 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c2363-de88-4746-9a3e-c732f63eeb00 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:00.233307 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c2363-de88-4746-9a3e-c732f63eeb00 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:00.233786 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c2363-de88-4746-9a3e-c732f63eeb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:00.234044 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e62fd-e694-44da-85d1-3342f4775180 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:00.255546 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c517836-80b6-43b1-812c-e1726152eccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:00.256561 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c517836-80b6-43b1-812c-e1726152eccc admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:00.256795 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c517836-80b6-43b1-812c-e1726152eccc admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:00.257067 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c517836-80b6-43b1-812c-e1726152eccc admin admin] PATH_INFO: `/v3/projects/36a7ced03a20440d98b801eda6c326d5/users/ab3ba5213b644994b7fd15e30cdef561/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:00.284604 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-e47c2363-de88-4746-9a3e-c732f63eeb00 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:00.291625 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e47c2363-de88-4746-9a3e-c732f63eeb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:00.305115 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c517836-80b6-43b1-812c-e1726152eccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=36a7ced03a20440d98b801eda6c326d5, user_id=ab3ba5213b644994b7fd15e30cdef561, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:00.307808 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c517836-80b6-43b1-812c-e1726152eccc admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:00.312066 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 805/1620] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:00.313794 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c2363-de88-4746-9a3e-c732f63eeb00 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:00.328155 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c2363-de88-4746-9a3e-c732f63eeb00 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:00.337003 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab047d-6fa7-4d11-b090-55aa4d053154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:00.337810 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab047d-6fa7-4d11-b090-55aa4d053154 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:00.338092 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab047d-6fa7-4d11-b090-55aa4d053154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:00.338367 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab047d-6fa7-4d11-b090-55aa4d053154 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:00.339246 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab047d-6fa7-4d11-b090-55aa4d053154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:37:00.339603 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab047d-6fa7-4d11-b090-55aa4d053154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:00.340937 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 816/1621] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:00 2021] PUT /identity/v3/projects/36a7ced03a20440d98b801eda6c326d5/users/ab3ba5213b644994b7fd15e30cdef561/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:00.342638 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab047d-6fa7-4d11-b090-55aa4d053154 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:00.344868 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c517836-80b6-43b1-812c-e1726152eccc admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:00.366160 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 806/1622] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:37:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:37:00.367795 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab047d-6fa7-4d11-b090-55aa4d053154 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:00.378172 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab047d-6fa7-4d11-b090-55aa4d053154 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:00.491742 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c8807-192b-4779-a2c1-a8dc08db3db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:00.493080 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c8807-192b-4779-a2c1-a8dc08db3db7 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:00.493419 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c8807-192b-4779-a2c1-a8dc08db3db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:00.494172 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c8807-192b-4779-a2c1-a8dc08db3db7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:00.495460 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c8807-192b-4779-a2c1-a8dc08db3db7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:00.498551 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c8807-192b-4779-a2c1-a8dc08db3db7 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:00.531562 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c517836-80b6-43b1-812c-e1726152eccc admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:00.547001 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 807/1623] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:00 2021] POST /identity/v3/projects => generated 363 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:00.547238 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379341e-4f39-4d15-a610-9c7d113e424b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:00.547238 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379341e-4f39-4d15-a610-9c7d113e424b admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:00.547238 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379341e-4f39-4d15-a610-9c7d113e424b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:00.547522 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379341e-4f39-4d15-a610-9c7d113e424b admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:00.548230 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379341e-4f39-4d15-a610-9c7d113e424b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:00.548343 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c8807-192b-4779-a2c1-a8dc08db3db7 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:00.550277 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379341e-4f39-4d15-a610-9c7d113e424b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:00.576759 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 817/1624] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:00 2021] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:37:00.577737 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379341e-4f39-4d15-a610-9c7d113e424b admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:00.604505 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379341e-4f39-4d15-a610-9c7d113e424b admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:00.693604 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c8807-192b-4779-a2c1-a8dc08db3db7 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:00.709827 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a2e24-dffa-4138-9e69-8f847eb9abd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:00.712524 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a2e24-dffa-4138-9e69-8f847eb9abd0 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:00.712677 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a2e24-dffa-4138-9e69-8f847eb9abd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:00.716646 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a2e24-dffa-4138-9e69-8f847eb9abd0 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:00.719398 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a2e24-dffa-4138-9e69-8f847eb9abd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:00.723478 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a2e24-dffa-4138-9e69-8f847eb9abd0 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:00.772124 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4581b7-bca5-4e40-8286-420a3671f240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:00.773088 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4581b7-bca5-4e40-8286-420a3671f240 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:00.773317 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4581b7-bca5-4e40-8286-420a3671f240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:00.773627 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4581b7-bca5-4e40-8286-420a3671f240 admin admin] PATH_INFO: `/v3/projects/36a7ced03a20440d98b801eda6c326d5/users/ab3ba5213b644994b7fd15e30cdef561/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:00.790998 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 808/1625] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:00 2021] POST /identity/v3/users => generated 282 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:37:00.796474 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a2e24-dffa-4138-9e69-8f847eb9abd0 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:00.796990 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4581b7-bca5-4e40-8286-420a3671f240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36a7ced03a20440d98b801eda6c326d5, user_id=ab3ba5213b644994b7fd15e30cdef561, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:00.804819 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4581b7-bca5-4e40-8286-420a3671f240 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:00.811974 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a2e24-dffa-4138-9e69-8f847eb9abd0 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:00.826862 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510c627-0671-4e1d-ab87-38ecf50e1312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:00.828116 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510c627-0671-4e1d-ab87-38ecf50e1312 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:00.828539 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510c627-0671-4e1d-ab87-38ecf50e1312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:00.829098 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510c627-0671-4e1d-ab87-38ecf50e1312 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:00.830299 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510c627-0671-4e1d-ab87-38ecf50e1312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:00.833795 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510c627-0671-4e1d-ab87-38ecf50e1312 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:00.834477 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 818/1626] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:00 2021] PUT /identity/v3/projects/36a7ced03a20440d98b801eda6c326d5/users/ab3ba5213b644994b7fd15e30cdef561/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:00.851953 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f7eb3-f135-4220-a228-f335e00b4ec6 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:00.852257 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f7eb3-f135-4220-a228-f335e00b4ec6 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:00.852534 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f7eb3-f135-4220-a228-f335e00b4ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:00.887505 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-da7f7eb3-f135-4220-a228-f335e00b4ec6 None None] MFA Rules not processed for user `ab3ba5213b644994b7fd15e30cdef561`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:00.888986 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-da7f7eb3-f135-4220-a228-f335e00b4ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:00.896751 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 809/1627] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:00 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:00.897804 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510c627-0671-4e1d-ab87-38ecf50e1312 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:00.952962 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510c627-0671-4e1d-ab87-38ecf50e1312 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:01.004939 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 819/1628] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:00 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:01.016876 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f7eb3-f135-4220-a228-f335e00b4ec6 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:01.020470 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-da7f7eb3-f135-4220-a228-f335e00b4ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:01.168042 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f7eb3-f135-4220-a228-f335e00b4ec6 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:01.173329 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42b26b-2d94-4f42-8c55-8f090e7c216a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:01.174217 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42b26b-2d94-4f42-8c55-8f090e7c216a service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:01.174654 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42b26b-2d94-4f42-8c55-8f090e7c216a service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:01.175121 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42b26b-2d94-4f42-8c55-8f090e7c216a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:01.189209 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42b26b-2d94-4f42-8c55-8f090e7c216a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:01.190783 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42b26b-2d94-4f42-8c55-8f090e7c216a service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:01.195430 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755fd49-c45c-4748-ba8d-5b6a379ccab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:01.197159 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755fd49-c45c-4748-ba8d-5b6a379ccab8 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:01.197604 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755fd49-c45c-4748-ba8d-5b6a379ccab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:01.198052 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755fd49-c45c-4748-ba8d-5b6a379ccab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:01.199044 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755fd49-c45c-4748-ba8d-5b6a379ccab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:01.200792 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755fd49-c45c-4748-ba8d-5b6a379ccab8 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:01.221050 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 810/1629] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:00 2021] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:01.225088 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755fd49-c45c-4748-ba8d-5b6a379ccab8 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:01.231326 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 820/1630] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:01 2021] GET /identity/v3/auth/tokens => generated 3490 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:01.254161 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755fd49-c45c-4748-ba8d-5b6a379ccab8 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:01.289923 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d7db4-c889-4b81-9658-2bf31afdf75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:01.290878 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d7db4-c889-4b81-9658-2bf31afdf75f admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:01.291159 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d7db4-c889-4b81-9658-2bf31afdf75f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:01.291429 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d7db4-c889-4b81-9658-2bf31afdf75f admin admin] PATH_INFO: `/v3/projects/4fd686681a89480bb12696f484e6192a/users/0fb8aa7d16504da1832744813f7b7739/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:01.349164 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d7db4-c889-4b81-9658-2bf31afdf75f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd686681a89480bb12696f484e6192a, user_id=0fb8aa7d16504da1832744813f7b7739, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:01.352662 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d7db4-c889-4b81-9658-2bf31afdf75f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:01.447028 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 811/1631] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:01 2021] PUT /identity/v3/projects/4fd686681a89480bb12696f484e6192a/users/0fb8aa7d16504da1832744813f7b7739/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:01.466137 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c5b68-cd87-477d-90dd-d59b12228053 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:01.467857 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c5b68-cd87-477d-90dd-d59b12228053 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:01.468249 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c5b68-cd87-477d-90dd-d59b12228053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:01.562850 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-684c5b68-cd87-477d-90dd-d59b12228053 None None] MFA Rules not processed for user `0fb8aa7d16504da1832744813f7b7739`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:01.566030 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-684c5b68-cd87-477d-90dd-d59b12228053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:01.760459 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 821/1632] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:01 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:01.764874 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d7db4-c889-4b81-9658-2bf31afdf75f admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:01.850563 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d7db4-c889-4b81-9658-2bf31afdf75f admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:01.856252 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48d681-0514-4a62-8116-de85daa8c41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:01.857352 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48d681-0514-4a62-8116-de85daa8c41c admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:01.858087 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48d681-0514-4a62-8116-de85daa8c41c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:01.859994 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48d681-0514-4a62-8116-de85daa8c41c admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:01.860963 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48d681-0514-4a62-8116-de85daa8c41c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:01.864075 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48d681-0514-4a62-8116-de85daa8c41c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:01.911196 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 812/1633] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:01 2021] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:01.915478 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c5b68-cd87-477d-90dd-d59b12228053 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:01.939240 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c5b68-cd87-477d-90dd-d59b12228053 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:02.041948 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcf132-18c5-41e4-b749-5a1c40399387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:02.043171 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcf132-18c5-41e4-b749-5a1c40399387 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:02.043710 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcf132-18c5-41e4-b749-5a1c40399387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:02.045423 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcf132-18c5-41e4-b749-5a1c40399387 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:02.047009 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcf132-18c5-41e4-b749-5a1c40399387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:02.049436 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcf132-18c5-41e4-b749-5a1c40399387 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:02.112306 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 822/1634] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:01 2021] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:02.113957 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48d681-0514-4a62-8116-de85daa8c41c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:02.131125 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48d681-0514-4a62-8116-de85daa8c41c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:02.137493 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41b3b2-89cd-48cc-ae19-8f9e310c5205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:02.138205 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41b3b2-89cd-48cc-ae19-8f9e310c5205 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:02.138510 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41b3b2-89cd-48cc-ae19-8f9e310c5205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:02.139580 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41b3b2-89cd-48cc-ae19-8f9e310c5205 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:02.139939 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41b3b2-89cd-48cc-ae19-8f9e310c5205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:02.142017 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41b3b2-89cd-48cc-ae19-8f9e310c5205 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:02.157557 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 813/1635] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:02 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:02.165566 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcf132-18c5-41e4-b749-5a1c40399387 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:02.182586 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcf132-18c5-41e4-b749-5a1c40399387 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:02.207965 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43539449-d2e7-4d32-93f6-fcfbd5d16326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:02.209021 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43539449-d2e7-4d32-93f6-fcfbd5d16326 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:02.209392 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43539449-d2e7-4d32-93f6-fcfbd5d16326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:02.209900 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43539449-d2e7-4d32-93f6-fcfbd5d16326 admin admin] PATH_INFO: `/v3/projects/5ca9288bed4347bfa1745e42a4b0f199/users/1088e19bf8744630b8dd0902ebc13b84/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:02.235461 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43539449-d2e7-4d32-93f6-fcfbd5d16326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca9288bed4347bfa1745e42a4b0f199, user_id=1088e19bf8744630b8dd0902ebc13b84, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:02.250239 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43539449-d2e7-4d32-93f6-fcfbd5d16326 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:02.281831 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 823/1636] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:02 2021] PUT /identity/v3/projects/5ca9288bed4347bfa1745e42a4b0f199/users/1088e19bf8744630b8dd0902ebc13b84/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:02.282781 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41b3b2-89cd-48cc-ae19-8f9e310c5205 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:02.302616 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41b3b2-89cd-48cc-ae19-8f9e310c5205 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:02.460290 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d3d11-c36d-418d-8284-35bf74d563e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:02.462160 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d3d11-c36d-418d-8284-35bf74d563e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:02.462999 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d3d11-c36d-418d-8284-35bf74d563e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:02.463483 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d3d11-c36d-418d-8284-35bf74d563e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:02.464563 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d3d11-c36d-418d-8284-35bf74d563e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:02.468630 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d3d11-c36d-418d-8284-35bf74d563e4 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:02.494006 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43539449-d2e7-4d32-93f6-fcfbd5d16326 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:02.502711 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 814/1637] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:02 2021] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:02.504157 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d3d11-c36d-418d-8284-35bf74d563e4 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:02.516900 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43539449-d2e7-4d32-93f6-fcfbd5d16326 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:02.523861 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d3d11-c36d-418d-8284-35bf74d563e4 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:02.525978 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7eded-62ad-4871-8409-b3f4249bbec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:02.527407 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7eded-62ad-4871-8409-b3f4249bbec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:02.527932 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7eded-62ad-4871-8409-b3f4249bbec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:02.528814 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7eded-62ad-4871-8409-b3f4249bbec3 admin admin] PATH_INFO: `/v3/users/e0a8d07e6a35408889aaef5f409ba273` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:02.531405 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7eded-62ad-4871-8409-b3f4249bbec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0a8d07e6a35408889aaef5f409ba273)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:02.534589 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7eded-62ad-4871-8409-b3f4249bbec3 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:02.544099 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d48605-5dfb-410e-af73-36a8d1cd41df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:02.549254 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d48605-5dfb-410e-af73-36a8d1cd41df admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:02.549613 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d48605-5dfb-410e-af73-36a8d1cd41df admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:02.549804 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d48605-5dfb-410e-af73-36a8d1cd41df admin admin] PATH_INFO: `/v3/projects/5ca9288bed4347bfa1745e42a4b0f199/users/1088e19bf8744630b8dd0902ebc13b84/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:02.552285 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d48605-5dfb-410e-af73-36a8d1cd41df admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca9288bed4347bfa1745e42a4b0f199, user_id=1088e19bf8744630b8dd0902ebc13b84, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:02.556035 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d48605-5dfb-410e-af73-36a8d1cd41df admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:02.590335 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 815/1638] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:02 2021] PUT /identity/v3/projects/5ca9288bed4347bfa1745e42a4b0f199/users/1088e19bf8744630b8dd0902ebc13b84/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:02.636300 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6823a6c-ae73-4b51-9c99-ba79617ce3b7 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:02.636692 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6823a6c-ae73-4b51-9c99-ba79617ce3b7 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:02.637099 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6823a6c-ae73-4b51-9c99-ba79617ce3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:02.670210 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-d6823a6c-ae73-4b51-9c99-ba79617ce3b7 None None] MFA Rules not processed for user `1088e19bf8744630b8dd0902ebc13b84`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:02.672176 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-d6823a6c-ae73-4b51-9c99-ba79617ce3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:02.682671 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-7ff7eded-62ad-4871-8409-b3f4249bbec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0a8d07e6a35408889aaef5f409ba273'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:02.722747 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-7ff7eded-62ad-4871-8409-b3f4249bbec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0a8d07e6a35408889aaef5f409ba273'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:02.727573 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-7ff7eded-62ad-4871-8409-b3f4249bbec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0a8d07e6a35408889aaef5f409ba273'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:02.767922 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 816/1639] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:02 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:37:02.769144 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6823a6c-ae73-4b51-9c99-ba79617ce3b7 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:02.770789 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-d6823a6c-ae73-4b51-9c99-ba79617ce3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:02.787079 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-7ff7eded-62ad-4871-8409-b3f4249bbec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0a8d07e6a35408889aaef5f409ba273'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:02.825386 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-7ff7eded-62ad-4871-8409-b3f4249bbec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0a8d07e6a35408889aaef5f409ba273'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:02.842703 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6823a6c-ae73-4b51-9c99-ba79617ce3b7 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:02.855134 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99282bba-e0f6-4975-99a4-415664c357ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:02.855979 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99282bba-e0f6-4975-99a4-415664c357ac service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:02.856363 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99282bba-e0f6-4975-99a4-415664c357ac service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:02.856748 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99282bba-e0f6-4975-99a4-415664c357ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:02.858707 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 824/1640] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:37:02 2021] DELETE /identity/v3/users/e0a8d07e6a35408889aaef5f409ba273 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:02.873032 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b58ebe-36f1-4171-813e-258029545314 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:02.875887 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b58ebe-36f1-4171-813e-258029545314 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:02.876201 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b58ebe-36f1-4171-813e-258029545314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:02.880297 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99282bba-e0f6-4975-99a4-415664c357ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:02.885871 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99282bba-e0f6-4975-99a4-415664c357ac service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:02.925422 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 817/1641] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:02 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:02.964745 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-09b58ebe-36f1-4171-813e-258029545314 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:02.977202 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-09b58ebe-36f1-4171-813e-258029545314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:03.188407 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99282bba-e0f6-4975-99a4-415664c357ac service cinder] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:03.210224 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99282bba-e0f6-4975-99a4-415664c357ac service cinder] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:03.300648 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 825/1642] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:03.311222 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b58ebe-36f1-4171-813e-258029545314 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:03.314174 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-09b58ebe-36f1-4171-813e-258029545314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:03.420437 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ce28a-9620-4a04-a199-ec28352cf184 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:03.421319 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ce28a-9620-4a04-a199-ec28352cf184 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:03.421514 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ce28a-9620-4a04-a199-ec28352cf184 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:03.421768 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ce28a-9620-4a04-a199-ec28352cf184 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:03.423616 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-699ce28a-9620-4a04-a199-ec28352cf184 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:03.469862 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b58ebe-36f1-4171-813e-258029545314 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:03.473778 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bee0f3-dfc6-4619-85c3-9efbba37682a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:03.474564 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bee0f3-dfc6-4619-85c3-9efbba37682a service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:03.474797 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bee0f3-dfc6-4619-85c3-9efbba37682a service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:03.475030 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bee0f3-dfc6-4619-85c3-9efbba37682a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:03.495866 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bee0f3-dfc6-4619-85c3-9efbba37682a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:03.497869 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bee0f3-dfc6-4619-85c3-9efbba37682a service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:03.520259 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 826/1643] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:37:03.624443 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ce28a-9620-4a04-a199-ec28352cf184 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:03.626837 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ce28a-9620-4a04-a199-ec28352cf184 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:03.653857 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 818/1644] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:03 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:37:04.452744 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bee0f3-dfc6-4619-85c3-9efbba37682a service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:04.456207 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-34bee0f3-dfc6-4619-85c3-9efbba37682a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:04.488316 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bee0f3-dfc6-4619-85c3-9efbba37682a service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:04.519853 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee35ce9-7976-430d-844c-c7a33b5da7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:04.521735 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee35ce9-7976-430d-844c-c7a33b5da7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:04.522948 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee35ce9-7976-430d-844c-c7a33b5da7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:04.526493 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee35ce9-7976-430d-844c-c7a33b5da7f1 admin admin] PATH_INFO: `/v3/projects/54e4e7c603ba42e285d3c9edbefd35e6` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:04.533596 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee35ce9-7976-430d-844c-c7a33b5da7f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54e4e7c603ba42e285d3c9edbefd35e6)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:04.537346 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee35ce9-7976-430d-844c-c7a33b5da7f1 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:04.579158 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdea088-610d-4253-93d5-83bf66956dbd None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:04.579702 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdea088-610d-4253-93d5-83bf66956dbd None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:04.580009 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdea088-610d-4253-93d5-83bf66956dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:04.640664 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-efdea088-610d-4253-93d5-83bf66956dbd None None] MFA Rules not processed for user `62cc0165aee14b449c8a49233001f631`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:04.642226 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-efdea088-610d-4253-93d5-83bf66956dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:04.645966 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-cee35ce9-7976-430d-844c-c7a33b5da7f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54e4e7c603ba42e285d3c9edbefd35e6', 'request_id': 'req-cee35ce9-7976-430d-844c-c7a33b5da7f1'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:04.681598 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-cee35ce9-7976-430d-844c-c7a33b5da7f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54e4e7c603ba42e285d3c9edbefd35e6', 'request_id': 'req-cee35ce9-7976-430d-844c-c7a33b5da7f1'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:04.703207 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-cee35ce9-7976-430d-844c-c7a33b5da7f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54e4e7c603ba42e285d3c9edbefd35e6', 'request_id': 'req-cee35ce9-7976-430d-844c-c7a33b5da7f1'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:04.750920 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-cee35ce9-7976-430d-844c-c7a33b5da7f1 admin admin] The token cache is being invalidate because project 54e4e7c603ba42e285d3c9edbefd35e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:37:04.751240 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-cee35ce9-7976-430d-844c-c7a33b5da7f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:04.754508 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-cee35ce9-7976-430d-844c-c7a33b5da7f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:04.760348 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 827/1645] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:37:04 2021] DELETE /identity/v3/projects/54e4e7c603ba42e285d3c9edbefd35e6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:04.795163 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee35ce9-7976-430d-844c-c7a33b5da7f1 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:04.803381 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-cee35ce9-7976-430d-844c-c7a33b5da7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:04.854524 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 819/1646] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Oct 28 14:37:04 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:37:05.024626 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdea088-610d-4253-93d5-83bf66956dbd None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:05.026530 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-efdea088-610d-4253-93d5-83bf66956dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:05.156239 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee35ce9-7976-430d-844c-c7a33b5da7f1 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:05.181657 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c0379-ab35-46ac-98b9-e5e5577f3c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:05.185187 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c0379-ab35-46ac-98b9-e5e5577f3c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:05.185507 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdea088-610d-4253-93d5-83bf66956dbd None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:05.190450 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca63fde-56d5-40d1-b935-02ad396630b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:05.191386 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca63fde-56d5-40d1-b935-02ad396630b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:05.191670 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca63fde-56d5-40d1-b935-02ad396630b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:05.191821 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c0379-ab35-46ac-98b9-e5e5577f3c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:05.191951 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca63fde-56d5-40d1-b935-02ad396630b9 admin admin] PATH_INFO: `/v3/users/ce2e58e898cd4b27a2ed175e83cb54ea` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:05.192226 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c0379-ab35-46ac-98b9-e5e5577f3c3f admin admin] PATH_INFO: `/v3/users/ab3ba5213b644994b7fd15e30cdef561` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:05.194000 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca63fde-56d5-40d1-b935-02ad396630b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce2e58e898cd4b27a2ed175e83cb54ea)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:05.195215 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c0379-ab35-46ac-98b9-e5e5577f3c3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab3ba5213b644994b7fd15e30cdef561)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:05.196356 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca63fde-56d5-40d1-b935-02ad396630b9 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:05.205668 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c0379-ab35-46ac-98b9-e5e5577f3c3f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:05.297676 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-6ca63fde-56d5-40d1-b935-02ad396630b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce2e58e898cd4b27a2ed175e83cb54ea'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:05.298417 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-6ca63fde-56d5-40d1-b935-02ad396630b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce2e58e898cd4b27a2ed175e83cb54ea'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:05.313381 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-6ca63fde-56d5-40d1-b935-02ad396630b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce2e58e898cd4b27a2ed175e83cb54ea'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:05.341799 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-6ca63fde-56d5-40d1-b935-02ad396630b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce2e58e898cd4b27a2ed175e83cb54ea'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:05.351217 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-7c6c0379-ab35-46ac-98b9-e5e5577f3c3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab3ba5213b644994b7fd15e30cdef561'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:05.369686 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-6ca63fde-56d5-40d1-b935-02ad396630b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce2e58e898cd4b27a2ed175e83cb54ea'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:05.373317 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-7c6c0379-ab35-46ac-98b9-e5e5577f3c3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab3ba5213b644994b7fd15e30cdef561'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:05.373958 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-7c6c0379-ab35-46ac-98b9-e5e5577f3c3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab3ba5213b644994b7fd15e30cdef561'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:05.397326 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 820/1647] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:37:05 2021] DELETE /identity/v3/users/ce2e58e898cd4b27a2ed175e83cb54ea => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:05.397651 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca63fde-56d5-40d1-b935-02ad396630b9 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:05.400931 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-6ca63fde-56d5-40d1-b935-02ad396630b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:05.411929 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-7c6c0379-ab35-46ac-98b9-e5e5577f3c3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab3ba5213b644994b7fd15e30cdef561'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:05.444295 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-7c6c0379-ab35-46ac-98b9-e5e5577f3c3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab3ba5213b644994b7fd15e30cdef561'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:05.477972 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 828/1648] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:37:04 2021] DELETE /identity/v3/users/ab3ba5213b644994b7fd15e30cdef561 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:05.479193 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2e1c5-5f8b-448f-81c1-54fb724b2d8b None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:05.479536 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2e1c5-5f8b-448f-81c1-54fb724b2d8b None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:05.479759 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2e1c5-5f8b-448f-81c1-54fb724b2d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:05.556780 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-94a2e1c5-5f8b-448f-81c1-54fb724b2d8b None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:05.561587 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-94a2e1c5-5f8b-448f-81c1-54fb724b2d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:05.777371 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 829/1649] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:05.782545 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca63fde-56d5-40d1-b935-02ad396630b9 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:05.977948 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10785d-3750-4601-a82f-5a25e3863692 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889e7be1dcaf47f599af9c9b7ad33042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:05.978948 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10785d-3750-4601-a82f-5a25e3863692 service swift] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:05.979368 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10785d-3750-4601-a82f-5a25e3863692 service swift] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:05.980026 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10785d-3750-4601-a82f-5a25e3863692 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:05.983289 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-2e10785d-3750-4601-a82f-5a25e3863692 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:06.059678 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10785d-3750-4601-a82f-5a25e3863692 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:06.072841 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10785d-3750-4601-a82f-5a25e3863692 service swift] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:06.099891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 821/1650] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Oct 28 14:37:05 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 14:37:06.160257 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2e1c5-5f8b-448f-81c1-54fb724b2d8b None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:06.162247 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-94a2e1c5-5f8b-448f-81c1-54fb724b2d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:06.438482 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2e1c5-5f8b-448f-81c1-54fb724b2d8b None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:06.456537 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906bd2a-7032-4ab2-abab-19af9aae8fd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:06.456537 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906bd2a-7032-4ab2-abab-19af9aae8fd1 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:06.456537 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906bd2a-7032-4ab2-abab-19af9aae8fd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:06.456874 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906bd2a-7032-4ab2-abab-19af9aae8fd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:06.497563 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906bd2a-7032-4ab2-abab-19af9aae8fd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:06.501671 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906bd2a-7032-4ab2-abab-19af9aae8fd1 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:06.540575 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 830/1651] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:07.987064 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10785d-3750-4601-a82f-5a25e3863692 service swift] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:07.990499 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-2e10785d-3750-4601-a82f-5a25e3863692 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:08.015939 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10785d-3750-4601-a82f-5a25e3863692 service swift] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:08.024693 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c9264-744c-441f-8414-446cddba001f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:08.025998 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c9264-744c-441f-8414-446cddba001f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:08.026455 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c9264-744c-441f-8414-446cddba001f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:08.027125 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c9264-744c-441f-8414-446cddba001f admin admin] PATH_INFO: `/v3/projects/9c4c6edcf3d040c89e37d0fbdea5c822` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:08.028675 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c9264-744c-441f-8414-446cddba001f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c4c6edcf3d040c89e37d0fbdea5c822)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:08.032068 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c9264-744c-441f-8414-446cddba001f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:08.159551 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1d9c9264-744c-441f-8414-446cddba001f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c4c6edcf3d040c89e37d0fbdea5c822', 'request_id': 'req-1d9c9264-744c-441f-8414-446cddba001f'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:08.187588 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1d9c9264-744c-441f-8414-446cddba001f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c4c6edcf3d040c89e37d0fbdea5c822', 'request_id': 'req-1d9c9264-744c-441f-8414-446cddba001f'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:08.230295 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1d9c9264-744c-441f-8414-446cddba001f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c4c6edcf3d040c89e37d0fbdea5c822', 'request_id': 'req-1d9c9264-744c-441f-8414-446cddba001f'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:08.283800 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1d9c9264-744c-441f-8414-446cddba001f admin admin] The token cache is being invalidate because project 9c4c6edcf3d040c89e37d0fbdea5c822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:37:08.284048 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1d9c9264-744c-441f-8414-446cddba001f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:08.287485 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1d9c9264-744c-441f-8414-446cddba001f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:08.292666 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 822/1652] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:37:07 2021] DELETE /identity/v3/projects/9c4c6edcf3d040c89e37d0fbdea5c822 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:08.299575 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0997eb-c780-4204-a700-862b17c45d9f None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:08.300408 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0997eb-c780-4204-a700-862b17c45d9f None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:08.300830 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0997eb-c780-4204-a700-862b17c45d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:08.345634 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-dd0997eb-c780-4204-a700-862b17c45d9f None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:08.352670 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-dd0997eb-c780-4204-a700-862b17c45d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:08.413822 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c9264-744c-441f-8414-446cddba001f admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:08.418082 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-1d9c9264-744c-441f-8414-446cddba001f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:08.630724 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 831/1653] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:08.638848 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73381eb-f8e3-430e-a37f-341f10bd0633 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:08.639361 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73381eb-f8e3-430e-a37f-341f10bd0633 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:08.639840 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73381eb-f8e3-430e-a37f-341f10bd0633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:08.721997 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-b73381eb-f8e3-430e-a37f-341f10bd0633 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:08.723375 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-b73381eb-f8e3-430e-a37f-341f10bd0633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:08.738472 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c9264-744c-441f-8414-446cddba001f admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:08.743836 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 832/1654] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:08.748469 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73381eb-f8e3-430e-a37f-341f10bd0633 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:08.764346 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad195e7-3b2a-4d2e-942f-7d6edc26cf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:08.764627 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73381eb-f8e3-430e-a37f-341f10bd0633 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:08.765313 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad195e7-3b2a-4d2e-942f-7d6edc26cf8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:08.765648 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad195e7-3b2a-4d2e-942f-7d6edc26cf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:08.765922 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad195e7-3b2a-4d2e-942f-7d6edc26cf8b admin admin] PATH_INFO: `/v3/projects/36a7ced03a20440d98b801eda6c326d5` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:08.771035 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad195e7-3b2a-4d2e-942f-7d6edc26cf8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=36a7ced03a20440d98b801eda6c326d5)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:08.780465 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad195e7-3b2a-4d2e-942f-7d6edc26cf8b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:08.781887 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1419c-33f7-4b70-8a4e-d60bb9ccb731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:08.782854 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1419c-33f7-4b70-8a4e-d60bb9ccb731 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:08.783339 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1419c-33f7-4b70-8a4e-d60bb9ccb731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:08.783870 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1419c-33f7-4b70-8a4e-d60bb9ccb731 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:08.784851 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1419c-33f7-4b70-8a4e-d60bb9ccb731 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:37:08.785369 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1419c-33f7-4b70-8a4e-d60bb9ccb731 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:08.788525 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1419c-33f7-4b70-8a4e-d60bb9ccb731 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:08.817156 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 833/1655] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:37:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:37:08.821648 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1419c-33f7-4b70-8a4e-d60bb9ccb731 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:08.841652 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1419c-33f7-4b70-8a4e-d60bb9ccb731 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:08.856124 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433e191-e133-4af6-b183-d3fab3f455ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:08.857054 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433e191-e133-4af6-b183-d3fab3f455ca admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:08.857585 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433e191-e133-4af6-b183-d3fab3f455ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:08.858076 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433e191-e133-4af6-b183-d3fab3f455ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:08.859940 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433e191-e133-4af6-b183-d3fab3f455ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:08.862802 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433e191-e133-4af6-b183-d3fab3f455ca admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:08.925356 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 834/1656] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:08 2021] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:37:08.929478 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433e191-e133-4af6-b183-d3fab3f455ca admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:08.956889 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9ad195e7-3b2a-4d2e-942f-7d6edc26cf8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36a7ced03a20440d98b801eda6c326d5', 'request_id': 'req-9ad195e7-3b2a-4d2e-942f-7d6edc26cf8b'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:08.979455 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9ad195e7-3b2a-4d2e-942f-7d6edc26cf8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36a7ced03a20440d98b801eda6c326d5', 'request_id': 'req-9ad195e7-3b2a-4d2e-942f-7d6edc26cf8b'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:09.016626 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9ad195e7-3b2a-4d2e-942f-7d6edc26cf8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36a7ced03a20440d98b801eda6c326d5', 'request_id': 'req-9ad195e7-3b2a-4d2e-942f-7d6edc26cf8b'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:09.075894 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9ad195e7-3b2a-4d2e-942f-7d6edc26cf8b admin admin] The token cache is being invalidate because project 36a7ced03a20440d98b801eda6c326d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:37:09.076379 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9ad195e7-3b2a-4d2e-942f-7d6edc26cf8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:09.078500 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9ad195e7-3b2a-4d2e-942f-7d6edc26cf8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:09.085840 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433e191-e133-4af6-b183-d3fab3f455ca admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:09.091928 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 823/1657] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:37:08 2021] DELETE /identity/v3/projects/36a7ced03a20440d98b801eda6c326d5 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:09.098173 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093854f4-3e7c-4c5c-bc5a-b5af9f016551 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:09.098860 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093854f4-3e7c-4c5c-bc5a-b5af9f016551 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:09.100273 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093854f4-3e7c-4c5c-bc5a-b5af9f016551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:09.109543 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb4d2e-777e-44e6-b1f6-82c6f3096c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:09.110431 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb4d2e-777e-44e6-b1f6-82c6f3096c15 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:09.110867 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb4d2e-777e-44e6-b1f6-82c6f3096c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:09.111231 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb4d2e-777e-44e6-b1f6-82c6f3096c15 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:09.112054 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb4d2e-777e-44e6-b1f6-82c6f3096c15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:09.114443 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb4d2e-777e-44e6-b1f6-82c6f3096c15 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:09.175119 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 835/1658] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:08 2021] POST /identity/v3/users => generated 290 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:09.176586 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb4d2e-777e-44e6-b1f6-82c6f3096c15 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:09.179795 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-71eb4d2e-777e-44e6-b1f6-82c6f3096c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:09.199080 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-093854f4-3e7c-4c5c-bc5a-b5af9f016551 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:09.200261 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-093854f4-3e7c-4c5c-bc5a-b5af9f016551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:09.234211 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb4d2e-777e-44e6-b1f6-82c6f3096c15 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:09.237622 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 824/1659] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:09.245978 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2a4d0-b5c8-4161-9a90-2e2bbf475abc None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:09.246273 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2a4d0-b5c8-4161-9a90-2e2bbf475abc None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:09.246706 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2a4d0-b5c8-4161-9a90-2e2bbf475abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:09.270380 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb05a2-8175-46aa-b506-7ed90dc299de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:09.271264 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb05a2-8175-46aa-b506-7ed90dc299de admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:09.271662 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb05a2-8175-46aa-b506-7ed90dc299de admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:09.272042 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb05a2-8175-46aa-b506-7ed90dc299de admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:09.273033 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb05a2-8175-46aa-b506-7ed90dc299de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:09.274869 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb05a2-8175-46aa-b506-7ed90dc299de admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:09.301519 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 836/1660] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:09 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:37:09.305829 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb05a2-8175-46aa-b506-7ed90dc299de admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:09.329420 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb05a2-8175-46aa-b506-7ed90dc299de admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:09.335182 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd974f78-54e3-4519-b5b6-d4e6f8735093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:09.335949 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-88f2a4d0-b5c8-4161-9a90-2e2bbf475abc None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:09.336482 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd974f78-54e3-4519-b5b6-d4e6f8735093 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:09.336978 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd974f78-54e3-4519-b5b6-d4e6f8735093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:09.337548 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd974f78-54e3-4519-b5b6-d4e6f8735093 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:09.338247 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-88f2a4d0-b5c8-4161-9a90-2e2bbf475abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:09.338837 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd974f78-54e3-4519-b5b6-d4e6f8735093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:09.340897 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd974f78-54e3-4519-b5b6-d4e6f8735093 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:09.360361 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 825/1661] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:09.364661 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2a4d0-b5c8-4161-9a90-2e2bbf475abc None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:09.377086 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 837/1662] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:09 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:37:09.381128 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd974f78-54e3-4519-b5b6-d4e6f8735093 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:09.391706 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd974f78-54e3-4519-b5b6-d4e6f8735093 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:09.396518 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2a4d0-b5c8-4161-9a90-2e2bbf475abc None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:09.407763 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51613c74-7565-45c9-9186-9d0a98268fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:09.408379 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d507842-4796-42aa-8c39-11f82d80926f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:09.408513 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51613c74-7565-45c9-9186-9d0a98268fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:09.408732 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51613c74-7565-45c9-9186-9d0a98268fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:09.409009 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51613c74-7565-45c9-9186-9d0a98268fc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:09.409753 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d507842-4796-42aa-8c39-11f82d80926f admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:09.409874 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51613c74-7565-45c9-9186-9d0a98268fc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:37:09.410058 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51613c74-7565-45c9-9186-9d0a98268fc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:09.410163 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d507842-4796-42aa-8c39-11f82d80926f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:09.410541 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d507842-4796-42aa-8c39-11f82d80926f admin admin] PATH_INFO: `/v3/projects/d02734facc9947519cb74888c7318ce3/users/919b425a861d481e9605460f0747f937/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:09.420075 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51613c74-7565-45c9-9186-9d0a98268fc6 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:09.439903 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d507842-4796-42aa-8c39-11f82d80926f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d02734facc9947519cb74888c7318ce3, user_id=919b425a861d481e9605460f0747f937, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:09.443297 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d507842-4796-42aa-8c39-11f82d80926f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:09.452742 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 826/1663] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:37:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:37:09.454488 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51613c74-7565-45c9-9186-9d0a98268fc6 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:09.479592 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51613c74-7565-45c9-9186-9d0a98268fc6 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:09.481031 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 838/1664] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:09 2021] PUT /identity/v3/projects/d02734facc9947519cb74888c7318ce3/users/919b425a861d481e9605460f0747f937/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:37:09.492379 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4a6d4-40b0-4754-afe3-c57433c5e7fc None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:09.492793 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4a6d4-40b0-4754-afe3-c57433c5e7fc None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:09.493202 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4a6d4-40b0-4754-afe3-c57433c5e7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:09.548812 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-0cb4a6d4-40b0-4754-afe3-c57433c5e7fc None None] MFA Rules not processed for user `919b425a861d481e9605460f0747f937`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:09.552840 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-0cb4a6d4-40b0-4754-afe3-c57433c5e7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:09.703673 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25dfdc4-eed7-4930-8a84-2bab9685ca4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:09.704690 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dfdc4-eed7-4930-8a84-2bab9685ca4c admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:09.705121 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dfdc4-eed7-4930-8a84-2bab9685ca4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:09.705729 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dfdc4-eed7-4930-8a84-2bab9685ca4c admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:09.706793 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25dfdc4-eed7-4930-8a84-2bab9685ca4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:09.709252 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25dfdc4-eed7-4930-8a84-2bab9685ca4c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:09.738278 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 839/1665] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:09 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:37:09.742838 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4a6d4-40b0-4754-afe3-c57433c5e7fc None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:09.772782 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 827/1666] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:09 2021] POST /identity/v3/projects => generated 373 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:09.776566 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25dfdc4-eed7-4930-8a84-2bab9685ca4c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:09.777297 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4a6d4-40b0-4754-afe3-c57433c5e7fc None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:09.913967 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25dfdc4-eed7-4930-8a84-2bab9685ca4c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:09.914306 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034db352-062d-44f8-a2f8-6b419ec7556a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:09.915161 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034db352-062d-44f8-a2f8-6b419ec7556a admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:09.915551 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034db352-062d-44f8-a2f8-6b419ec7556a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:09.915931 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034db352-062d-44f8-a2f8-6b419ec7556a admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:09.916764 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034db352-062d-44f8-a2f8-6b419ec7556a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:09.918953 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034db352-062d-44f8-a2f8-6b419ec7556a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:09.919568 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b7bc8-bb5a-48c4-bdc6-a1ea5a21def4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:09.920995 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b7bc8-bb5a-48c4-bdc6-a1ea5a21def4 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:09.921289 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b7bc8-bb5a-48c4-bdc6-a1ea5a21def4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:09.921543 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b7bc8-bb5a-48c4-bdc6-a1ea5a21def4 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:09.922256 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b7bc8-bb5a-48c4-bdc6-a1ea5a21def4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:09.924296 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b7bc8-bb5a-48c4-bdc6-a1ea5a21def4 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:09.954163 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 828/1667] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:09 2021] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:09.958309 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b7bc8-bb5a-48c4-bdc6-a1ea5a21def4 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:09.973273 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b7bc8-bb5a-48c4-bdc6-a1ea5a21def4 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:09.987384 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 840/1668] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:09 2021] POST /identity/v3/projects => generated 379 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:37:09.991476 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034db352-062d-44f8-a2f8-6b419ec7556a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:09.992092 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66a82f-46b8-4424-856a-2fbaf8f77737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:09.994287 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66a82f-46b8-4424-856a-2fbaf8f77737 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:09.994906 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66a82f-46b8-4424-856a-2fbaf8f77737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:09.996689 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66a82f-46b8-4424-856a-2fbaf8f77737 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:09.997616 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66a82f-46b8-4424-856a-2fbaf8f77737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:10.002280 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66a82f-46b8-4424-856a-2fbaf8f77737 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:10.030547 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 829/1669] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:09 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:10.031805 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66a82f-46b8-4424-856a-2fbaf8f77737 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:10.053074 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66a82f-46b8-4424-856a-2fbaf8f77737 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:10.123243 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034db352-062d-44f8-a2f8-6b419ec7556a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:10.134161 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9baac-27c4-4b2b-a43e-5df308e4fb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:10.134161 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9baac-27c4-4b2b-a43e-5df308e4fb4f admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:10.134161 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9baac-27c4-4b2b-a43e-5df308e4fb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:10.134161 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9baac-27c4-4b2b-a43e-5df308e4fb4f admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:10.135172 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9baac-27c4-4b2b-a43e-5df308e4fb4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:10.140113 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9baac-27c4-4b2b-a43e-5df308e4fb4f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:10.179103 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 841/1670] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:09 2021] POST /identity/v3/users => generated 296 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:10.180157 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9baac-27c4-4b2b-a43e-5df308e4fb4f admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:10.204914 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9baac-27c4-4b2b-a43e-5df308e4fb4f admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:10.209879 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903c237-904e-41e0-b96f-cd91c2c97e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:10.210459 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86fc61-9f94-4c86-9add-dd505323c9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:10.210836 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903c237-904e-41e0-b96f-cd91c2c97e0c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:10.211202 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86fc61-9f94-4c86-9add-dd505323c9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:10.211316 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903c237-904e-41e0-b96f-cd91c2c97e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:10.211474 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86fc61-9f94-4c86-9add-dd505323c9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:10.211749 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86fc61-9f94-4c86-9add-dd505323c9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:10.212024 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903c237-904e-41e0-b96f-cd91c2c97e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:10.212505 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86fc61-9f94-4c86-9add-dd505323c9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:10.212987 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903c237-904e-41e0-b96f-cd91c2c97e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:10.214273 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86fc61-9f94-4c86-9add-dd505323c9f0 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:10.214902 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903c237-904e-41e0-b96f-cd91c2c97e0c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:10.227489 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 830/1671] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:10 2021] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:10.231369 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86fc61-9f94-4c86-9add-dd505323c9f0 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:10.238765 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 842/1672] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:10 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:10.240672 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903c237-904e-41e0-b96f-cd91c2c97e0c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:10.244029 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86fc61-9f94-4c86-9add-dd505323c9f0 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:10.263498 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903c237-904e-41e0-b96f-cd91c2c97e0c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:10.264601 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543210a-25bb-4447-bd5b-c5ea3ebd563b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:10.265912 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543210a-25bb-4447-bd5b-c5ea3ebd563b admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:10.266428 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543210a-25bb-4447-bd5b-c5ea3ebd563b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:10.266872 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543210a-25bb-4447-bd5b-c5ea3ebd563b admin admin] PATH_INFO: `/v3/projects/20a0f853fce04e269e6193fa33670d1f/users/96a45c5f2417482eac820a58322c796d/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:10.270303 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780311e-fc44-4212-8fc3-d69e59bab281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:10.271431 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780311e-fc44-4212-8fc3-d69e59bab281 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:10.271868 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780311e-fc44-4212-8fc3-d69e59bab281 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:10.272243 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780311e-fc44-4212-8fc3-d69e59bab281 admin admin] PATH_INFO: `/v3/projects/87b0bb039133413781094cbc235ed4c8/users/bf19ee3271094cd69b6ce38b8ed28f56/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:10.291122 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543210a-25bb-4447-bd5b-c5ea3ebd563b admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a0f853fce04e269e6193fa33670d1f, user_id=96a45c5f2417482eac820a58322c796d, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:10.296224 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543210a-25bb-4447-bd5b-c5ea3ebd563b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:10.297187 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780311e-fc44-4212-8fc3-d69e59bab281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b0bb039133413781094cbc235ed4c8, user_id=bf19ee3271094cd69b6ce38b8ed28f56, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:10.300087 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780311e-fc44-4212-8fc3-d69e59bab281 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:10.330650 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 843/1673] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:10 2021] PUT /identity/v3/projects/87b0bb039133413781094cbc235ed4c8/users/bf19ee3271094cd69b6ce38b8ed28f56/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:10.340687 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafecd39-480f-4cb0-a385-b9c15791a55e None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:10.341321 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafecd39-480f-4cb0-a385-b9c15791a55e None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:10.342197 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafecd39-480f-4cb0-a385-b9c15791a55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:10.356118 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 831/1674] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:10 2021] PUT /identity/v3/projects/20a0f853fce04e269e6193fa33670d1f/users/96a45c5f2417482eac820a58322c796d/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:10.360855 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543210a-25bb-4447-bd5b-c5ea3ebd563b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:10.420951 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-dafecd39-480f-4cb0-a385-b9c15791a55e None None] MFA Rules not processed for user `bf19ee3271094cd69b6ce38b8ed28f56`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:10.432271 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-dafecd39-480f-4cb0-a385-b9c15791a55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:10.520217 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543210a-25bb-4447-bd5b-c5ea3ebd563b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:10.556780 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 844/1675] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:10 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:10.562422 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafecd39-480f-4cb0-a385-b9c15791a55e None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:10.631812 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bf0a0-68f3-4b67-9f66-23937201b29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:10.632519 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bf0a0-68f3-4b67-9f66-23937201b29e admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:10.632801 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bf0a0-68f3-4b67-9f66-23937201b29e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:10.633078 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bf0a0-68f3-4b67-9f66-23937201b29e admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:10.633856 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1bf0a0-68f3-4b67-9f66-23937201b29e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:10.660493 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1bf0a0-68f3-4b67-9f66-23937201b29e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:10.689565 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 832/1676] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:10 2021] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:10.694918 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bf0a0-68f3-4b67-9f66-23937201b29e admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:10.724601 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bf0a0-68f3-4b67-9f66-23937201b29e admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:10.726017 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafecd39-480f-4cb0-a385-b9c15791a55e None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:10.739206 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fece9-f430-4cff-9f2f-0e1604e000fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:10.740133 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fece9-f430-4cff-9f2f-0e1604e000fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:10.740420 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fece9-f430-4cff-9f2f-0e1604e000fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:10.740678 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fece9-f430-4cff-9f2f-0e1604e000fe admin admin] PATH_INFO: `/v3/projects/20a0f853fce04e269e6193fa33670d1f/users/96a45c5f2417482eac820a58322c796d/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:10.742183 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d99544-c0a6-41f8-be01-e8e8368bae9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:10.743691 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d99544-c0a6-41f8-be01-e8e8368bae9b admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:10.743815 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d99544-c0a6-41f8-be01-e8e8368bae9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:10.744083 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d99544-c0a6-41f8-be01-e8e8368bae9b admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:10.744816 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d99544-c0a6-41f8-be01-e8e8368bae9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:10.747373 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fece9-f430-4cff-9f2f-0e1604e000fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a0f853fce04e269e6193fa33670d1f, user_id=96a45c5f2417482eac820a58322c796d, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:10.750034 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fece9-f430-4cff-9f2f-0e1604e000fe admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:10.753144 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d99544-c0a6-41f8-be01-e8e8368bae9b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:10.778673 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 833/1677] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:10 2021] PUT /identity/v3/projects/20a0f853fce04e269e6193fa33670d1f/users/96a45c5f2417482eac820a58322c796d/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:10.802980 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02e27b-a8fc-4e6e-9b33-7cf184d8bcd2 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:10.803405 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02e27b-a8fc-4e6e-9b33-7cf184d8bcd2 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:10.803665 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02e27b-a8fc-4e6e-9b33-7cf184d8bcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:10.825364 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 845/1678] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:10 2021] POST /identity/v3/projects => generated 373 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:10.837930 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d99544-c0a6-41f8-be01-e8e8368bae9b admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:10.878267 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-1e02e27b-a8fc-4e6e-9b33-7cf184d8bcd2 None None] MFA Rules not processed for user `96a45c5f2417482eac820a58322c796d`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:10.879576 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-1e02e27b-a8fc-4e6e-9b33-7cf184d8bcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:10.990629 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d99544-c0a6-41f8-be01-e8e8368bae9b admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:10.996734 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a884090-729e-4e46-a1f7-05e6bf6d9c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:10.997428 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a884090-729e-4e46-a1f7-05e6bf6d9c8d admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:10.997759 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a884090-729e-4e46-a1f7-05e6bf6d9c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:10.998003 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a884090-729e-4e46-a1f7-05e6bf6d9c8d admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:10.998709 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a884090-729e-4e46-a1f7-05e6bf6d9c8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:11.015674 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a884090-729e-4e46-a1f7-05e6bf6d9c8d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:11.024203 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 834/1679] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:10 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:11.030561 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02e27b-a8fc-4e6e-9b33-7cf184d8bcd2 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:11.052307 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02e27b-a8fc-4e6e-9b33-7cf184d8bcd2 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:11.061933 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0e493-effc-4ba4-8d1e-4e1739b70ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:11.063093 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0e493-effc-4ba4-8d1e-4e1739b70ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:11.063558 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0e493-effc-4ba4-8d1e-4e1739b70ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:11.063944 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0e493-effc-4ba4-8d1e-4e1739b70ba9 admin admin] PATH_INFO: `/v3/users/919b425a861d481e9605460f0747f937` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:11.065610 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0e493-effc-4ba4-8d1e-4e1739b70ba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=919b425a861d481e9605460f0747f937)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:11.068525 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 846/1680] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:10 2021] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:11.068816 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0e493-effc-4ba4-8d1e-4e1739b70ba9 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:11.072803 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a884090-729e-4e46-a1f7-05e6bf6d9c8d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:11.089727 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a884090-729e-4e46-a1f7-05e6bf6d9c8d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:11.101819 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a301c-60a3-4d07-8b54-15009bed2437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:11.102513 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a301c-60a3-4d07-8b54-15009bed2437 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:11.102835 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a301c-60a3-4d07-8b54-15009bed2437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:11.103809 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a301c-60a3-4d07-8b54-15009bed2437 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:11.103942 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a301c-60a3-4d07-8b54-15009bed2437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:11.105523 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a301c-60a3-4d07-8b54-15009bed2437 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:11.147150 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 847/1681] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:11 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:37:11.154943 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a301c-60a3-4d07-8b54-15009bed2437 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:11.173261 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-13c0e493-effc-4ba4-8d1e-4e1739b70ba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '919b425a861d481e9605460f0747f937'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:11.174431 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-13c0e493-effc-4ba4-8d1e-4e1739b70ba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '919b425a861d481e9605460f0747f937'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:11.182076 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a301c-60a3-4d07-8b54-15009bed2437 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:11.189798 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-13c0e493-effc-4ba4-8d1e-4e1739b70ba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '919b425a861d481e9605460f0747f937'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:11.197084 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3162253-1e77-4ce5-8707-825c2313960c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:11.198655 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3162253-1e77-4ce5-8707-825c2313960c admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:11.198994 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3162253-1e77-4ce5-8707-825c2313960c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:11.201054 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3162253-1e77-4ce5-8707-825c2313960c admin admin] PATH_INFO: `/v3/projects/1c69709ca61e4078b83e0e68d4ced3a3/users/2259b320514d410baf538d1a1d054721/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:11.210473 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-13c0e493-effc-4ba4-8d1e-4e1739b70ba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '919b425a861d481e9605460f0747f937'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:11.244976 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3162253-1e77-4ce5-8707-825c2313960c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c69709ca61e4078b83e0e68d4ced3a3, user_id=2259b320514d410baf538d1a1d054721, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:11.245231 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-13c0e493-effc-4ba4-8d1e-4e1739b70ba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '919b425a861d481e9605460f0747f937'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:11.256488 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3162253-1e77-4ce5-8707-825c2313960c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:11.263140 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 835/1682] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:37:11 2021] DELETE /identity/v3/users/919b425a861d481e9605460f0747f937 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:11.278926 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a3982-e3c8-4f0c-ab37-a508cd1fa9a0 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:11.280885 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a3982-e3c8-4f0c-ab37-a508cd1fa9a0 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:11.281172 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a3982-e3c8-4f0c-ab37-a508cd1fa9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:11.299300 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 848/1683] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:11 2021] PUT /identity/v3/projects/1c69709ca61e4078b83e0e68d4ced3a3/users/2259b320514d410baf538d1a1d054721/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:11.302748 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3162253-1e77-4ce5-8707-825c2313960c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:11.308730 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-2c0a3982-e3c8-4f0c-ab37-a508cd1fa9a0 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:11.311551 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-f3162253-1e77-4ce5-8707-825c2313960c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:11.311792 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-2c0a3982-e3c8-4f0c-ab37-a508cd1fa9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:11.403191 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3162253-1e77-4ce5-8707-825c2313960c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:11.409487 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f69a92-d68f-4097-a41c-8a930c986431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:11.411119 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f69a92-d68f-4097-a41c-8a930c986431 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:11.411481 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f69a92-d68f-4097-a41c-8a930c986431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:11.411826 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f69a92-d68f-4097-a41c-8a930c986431 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:11.413137 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f69a92-d68f-4097-a41c-8a930c986431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:11.415974 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f69a92-d68f-4097-a41c-8a930c986431 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:11.429932 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 849/1684] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:11 2021] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:11.434784 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f69a92-d68f-4097-a41c-8a930c986431 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:11.447526 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f69a92-d68f-4097-a41c-8a930c986431 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:11.453122 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1466af-f0df-4eb6-a697-a962a34156bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:11.454818 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1466af-f0df-4eb6-a697-a962a34156bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:11.454818 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1466af-f0df-4eb6-a697-a962a34156bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:11.455026 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1466af-f0df-4eb6-a697-a962a34156bc admin admin] PATH_INFO: `/v3/projects/1c69709ca61e4078b83e0e68d4ced3a3/users/2259b320514d410baf538d1a1d054721/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:11.456325 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 836/1685] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:11.466329 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1466af-f0df-4eb6-a697-a962a34156bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c69709ca61e4078b83e0e68d4ced3a3, user_id=2259b320514d410baf538d1a1d054721, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:11.470288 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1466af-f0df-4eb6-a697-a962a34156bc admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:11.518597 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a3982-e3c8-4f0c-ab37-a508cd1fa9a0 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:11.520089 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-2c0a3982-e3c8-4f0c-ab37-a508cd1fa9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:11.542948 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 850/1686] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:11 2021] PUT /identity/v3/projects/1c69709ca61e4078b83e0e68d4ced3a3/users/2259b320514d410baf538d1a1d054721/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:11.556126 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84078fc-d2a5-471c-b4be-e2fcd6450eb5 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:11.556400 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84078fc-d2a5-471c-b4be-e2fcd6450eb5 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:11.556693 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84078fc-d2a5-471c-b4be-e2fcd6450eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:11.659650 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-f84078fc-d2a5-471c-b4be-e2fcd6450eb5 None None] MFA Rules not processed for user `2259b320514d410baf538d1a1d054721`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:11.672021 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-f84078fc-d2a5-471c-b4be-e2fcd6450eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:11.681622 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a3982-e3c8-4f0c-ab37-a508cd1fa9a0 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:11.782334 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e192b8a-0a31-4fa4-9260-e92906216e20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:11.783053 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e192b8a-0a31-4fa4-9260-e92906216e20 service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:11.783403 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e192b8a-0a31-4fa4-9260-e92906216e20 service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:11.783749 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e192b8a-0a31-4fa4-9260-e92906216e20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:11.787322 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 851/1687] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:11 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:37:11.801865 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84078fc-d2a5-471c-b4be-e2fcd6450eb5 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:11.803641 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-f84078fc-d2a5-471c-b4be-e2fcd6450eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:11.917246 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e192b8a-0a31-4fa4-9260-e92906216e20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:11.919083 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e192b8a-0a31-4fa4-9260-e92906216e20 service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:11.950593 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 837/1688] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:11.951961 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84078fc-d2a5-471c-b4be-e2fcd6450eb5 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:11.963654 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4a6ab-7caa-4d68-86e1-da1228764a85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:11.964475 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4a6ab-7caa-4d68-86e1-da1228764a85 service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:11.964821 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4a6ab-7caa-4d68-86e1-da1228764a85 service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:11.965158 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4a6ab-7caa-4d68-86e1-da1228764a85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:11.989511 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4a6ab-7caa-4d68-86e1-da1228764a85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:11.991146 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4a6ab-7caa-4d68-86e1-da1228764a85 service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:12.015613 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 852/1689] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:11 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:12.150166 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec754858-e7fe-4c15-8b66-fc775e68fd98 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:12.150783 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec754858-e7fe-4c15-8b66-fc775e68fd98 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:12.150955 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec754858-e7fe-4c15-8b66-fc775e68fd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:12.269579 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-ec754858-e7fe-4c15-8b66-fc775e68fd98 None None] MFA Rules not processed for user `fb71aef5ce61461b9c92f8bf4869af1d`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:12.275207 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-ec754858-e7fe-4c15-8b66-fc775e68fd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:12.508891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 838/1690] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:12 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:12.632497 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4a6ab-7caa-4d68-86e1-da1228764a85 service cinder] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:12.634136 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-9ae4a6ab-7caa-4d68-86e1-da1228764a85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:12.677856 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd03601-9491-48c5-97f6-5e9ce60b762f None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:12.678192 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd03601-9491-48c5-97f6-5e9ce60b762f None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:12.678411 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd03601-9491-48c5-97f6-5e9ce60b762f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:12.783177 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-fbd03601-9491-48c5-97f6-5e9ce60b762f None None] MFA Rules not processed for user `8b1e077f454b471ba851db9431f1011d`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:12.787806 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-fbd03601-9491-48c5-97f6-5e9ce60b762f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:12.940331 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4a6ab-7caa-4d68-86e1-da1228764a85 service cinder] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:12.964777 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fb573-cc24-4c48-93f8-c2eef87e8a4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:12.966589 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fb573-cc24-4c48-93f8-c2eef87e8a4f service nova] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:12.967001 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fb573-cc24-4c48-93f8-c2eef87e8a4f service nova] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:12.967369 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fb573-cc24-4c48-93f8-c2eef87e8a4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:12.977917 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fb573-cc24-4c48-93f8-c2eef87e8a4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:12.979693 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fb573-cc24-4c48-93f8-c2eef87e8a4f service nova] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:12.990582 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 853/1691] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:12 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:12.991667 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fb573-cc24-4c48-93f8-c2eef87e8a4f service nova] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:13.015855 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fb573-cc24-4c48-93f8-c2eef87e8a4f service nova] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:13.018713 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 839/1692] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:12 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:37:13.025939 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd03601-9491-48c5-97f6-5e9ce60b762f None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:13.028602 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-fbd03601-9491-48c5-97f6-5e9ce60b762f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:13.033939 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6f269-5f3e-4673-85d7-5c935b4aa8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:13.035156 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6f269-5f3e-4673-85d7-5c935b4aa8d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:13.035546 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6f269-5f3e-4673-85d7-5c935b4aa8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:13.035918 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6f269-5f3e-4673-85d7-5c935b4aa8d9 admin admin] PATH_INFO: `/v3/users/bf19ee3271094cd69b6ce38b8ed28f56` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:13.038948 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6f269-5f3e-4673-85d7-5c935b4aa8d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf19ee3271094cd69b6ce38b8ed28f56)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:13.041035 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6f269-5f3e-4673-85d7-5c935b4aa8d9 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:13.069607 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd03601-9491-48c5-97f6-5e9ce60b762f None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:13.083708 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cffc1c-eca4-40da-a1e2-2074cacd7c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:13.084758 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cffc1c-eca4-40da-a1e2-2074cacd7c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:13.085138 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cffc1c-eca4-40da-a1e2-2074cacd7c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:13.087273 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cffc1c-eca4-40da-a1e2-2074cacd7c52 admin admin] PATH_INFO: `/v3/projects/d02734facc9947519cb74888c7318ce3` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:13.091612 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cffc1c-eca4-40da-a1e2-2074cacd7c52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d02734facc9947519cb74888c7318ce3)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:13.093720 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cffc1c-eca4-40da-a1e2-2074cacd7c52 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:13.176616 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-18d6f269-5f3e-4673-85d7-5c935b4aa8d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf19ee3271094cd69b6ce38b8ed28f56'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:13.198479 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a0cffc1c-eca4-40da-a1e2-2074cacd7c52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd02734facc9947519cb74888c7318ce3', 'request_id': 'req-a0cffc1c-eca4-40da-a1e2-2074cacd7c52'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:13.202173 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-18d6f269-5f3e-4673-85d7-5c935b4aa8d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf19ee3271094cd69b6ce38b8ed28f56'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:13.203157 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-18d6f269-5f3e-4673-85d7-5c935b4aa8d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf19ee3271094cd69b6ce38b8ed28f56'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:13.221949 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a0cffc1c-eca4-40da-a1e2-2074cacd7c52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd02734facc9947519cb74888c7318ce3', 'request_id': 'req-a0cffc1c-eca4-40da-a1e2-2074cacd7c52'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:13.225238 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-18d6f269-5f3e-4673-85d7-5c935b4aa8d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf19ee3271094cd69b6ce38b8ed28f56'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:13.242846 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-18d6f269-5f3e-4673-85d7-5c935b4aa8d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf19ee3271094cd69b6ce38b8ed28f56'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:13.248050 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a0cffc1c-eca4-40da-a1e2-2074cacd7c52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd02734facc9947519cb74888c7318ce3', 'request_id': 'req-a0cffc1c-eca4-40da-a1e2-2074cacd7c52'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:13.271839 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 854/1693] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:37:12 2021] DELETE /identity/v3/users/bf19ee3271094cd69b6ce38b8ed28f56 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:13.271839 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6f269-5f3e-4673-85d7-5c935b4aa8d9 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:13.275200 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-18d6f269-5f3e-4673-85d7-5c935b4aa8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:13.275411 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a0cffc1c-eca4-40da-a1e2-2074cacd7c52 admin admin] The token cache is being invalidate because project d02734facc9947519cb74888c7318ce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:37:13.277225 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a0cffc1c-eca4-40da-a1e2-2074cacd7c52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:13.280816 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a0cffc1c-eca4-40da-a1e2-2074cacd7c52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:13.285835 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 840/1694] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:37:13 2021] DELETE /identity/v3/projects/d02734facc9947519cb74888c7318ce3 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:13.288663 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a33d77-191b-40cc-ad67-82a7dbf64e89 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:13.289216 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a33d77-191b-40cc-ad67-82a7dbf64e89 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:13.293181 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a33d77-191b-40cc-ad67-82a7dbf64e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:13.335249 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-90a33d77-191b-40cc-ad67-82a7dbf64e89 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:13.338385 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-90a33d77-191b-40cc-ad67-82a7dbf64e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:13.474283 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6f269-5f3e-4673-85d7-5c935b4aa8d9 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:13.492986 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e270470-cdc5-4ef9-acb4-bfe697f88454 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:13.493830 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e270470-cdc5-4ef9-acb4-bfe697f88454 service nova] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:13.494237 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e270470-cdc5-4ef9-acb4-bfe697f88454 service nova] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:13.495362 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e270470-cdc5-4ef9-acb4-bfe697f88454 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:13.497920 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-8e270470-cdc5-4ef9-acb4-bfe697f88454 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:13.506297 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 841/1695] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:13.511794 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a33d77-191b-40cc-ad67-82a7dbf64e89 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:13.516119 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-90a33d77-191b-40cc-ad67-82a7dbf64e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:13.547142 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a33d77-191b-40cc-ad67-82a7dbf64e89 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:13.571722 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52f159-bba9-4724-9ef9-0080e992f2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:13.573973 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52f159-bba9-4724-9ef9-0080e992f2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:13.574451 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52f159-bba9-4724-9ef9-0080e992f2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:13.574938 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52f159-bba9-4724-9ef9-0080e992f2ac admin admin] PATH_INFO: `/v3/users/96a45c5f2417482eac820a58322c796d` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:13.578020 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52f159-bba9-4724-9ef9-0080e992f2ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=96a45c5f2417482eac820a58322c796d)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:13.583816 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52f159-bba9-4724-9ef9-0080e992f2ac admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:13.680930 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e270470-cdc5-4ef9-acb4-bfe697f88454 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:13.685145 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e270470-cdc5-4ef9-acb4-bfe697f88454 service nova] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:13.719338 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 855/1696] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:13 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:13.720436 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e270470-cdc5-4ef9-acb4-bfe697f88454 service nova] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:13.724984 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-8e270470-cdc5-4ef9-acb4-bfe697f88454 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:13.814805 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-fd52f159-bba9-4724-9ef9-0080e992f2ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96a45c5f2417482eac820a58322c796d'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:13.816108 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-fd52f159-bba9-4724-9ef9-0080e992f2ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96a45c5f2417482eac820a58322c796d'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:13.831083 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-fd52f159-bba9-4724-9ef9-0080e992f2ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96a45c5f2417482eac820a58322c796d'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:13.869833 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-fd52f159-bba9-4724-9ef9-0080e992f2ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96a45c5f2417482eac820a58322c796d'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:13.918602 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e270470-cdc5-4ef9-acb4-bfe697f88454 service nova] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:13.939528 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-fd52f159-bba9-4724-9ef9-0080e992f2ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96a45c5f2417482eac820a58322c796d'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:13.940352 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6ac4b-ff41-45da-8e02-3b53b13deb46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:13.941398 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6ac4b-ff41-45da-8e02-3b53b13deb46 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:13.941996 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6ac4b-ff41-45da-8e02-3b53b13deb46 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:13.943060 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6ac4b-ff41-45da-8e02-3b53b13deb46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:13.951968 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-13e6ac4b-ff41-45da-8e02-3b53b13deb46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:13.964423 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 842/1697] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:37:13 2021] DELETE /identity/v3/users/96a45c5f2417482eac820a58322c796d => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:13.975966 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8c628-f220-4425-ba2a-a19241539024 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:13.976443 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8c628-f220-4425-ba2a-a19241539024 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:13.979293 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8c628-f220-4425-ba2a-a19241539024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:13.986351 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6ac4b-ff41-45da-8e02-3b53b13deb46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:13.989164 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6ac4b-ff41-45da-8e02-3b53b13deb46 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:14.027358 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 856/1698] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:14.054304 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-30f8c628-f220-4425-ba2a-a19241539024 None None] MFA Rules not processed for user `a689fc75b37b4557a682f6cad357df6c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:14.058379 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-30f8c628-f220-4425-ba2a-a19241539024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:14.205247 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 843/1699] 10.222.0.72 () {58 vars in 1015 bytes} [Thu Oct 28 14:37:13 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:14.233679 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6ac4b-ff41-45da-8e02-3b53b13deb46 service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:14.235669 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-13e6ac4b-ff41-45da-8e02-3b53b13deb46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:14.274229 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6ac4b-ff41-45da-8e02-3b53b13deb46 service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:14.299701 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af107029-8896-4dc5-b8a0-d7ab582dc23a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:14.305127 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af107029-8896-4dc5-b8a0-d7ab582dc23a service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:14.305600 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af107029-8896-4dc5-b8a0-d7ab582dc23a service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:14.306042 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af107029-8896-4dc5-b8a0-d7ab582dc23a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:14.350598 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af107029-8896-4dc5-b8a0-d7ab582dc23a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:14.352484 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af107029-8896-4dc5-b8a0-d7ab582dc23a service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:14.382440 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 857/1700] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:14 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:14.513630 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8c628-f220-4425-ba2a-a19241539024 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:14.515509 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-30f8c628-f220-4425-ba2a-a19241539024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:14.532456 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8c628-f220-4425-ba2a-a19241539024 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:14.553679 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0af99-3410-4bea-af97-9005b742c80f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:14.554482 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0af99-3410-4bea-af97-9005b742c80f service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:14.554482 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0af99-3410-4bea-af97-9005b742c80f service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:14.554727 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0af99-3410-4bea-af97-9005b742c80f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:14.580078 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0af99-3410-4bea-af97-9005b742c80f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:14.581635 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0af99-3410-4bea-af97-9005b742c80f service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:14.607027 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 844/1701] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:14 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:17.096424 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af107029-8896-4dc5-b8a0-d7ab582dc23a service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:17.103760 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-af107029-8896-4dc5-b8a0-d7ab582dc23a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:17.215087 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0af99-3410-4bea-af97-9005b742c80f service neutron] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:17.217174 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-57d0af99-3410-4bea-af97-9005b742c80f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:17.319785 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af107029-8896-4dc5-b8a0-d7ab582dc23a service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:17.334134 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92563c76-42e9-44fe-a362-6ebbe609b752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:17.335063 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92563c76-42e9-44fe-a362-6ebbe609b752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:17.335537 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92563c76-42e9-44fe-a362-6ebbe609b752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:17.335824 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92563c76-42e9-44fe-a362-6ebbe609b752 admin admin] PATH_INFO: `/v3/users/0fb8aa7d16504da1832744813f7b7739` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:17.339505 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92563c76-42e9-44fe-a362-6ebbe609b752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fb8aa7d16504da1832744813f7b7739)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:17.341747 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92563c76-42e9-44fe-a362-6ebbe609b752 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:17.347590 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0af99-3410-4bea-af97-9005b742c80f service neutron] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:17.354499 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2a096-9f0b-4d96-b3b3-0b55e09f0c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:17.356259 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2a096-9f0b-4d96-b3b3-0b55e09f0c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:17.356697 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2a096-9f0b-4d96-b3b3-0b55e09f0c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:17.357832 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2a096-9f0b-4d96-b3b3-0b55e09f0c6f admin admin] PATH_INFO: `/v3/projects/87b0bb039133413781094cbc235ed4c8` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:17.361412 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2a096-9f0b-4d96-b3b3-0b55e09f0c6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=87b0bb039133413781094cbc235ed4c8)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:17.364755 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2a096-9f0b-4d96-b3b3-0b55e09f0c6f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:17.492549 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-97f2a096-9f0b-4d96-b3b3-0b55e09f0c6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87b0bb039133413781094cbc235ed4c8', 'request_id': 'req-97f2a096-9f0b-4d96-b3b3-0b55e09f0c6f'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:17.514595 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-97f2a096-9f0b-4d96-b3b3-0b55e09f0c6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87b0bb039133413781094cbc235ed4c8', 'request_id': 'req-97f2a096-9f0b-4d96-b3b3-0b55e09f0c6f'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:17.515407 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-92563c76-42e9-44fe-a362-6ebbe609b752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fb8aa7d16504da1832744813f7b7739'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:17.532323 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-97f2a096-9f0b-4d96-b3b3-0b55e09f0c6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87b0bb039133413781094cbc235ed4c8', 'request_id': 'req-97f2a096-9f0b-4d96-b3b3-0b55e09f0c6f'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:17.544167 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-92563c76-42e9-44fe-a362-6ebbe609b752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fb8aa7d16504da1832744813f7b7739'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:17.544906 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-92563c76-42e9-44fe-a362-6ebbe609b752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fb8aa7d16504da1832744813f7b7739'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:17.557604 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-97f2a096-9f0b-4d96-b3b3-0b55e09f0c6f admin admin] The token cache is being invalidate because project 87b0bb039133413781094cbc235ed4c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:37:17.558323 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-97f2a096-9f0b-4d96-b3b3-0b55e09f0c6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:17.559592 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-97f2a096-9f0b-4d96-b3b3-0b55e09f0c6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:17.571105 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 845/1702] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:37:17 2021] DELETE /identity/v3/projects/87b0bb039133413781094cbc235ed4c8 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:17.578020 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-92563c76-42e9-44fe-a362-6ebbe609b752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fb8aa7d16504da1832744813f7b7739'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:17.592830 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-92563c76-42e9-44fe-a362-6ebbe609b752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fb8aa7d16504da1832744813f7b7739'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:17.608397 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 858/1703] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:37:17 2021] DELETE /identity/v3/users/0fb8aa7d16504da1832744813f7b7739 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:17.614004 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2a096-9f0b-4d96-b3b3-0b55e09f0c6f admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:17.614133 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1556d14-f9af-4dd8-99cf-e4b4c154b014 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:17.614330 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1556d14-f9af-4dd8-99cf-e4b4c154b014 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:17.614599 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1556d14-f9af-4dd8-99cf-e4b4c154b014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:17.617048 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-97f2a096-9f0b-4d96-b3b3-0b55e09f0c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:17.649392 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-f1556d14-f9af-4dd8-99cf-e4b4c154b014 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:17.650627 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-f1556d14-f9af-4dd8-99cf-e4b4c154b014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:17.754206 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2a096-9f0b-4d96-b3b3-0b55e09f0c6f admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:17.822359 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 859/1704] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:17.881548 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6427184-1cec-4491-b56c-2c5bbf2dea2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:17.882496 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6427184-1cec-4491-b56c-2c5bbf2dea2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:17.882854 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6427184-1cec-4491-b56c-2c5bbf2dea2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:17.883130 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6427184-1cec-4491-b56c-2c5bbf2dea2c admin admin] PATH_INFO: `/v3/users/2259b320514d410baf538d1a1d054721` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:17.892217 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6427184-1cec-4491-b56c-2c5bbf2dea2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2259b320514d410baf538d1a1d054721)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:17.901041 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6427184-1cec-4491-b56c-2c5bbf2dea2c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:18.009889 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1556d14-f9af-4dd8-99cf-e4b4c154b014 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:18.012808 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-f1556d14-f9af-4dd8-99cf-e4b4c154b014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:18.046351 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-f6427184-1cec-4491-b56c-2c5bbf2dea2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2259b320514d410baf538d1a1d054721'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:18.048380 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-f6427184-1cec-4491-b56c-2c5bbf2dea2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2259b320514d410baf538d1a1d054721'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:18.075016 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-f6427184-1cec-4491-b56c-2c5bbf2dea2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2259b320514d410baf538d1a1d054721'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:18.084394 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-f6427184-1cec-4491-b56c-2c5bbf2dea2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2259b320514d410baf538d1a1d054721'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:18.138026 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-f6427184-1cec-4491-b56c-2c5bbf2dea2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2259b320514d410baf538d1a1d054721'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:18.144666 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1556d14-f9af-4dd8-99cf-e4b4c154b014 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:18.151363 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28340c-7d15-453b-95d5-d743aad2f0bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:18.153164 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28340c-7d15-453b-95d5-d743aad2f0bb service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:18.153612 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28340c-7d15-453b-95d5-d743aad2f0bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:18.154033 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28340c-7d15-453b-95d5-d743aad2f0bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:18.158538 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-2e28340c-7d15-453b-95d5-d743aad2f0bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:18.160488 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 846/1705] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:37:17 2021] DELETE /identity/v3/users/2259b320514d410baf538d1a1d054721 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:18.184270 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28340c-7d15-453b-95d5-d743aad2f0bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:18.185993 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28340c-7d15-453b-95d5-d743aad2f0bb service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:18.213246 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 860/1706] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:18.496041 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687d969-b520-4ec6-9afd-e61f4211d8b4 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:18.496698 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687d969-b520-4ec6-9afd-e61f4211d8b4 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:18.496698 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687d969-b520-4ec6-9afd-e61f4211d8b4 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:18.498934 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 847/1707] 10.222.0.79 () {54 vars in 921 bytes} [Thu Oct 28 14:37:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:37:18.566648 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff58759-afe6-4be6-aebf-17c5716cd93c None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:18.567229 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff58759-afe6-4be6-aebf-17c5716cd93c None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:18.567652 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff58759-afe6-4be6-aebf-17c5716cd93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:18.599789 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-8ff58759-afe6-4be6-aebf-17c5716cd93c None None] MFA Rules not processed for user `18cd6636ae7847c78be910824410d295`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:18.604104 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-8ff58759-afe6-4be6-aebf-17c5716cd93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:18.791071 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 861/1708] 10.222.0.79 () {58 vars in 1018 bytes} [Thu Oct 28 14:37:18 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:18.829521 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687d969-b520-4ec6-9afd-e61f4211d8b4 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:18.832021 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-d687d969-b520-4ec6-9afd-e61f4211d8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:18.874988 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687d969-b520-4ec6-9afd-e61f4211d8b4 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:18.892359 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935bf0e7-58d0-496e-b8e8-1931c4e73332 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:18.893168 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bf0e7-58d0-496e-b8e8-1931c4e73332 service nova] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:18.893549 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bf0e7-58d0-496e-b8e8-1931c4e73332 service nova] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:18.893925 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bf0e7-58d0-496e-b8e8-1931c4e73332 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:18.920242 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935bf0e7-58d0-496e-b8e8-1931c4e73332 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:18.922673 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935bf0e7-58d0-496e-b8e8-1931c4e73332 service nova] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:18.937068 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 848/1709] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:18 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:19.260217 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff58759-afe6-4be6-aebf-17c5716cd93c None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:19.262275 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-8ff58759-afe6-4be6-aebf-17c5716cd93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:19.351659 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff58759-afe6-4be6-aebf-17c5716cd93c None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:19.356768 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086ceb0-995f-44fe-8c3f-d56ec0fb1380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:19.357666 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086ceb0-995f-44fe-8c3f-d56ec0fb1380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:19.358073 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086ceb0-995f-44fe-8c3f-d56ec0fb1380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:19.358852 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086ceb0-995f-44fe-8c3f-d56ec0fb1380 admin admin] PATH_INFO: `/v3/projects/20a0f853fce04e269e6193fa33670d1f` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:19.360894 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086ceb0-995f-44fe-8c3f-d56ec0fb1380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20a0f853fce04e269e6193fa33670d1f)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:19.363287 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086ceb0-995f-44fe-8c3f-d56ec0fb1380 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:19.439101 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-b086ceb0-995f-44fe-8c3f-d56ec0fb1380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20a0f853fce04e269e6193fa33670d1f', 'request_id': 'req-b086ceb0-995f-44fe-8c3f-d56ec0fb1380'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:19.451032 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-b086ceb0-995f-44fe-8c3f-d56ec0fb1380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20a0f853fce04e269e6193fa33670d1f', 'request_id': 'req-b086ceb0-995f-44fe-8c3f-d56ec0fb1380'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:19.465876 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-b086ceb0-995f-44fe-8c3f-d56ec0fb1380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20a0f853fce04e269e6193fa33670d1f', 'request_id': 'req-b086ceb0-995f-44fe-8c3f-d56ec0fb1380'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:19.481416 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-b086ceb0-995f-44fe-8c3f-d56ec0fb1380 admin admin] The token cache is being invalidate because project 20a0f853fce04e269e6193fa33670d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:37:19.481885 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-b086ceb0-995f-44fe-8c3f-d56ec0fb1380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:19.482816 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-b086ceb0-995f-44fe-8c3f-d56ec0fb1380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:19.486764 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 862/1710] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:37:19 2021] DELETE /identity/v3/projects/20a0f853fce04e269e6193fa33670d1f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:19.491544 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5790b-fef8-4448-ae4f-90f7a6f870bb None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:19.491848 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5790b-fef8-4448-ae4f-90f7a6f870bb None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:19.492097 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5790b-fef8-4448-ae4f-90f7a6f870bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:19.518276 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-83d5790b-fef8-4448-ae4f-90f7a6f870bb None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:19.519838 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-83d5790b-fef8-4448-ae4f-90f7a6f870bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:19.606437 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 849/1711] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:19.615323 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cd85d-867d-4858-b0d8-1464f2bdd4f3 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:19.615542 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cd85d-867d-4858-b0d8-1464f2bdd4f3 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:19.615782 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cd85d-867d-4858-b0d8-1464f2bdd4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:19.636082 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-b09cd85d-867d-4858-b0d8-1464f2bdd4f3 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:19.637966 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-b09cd85d-867d-4858-b0d8-1464f2bdd4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:19.655942 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 863/1712] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:19.656484 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5790b-fef8-4448-ae4f-90f7a6f870bb None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:19.667160 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5790b-fef8-4448-ae4f-90f7a6f870bb None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:19.673251 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d424cee-2026-483f-ade1-7f9191101e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:19.674593 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d424cee-2026-483f-ade1-7f9191101e01 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:19.677997 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d424cee-2026-483f-ade1-7f9191101e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:19.678308 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d424cee-2026-483f-ade1-7f9191101e01 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:19.679384 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d424cee-2026-483f-ade1-7f9191101e01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:37:19.679760 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d424cee-2026-483f-ade1-7f9191101e01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:19.681601 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d424cee-2026-483f-ade1-7f9191101e01 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:19.699997 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 850/1713] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:37:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:37:19.701343 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cd85d-867d-4858-b0d8-1464f2bdd4f3 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:19.713397 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cd85d-867d-4858-b0d8-1464f2bdd4f3 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:19.718350 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af90a4d-5644-48a7-87e8-873347a33caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:19.719085 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af90a4d-5644-48a7-87e8-873347a33caf admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:19.719360 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af90a4d-5644-48a7-87e8-873347a33caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:19.719630 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af90a4d-5644-48a7-87e8-873347a33caf admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:19.720508 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af90a4d-5644-48a7-87e8-873347a33caf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:19.722566 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af90a4d-5644-48a7-87e8-873347a33caf admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:19.764265 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 864/1714] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:19 2021] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:19.766626 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d424cee-2026-483f-ade1-7f9191101e01 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:19.778591 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d424cee-2026-483f-ade1-7f9191101e01 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:19.857975 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458489f2-b96a-4ae9-a03e-9afc0158cc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:19.859984 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458489f2-b96a-4ae9-a03e-9afc0158cc2e admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:19.860508 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458489f2-b96a-4ae9-a03e-9afc0158cc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:19.861017 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458489f2-b96a-4ae9-a03e-9afc0158cc2e admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:19.862137 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458489f2-b96a-4ae9-a03e-9afc0158cc2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:19.865086 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458489f2-b96a-4ae9-a03e-9afc0158cc2e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:19.919184 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 851/1715] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:19 2021] POST /identity/v3/users => generated 285 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:19.920279 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af90a4d-5644-48a7-87e8-873347a33caf admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:19.939781 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af90a4d-5644-48a7-87e8-873347a33caf admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:19.953875 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2f182-ec7d-4c7d-973a-9bab11430452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:19.954572 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2f182-ec7d-4c7d-973a-9bab11430452 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:19.954886 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2f182-ec7d-4c7d-973a-9bab11430452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:19.955326 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2f182-ec7d-4c7d-973a-9bab11430452 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:19.957529 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2f182-ec7d-4c7d-973a-9bab11430452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:19.960387 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2f182-ec7d-4c7d-973a-9bab11430452 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:19.986870 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 865/1716] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:19 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:19.991368 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458489f2-b96a-4ae9-a03e-9afc0158cc2e admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:20.007751 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458489f2-b96a-4ae9-a03e-9afc0158cc2e admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:20.014606 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f727d4-c595-47f6-af1b-86ca859f2349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:20.015707 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f727d4-c595-47f6-af1b-86ca859f2349 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:20.015982 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f727d4-c595-47f6-af1b-86ca859f2349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:20.016255 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f727d4-c595-47f6-af1b-86ca859f2349 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:20.017683 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f727d4-c595-47f6-af1b-86ca859f2349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:20.019666 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f727d4-c595-47f6-af1b-86ca859f2349 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:20.037130 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 852/1717] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:19 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:20.041369 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2f182-ec7d-4c7d-973a-9bab11430452 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:20.056154 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2f182-ec7d-4c7d-973a-9bab11430452 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:20.061819 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a49e82-be19-4882-81c8-5bae50907980 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:20.064617 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a49e82-be19-4882-81c8-5bae50907980 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:20.065248 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a49e82-be19-4882-81c8-5bae50907980 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:20.068312 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 853/1718] 10.222.0.79 () {54 vars in 921 bytes} [Thu Oct 28 14:37:20 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 14:37:20.072356 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4c4c9-e480-458e-8472-8a7958c9d872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:20.073617 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4c4c9-e480-458e-8472-8a7958c9d872 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:20.078197 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4c4c9-e480-458e-8472-8a7958c9d872 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:20.078574 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4c4c9-e480-458e-8472-8a7958c9d872 admin admin] PATH_INFO: `/v3/projects/9cfc4f5ec60748dfbf9edbe8defbb9e3/users/c2143d967a064b2486227bfdd589ef7a/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:20.097139 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4c4c9-e480-458e-8472-8a7958c9d872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cfc4f5ec60748dfbf9edbe8defbb9e3, user_id=c2143d967a064b2486227bfdd589ef7a, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:20.100390 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4c4c9-e480-458e-8472-8a7958c9d872 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:20.118552 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 866/1719] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:20 2021] PUT /identity/v3/projects/9cfc4f5ec60748dfbf9edbe8defbb9e3/users/c2143d967a064b2486227bfdd589ef7a/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:37:20.129169 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc8776-a356-4caa-a9d5-7838549f4ef5 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:20.129345 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc8776-a356-4caa-a9d5-7838549f4ef5 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:20.129670 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc8776-a356-4caa-a9d5-7838549f4ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:20.140984 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cf120-5d2e-4774-96b5-adbb599bd685 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:20.143201 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cf120-5d2e-4774-96b5-adbb599bd685 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:20.143732 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cf120-5d2e-4774-96b5-adbb599bd685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:20.174250 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-54cc8776-a356-4caa-a9d5-7838549f4ef5 None None] MFA Rules not processed for user `c2143d967a064b2486227bfdd589ef7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:20.175840 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-54cc8776-a356-4caa-a9d5-7838549f4ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:20.177943 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-925cf120-5d2e-4774-96b5-adbb599bd685 None None] MFA Rules not processed for user `18cd6636ae7847c78be910824410d295`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:20.180803 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-925cf120-5d2e-4774-96b5-adbb599bd685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:20.291501 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 854/1720] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:20 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:37:20.296191 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc8776-a356-4caa-a9d5-7838549f4ef5 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:20.298203 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 867/1721] 10.222.0.79 () {58 vars in 1018 bytes} [Thu Oct 28 14:37:20 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:20.301964 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cf120-5d2e-4774-96b5-adbb599bd685 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:20.303320 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-54cc8776-a356-4caa-a9d5-7838549f4ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:20.394355 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc8776-a356-4caa-a9d5-7838549f4ef5 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:20.400127 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0768e-9d80-4172-9a81-8be452641b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:20.401004 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0768e-9d80-4172-9a81-8be452641b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:20.401327 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0768e-9d80-4172-9a81-8be452641b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:20.401651 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0768e-9d80-4172-9a81-8be452641b0e admin admin] PATH_INFO: `/v3/projects/1c69709ca61e4078b83e0e68d4ced3a3` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:20.404078 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0768e-9d80-4172-9a81-8be452641b0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c69709ca61e4078b83e0e68d4ced3a3)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:20.406145 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0768e-9d80-4172-9a81-8be452641b0e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:20.424635 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cf120-5d2e-4774-96b5-adbb599bd685 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:20.430808 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836ca4a-1994-43e1-8af3-9b8f62fb99c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:20.431614 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836ca4a-1994-43e1-8af3-9b8f62fb99c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:20.431895 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836ca4a-1994-43e1-8af3-9b8f62fb99c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:20.432226 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836ca4a-1994-43e1-8af3-9b8f62fb99c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:20.432985 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836ca4a-1994-43e1-8af3-9b8f62fb99c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:20.436150 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836ca4a-1994-43e1-8af3-9b8f62fb99c3 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:20.486747 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 868/1722] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:20 2021] POST /identity/v3/projects => generated 369 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:20.490162 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836ca4a-1994-43e1-8af3-9b8f62fb99c3 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:20.495380 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-1836ca4a-1994-43e1-8af3-9b8f62fb99c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:20.498391 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-87b0768e-9d80-4172-9a81-8be452641b0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c69709ca61e4078b83e0e68d4ced3a3', 'request_id': 'req-87b0768e-9d80-4172-9a81-8be452641b0e'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:20.507841 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-87b0768e-9d80-4172-9a81-8be452641b0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c69709ca61e4078b83e0e68d4ced3a3', 'request_id': 'req-87b0768e-9d80-4172-9a81-8be452641b0e'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:20.518998 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-87b0768e-9d80-4172-9a81-8be452641b0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c69709ca61e4078b83e0e68d4ced3a3', 'request_id': 'req-87b0768e-9d80-4172-9a81-8be452641b0e'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:20.541750 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-87b0768e-9d80-4172-9a81-8be452641b0e admin admin] The token cache is being invalidate because project 1c69709ca61e4078b83e0e68d4ced3a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:37:20.543543 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-87b0768e-9d80-4172-9a81-8be452641b0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:20.544588 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-87b0768e-9d80-4172-9a81-8be452641b0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:20.551948 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 855/1723] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:37:20 2021] DELETE /identity/v3/projects/1c69709ca61e4078b83e0e68d4ced3a3 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:20.554032 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0768e-9d80-4172-9a81-8be452641b0e admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:20.555668 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-87b0768e-9d80-4172-9a81-8be452641b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:20.624150 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836ca4a-1994-43e1-8af3-9b8f62fb99c3 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:20.632408 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830db954-e332-4329-bb40-fe8cae2b9fdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:20.633328 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830db954-e332-4329-bb40-fe8cae2b9fdf service nova] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:20.633806 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830db954-e332-4329-bb40-fe8cae2b9fdf service nova] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:20.634210 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830db954-e332-4329-bb40-fe8cae2b9fdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:20.636378 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-830db954-e332-4329-bb40-fe8cae2b9fdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:20.663613 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0768e-9d80-4172-9a81-8be452641b0e admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:20.673465 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830db954-e332-4329-bb40-fe8cae2b9fdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:20.680271 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830db954-e332-4329-bb40-fe8cae2b9fdf service nova] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:20.705223 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 869/1724] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:20 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:20.707156 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3a322-3faf-421a-8647-b8b874f60334 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:20.708134 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3a322-3faf-421a-8647-b8b874f60334 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:20.708952 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3a322-3faf-421a-8647-b8b874f60334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:20.743578 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-97c3a322-3faf-421a-8647-b8b874f60334 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:20.744657 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-97c3a322-3faf-421a-8647-b8b874f60334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:20.795193 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6919e-09aa-4160-9a15-9d3a3d6d34b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:20.796208 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6919e-09aa-4160-9a15-9d3a3d6d34b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:20.796614 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6919e-09aa-4160-9a15-9d3a3d6d34b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:20.796773 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6919e-09aa-4160-9a15-9d3a3d6d34b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:20.797496 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6919e-09aa-4160-9a15-9d3a3d6d34b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:20.799555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6919e-09aa-4160-9a15-9d3a3d6d34b9 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:20.838353 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 856/1725] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:20 2021] POST /identity/v3/users => generated 291 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:20.840534 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6919e-09aa-4160-9a15-9d3a3d6d34b9 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:20.842196 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-6aa6919e-09aa-4160-9a15-9d3a3d6d34b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:20.848948 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 870/1726] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:20.850853 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3a322-3faf-421a-8647-b8b874f60334 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:20.858221 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6919e-09aa-4160-9a15-9d3a3d6d34b9 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:20.865702 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3a322-3faf-421a-8647-b8b874f60334 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:20.867703 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d51024-fd71-4554-a695-6bd66605421e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:20.868964 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d51024-fd71-4554-a695-6bd66605421e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:20.869315 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d51024-fd71-4554-a695-6bd66605421e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:20.869735 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d51024-fd71-4554-a695-6bd66605421e admin admin] PATH_INFO: `/v3/projects/4fd686681a89480bb12696f484e6192a` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:20.871644 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d51024-fd71-4554-a695-6bd66605421e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd686681a89480bb12696f484e6192a)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:20.872229 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8d7b6-3a80-4be5-b95e-f4a9275a70b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:20.873734 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8d7b6-3a80-4be5-b95e-f4a9275a70b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:20.873870 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d51024-fd71-4554-a695-6bd66605421e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:20.874243 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8d7b6-3a80-4be5-b95e-f4a9275a70b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:20.874565 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8d7b6-3a80-4be5-b95e-f4a9275a70b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:20.875898 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e8d7b6-3a80-4be5-b95e-f4a9275a70b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:20.878458 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e8d7b6-3a80-4be5-b95e-f4a9275a70b6 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:20.894770 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 871/1727] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:20 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:20.896453 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180a759-4836-415d-b597-5482e903b3b8 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:20.896799 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180a759-4836-415d-b597-5482e903b3b8 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:20.897144 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180a759-4836-415d-b597-5482e903b3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:20.945646 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-3180a759-4836-415d-b597-5482e903b3b8 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:20.949048 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-3180a759-4836-415d-b597-5482e903b3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:20.974962 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 872/1728] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:20.976282 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180a759-4836-415d-b597-5482e903b3b8 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:20.985767 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-85d51024-fd71-4554-a695-6bd66605421e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd686681a89480bb12696f484e6192a', 'request_id': 'req-85d51024-fd71-4554-a695-6bd66605421e'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:20.990937 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180a759-4836-415d-b597-5482e903b3b8 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:21.011908 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-85d51024-fd71-4554-a695-6bd66605421e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd686681a89480bb12696f484e6192a', 'request_id': 'req-85d51024-fd71-4554-a695-6bd66605421e'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:21.034221 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-85d51024-fd71-4554-a695-6bd66605421e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd686681a89480bb12696f484e6192a', 'request_id': 'req-85d51024-fd71-4554-a695-6bd66605421e'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:21.060738 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-85d51024-fd71-4554-a695-6bd66605421e admin admin] The token cache is being invalidate because project 4fd686681a89480bb12696f484e6192a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:37:21.065109 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-85d51024-fd71-4554-a695-6bd66605421e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:21.066358 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c89e8-13b4-4abf-b26b-662bf864d4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:21.067585 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c89e8-13b4-4abf-b26b-662bf864d4ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:21.067900 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-85d51024-fd71-4554-a695-6bd66605421e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:21.068037 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c89e8-13b4-4abf-b26b-662bf864d4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:21.068396 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c89e8-13b4-4abf-b26b-662bf864d4ae admin admin] PATH_INFO: `/v3/projects/c35e2fb84c3f475093af7ffbecf58e0f/users/b850005cb08e4d78b762d17d8e295b51/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:21.070313 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 857/1729] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:37:20 2021] DELETE /identity/v3/projects/4fd686681a89480bb12696f484e6192a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:21.071672 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d51024-fd71-4554-a695-6bd66605421e admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:21.074737 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-85d51024-fd71-4554-a695-6bd66605421e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:21.098844 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d51024-fd71-4554-a695-6bd66605421e admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:21.109417 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bef73-0787-4350-971a-9d9902a546b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:21.112289 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bef73-0787-4350-971a-9d9902a546b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:21.112601 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bef73-0787-4350-971a-9d9902a546b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:21.113032 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bef73-0787-4350-971a-9d9902a546b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:21.115925 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bef73-0787-4350-971a-9d9902a546b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:37:21.116312 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bef73-0787-4350-971a-9d9902a546b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:21.116712 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c89e8-13b4-4abf-b26b-662bf864d4ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=c35e2fb84c3f475093af7ffbecf58e0f, user_id=b850005cb08e4d78b762d17d8e295b51, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:21.118308 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bef73-0787-4350-971a-9d9902a546b5 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:21.119555 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c89e8-13b4-4abf-b26b-662bf864d4ae admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:21.136699 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 858/1730] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:37:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:37:21.138120 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bef73-0787-4350-971a-9d9902a546b5 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:21.142054 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-607bef73-0787-4350-971a-9d9902a546b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:21.158363 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 873/1731] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:20 2021] PUT /identity/v3/projects/c35e2fb84c3f475093af7ffbecf58e0f/users/b850005cb08e4d78b762d17d8e295b51/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:21.159220 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c89e8-13b4-4abf-b26b-662bf864d4ae admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:21.166448 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bef73-0787-4350-971a-9d9902a546b5 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:21.236894 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393d6e9-ef3a-4e52-9218-eff49d170048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:21.238098 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393d6e9-ef3a-4e52-9218-eff49d170048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:21.238383 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393d6e9-ef3a-4e52-9218-eff49d170048 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:21.238697 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393d6e9-ef3a-4e52-9218-eff49d170048 admin admin] PATH_INFO: `/v3/users/1088e19bf8744630b8dd0902ebc13b84` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:21.240112 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393d6e9-ef3a-4e52-9218-eff49d170048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1088e19bf8744630b8dd0902ebc13b84)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:21.242793 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393d6e9-ef3a-4e52-9218-eff49d170048 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:21.247999 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c89e8-13b4-4abf-b26b-662bf864d4ae admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:21.254456 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0dab8-30dd-4b18-8313-ef86921e0fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:21.255352 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0dab8-30dd-4b18-8313-ef86921e0fca admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:21.255636 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0dab8-30dd-4b18-8313-ef86921e0fca admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:21.255920 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0dab8-30dd-4b18-8313-ef86921e0fca admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:21.256637 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0dab8-30dd-4b18-8313-ef86921e0fca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:21.258565 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0dab8-30dd-4b18-8313-ef86921e0fca admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:21.294233 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 874/1732] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:21 2021] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:21.299388 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0dab8-30dd-4b18-8313-ef86921e0fca admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:21.302407 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-2ae0dab8-30dd-4b18-8313-ef86921e0fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:21.315381 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1393d6e9-ef3a-4e52-9218-eff49d170048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1088e19bf8744630b8dd0902ebc13b84'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:21.316805 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1393d6e9-ef3a-4e52-9218-eff49d170048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1088e19bf8744630b8dd0902ebc13b84'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:21.330587 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1393d6e9-ef3a-4e52-9218-eff49d170048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1088e19bf8744630b8dd0902ebc13b84'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:21.347212 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1393d6e9-ef3a-4e52-9218-eff49d170048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1088e19bf8744630b8dd0902ebc13b84'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:21.368000 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1393d6e9-ef3a-4e52-9218-eff49d170048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1088e19bf8744630b8dd0902ebc13b84'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:21.380288 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 859/1733] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:37:21 2021] DELETE /identity/v3/users/1088e19bf8744630b8dd0902ebc13b84 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:21.380288 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393d6e9-ef3a-4e52-9218-eff49d170048 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:21.381487 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-1393d6e9-ef3a-4e52-9218-eff49d170048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:21.407089 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0dab8-30dd-4b18-8313-ef86921e0fca admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:21.489840 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393d6e9-ef3a-4e52-9218-eff49d170048 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:21.496690 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d94ab5-c8eb-4e7c-8d68-3a14b12a6625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:21.497936 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d94ab5-c8eb-4e7c-8d68-3a14b12a6625 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:21.498042 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d94ab5-c8eb-4e7c-8d68-3a14b12a6625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:21.498632 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d94ab5-c8eb-4e7c-8d68-3a14b12a6625 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:21.499984 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d94ab5-c8eb-4e7c-8d68-3a14b12a6625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:21.503228 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d94ab5-c8eb-4e7c-8d68-3a14b12a6625 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:21.520077 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821fc8e-2746-43fd-b7ad-344efc08297f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:21.520922 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821fc8e-2746-43fd-b7ad-344efc08297f admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:21.521323 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821fc8e-2746-43fd-b7ad-344efc08297f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:21.521810 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821fc8e-2746-43fd-b7ad-344efc08297f admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:21.522968 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821fc8e-2746-43fd-b7ad-344efc08297f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:21.525509 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821fc8e-2746-43fd-b7ad-344efc08297f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:21.535358 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 860/1734] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:21 2021] POST /identity/v3/users => generated 291 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:21.537336 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb6fea-44bf-4600-a970-902aa0d274a5 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:21.537670 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb6fea-44bf-4600-a970-902aa0d274a5 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:21.537980 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb6fea-44bf-4600-a970-902aa0d274a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:21.541353 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 875/1735] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:21 2021] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:21.542609 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821fc8e-2746-43fd-b7ad-344efc08297f admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:21.559349 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-57fb6fea-44bf-4600-a970-902aa0d274a5 None None] MFA Rules not processed for user `fb71aef5ce61461b9c92f8bf4869af1d`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:21.561720 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-57fb6fea-44bf-4600-a970-902aa0d274a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:21.569798 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821fc8e-2746-43fd-b7ad-344efc08297f admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:21.577085 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d59355-fc00-4fde-9acd-65be1341f046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:21.577942 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d59355-fc00-4fde-9acd-65be1341f046 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:21.578224 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d59355-fc00-4fde-9acd-65be1341f046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:21.578496 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d59355-fc00-4fde-9acd-65be1341f046 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:21.580764 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d59355-fc00-4fde-9acd-65be1341f046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:21.582389 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d59355-fc00-4fde-9acd-65be1341f046 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:21.592923 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 876/1736] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:21 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:21.596813 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d59355-fc00-4fde-9acd-65be1341f046 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:21.599327 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-38d59355-fc00-4fde-9acd-65be1341f046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:21.613365 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d59355-fc00-4fde-9acd-65be1341f046 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:21.619486 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494990c-85e8-41fa-b854-6dc82aebfeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:21.620925 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494990c-85e8-41fa-b854-6dc82aebfeed admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:21.621563 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494990c-85e8-41fa-b854-6dc82aebfeed admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:21.621563 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494990c-85e8-41fa-b854-6dc82aebfeed admin admin] PATH_INFO: `/v3/projects/c35e2fb84c3f475093af7ffbecf58e0f/users/b850005cb08e4d78b762d17d8e295b51/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:21.625883 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494990c-85e8-41fa-b854-6dc82aebfeed admin admin] RBAC: Authorizing `identity:create_grant(project_id=c35e2fb84c3f475093af7ffbecf58e0f, user_id=b850005cb08e4d78b762d17d8e295b51, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:21.626883 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494990c-85e8-41fa-b854-6dc82aebfeed admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:21.648997 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 877/1737] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:21 2021] PUT /identity/v3/projects/c35e2fb84c3f475093af7ffbecf58e0f/users/b850005cb08e4d78b762d17d8e295b51/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:21.649913 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494990c-85e8-41fa-b854-6dc82aebfeed admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:21.667622 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 861/1738] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:21 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:21.668923 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a3379-4024-4b97-b546-19a402c555a5 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:21.669210 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a3379-4024-4b97-b546-19a402c555a5 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:21.669477 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a3379-4024-4b97-b546-19a402c555a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:21.721047 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-368a3379-4024-4b97-b546-19a402c555a5 None None] MFA Rules not processed for user `b850005cb08e4d78b762d17d8e295b51`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:21.723368 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-368a3379-4024-4b97-b546-19a402c555a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:21.774882 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494990c-85e8-41fa-b854-6dc82aebfeed admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:21.781233 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5196f-1c6b-477d-ac37-ca5f0cb1941b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:21.782505 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5196f-1c6b-477d-ac37-ca5f0cb1941b admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:21.783043 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5196f-1c6b-477d-ac37-ca5f0cb1941b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:21.783536 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5196f-1c6b-477d-ac37-ca5f0cb1941b admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:21.784571 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f5196f-1c6b-477d-ac37-ca5f0cb1941b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:21.787055 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f5196f-1c6b-477d-ac37-ca5f0cb1941b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:21.800488 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 878/1739] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:21 2021] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:21.804369 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5196f-1c6b-477d-ac37-ca5f0cb1941b admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:21.817032 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5196f-1c6b-477d-ac37-ca5f0cb1941b admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:21.822704 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 862/1740] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:21 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:21.826988 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95300e57-1e50-47f0-bcd9-277e93caf513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:21.829681 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a3379-4024-4b97-b546-19a402c555a5 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:21.830933 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95300e57-1e50-47f0-bcd9-277e93caf513 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:21.831217 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95300e57-1e50-47f0-bcd9-277e93caf513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:21.831491 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95300e57-1e50-47f0-bcd9-277e93caf513 admin admin] PATH_INFO: `/v3/projects/ad4fc3b6ccff4a0e892df19f5e40855d/users/a0d60ac0bc9b41d2a2d674272e22a362/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:21.833388 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-368a3379-4024-4b97-b546-19a402c555a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:21.855107 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95300e57-1e50-47f0-bcd9-277e93caf513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4fc3b6ccff4a0e892df19f5e40855d, user_id=a0d60ac0bc9b41d2a2d674272e22a362, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:21.857927 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95300e57-1e50-47f0-bcd9-277e93caf513 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:21.880032 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 879/1741] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:21 2021] PUT /identity/v3/projects/ad4fc3b6ccff4a0e892df19f5e40855d/users/a0d60ac0bc9b41d2a2d674272e22a362/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:37:21.890370 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482c477-1290-423c-a60f-c03a58acd793 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:21.890751 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482c477-1290-423c-a60f-c03a58acd793 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:21.890959 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482c477-1290-423c-a60f-c03a58acd793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:21.919246 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-6482c477-1290-423c-a60f-c03a58acd793 None None] MFA Rules not processed for user `a0d60ac0bc9b41d2a2d674272e22a362`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:21.920839 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-6482c477-1290-423c-a60f-c03a58acd793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:21.931137 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a3379-4024-4b97-b546-19a402c555a5 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:22.001347 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 880/1742] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:21 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:22.002377 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab1035-6669-4dd5-a5af-28ac56a53320 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:22.003250 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab1035-6669-4dd5-a5af-28ac56a53320 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:22.003671 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab1035-6669-4dd5-a5af-28ac56a53320 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:22.004125 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab1035-6669-4dd5-a5af-28ac56a53320 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:22.006100 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482c477-1290-423c-a60f-c03a58acd793 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:22.104227 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab1035-6669-4dd5-a5af-28ac56a53320 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:22.106644 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab1035-6669-4dd5-a5af-28ac56a53320 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:22.137163 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482c477-1290-423c-a60f-c03a58acd793 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:22.138019 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 863/1743] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:21 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:37:22.147009 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c22ea-6349-40d9-8c57-2b9159fe1ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:22.147762 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c22ea-6349-40d9-8c57-2b9159fe1ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:22.148041 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c22ea-6349-40d9-8c57-2b9159fe1ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:22.148312 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c22ea-6349-40d9-8c57-2b9159fe1ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:22.149057 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c22ea-6349-40d9-8c57-2b9159fe1ee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:22.151338 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c22ea-6349-40d9-8c57-2b9159fe1ee5 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:22.187687 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab1035-6669-4dd5-a5af-28ac56a53320 service cinder] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:22.190589 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-ceab1035-6669-4dd5-a5af-28ac56a53320 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:22.199914 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 881/1744] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:22 2021] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:22.205348 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c22ea-6349-40d9-8c57-2b9159fe1ee5 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:22.238071 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab1035-6669-4dd5-a5af-28ac56a53320 service cinder] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:22.334438 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b2043-ef1d-4de6-8301-b07cec7a62a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:22.335535 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b2043-ef1d-4de6-8301-b07cec7a62a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:22.335813 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b2043-ef1d-4de6-8301-b07cec7a62a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:22.336082 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b2043-ef1d-4de6-8301-b07cec7a62a1 admin admin] PATH_INFO: `/v3/projects/5ca9288bed4347bfa1745e42a4b0f199` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:22.337691 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b2043-ef1d-4de6-8301-b07cec7a62a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca9288bed4347bfa1745e42a4b0f199)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:22.340115 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c22ea-6349-40d9-8c57-2b9159fe1ee5 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:22.340800 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b2043-ef1d-4de6-8301-b07cec7a62a1 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:22.348643 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbdad4-9593-428d-8e5e-2408b3abdc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:22.349342 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbdad4-9593-428d-8e5e-2408b3abdc3d admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:22.349617 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbdad4-9593-428d-8e5e-2408b3abdc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:22.350259 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbdad4-9593-428d-8e5e-2408b3abdc3d admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:22.350826 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbdad4-9593-428d-8e5e-2408b3abdc3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:22.353020 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbdad4-9593-428d-8e5e-2408b3abdc3d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:22.393402 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 882/1745] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:22 2021] POST /identity/v3/users => generated 296 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:22.394379 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbdad4-9593-428d-8e5e-2408b3abdc3d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:22.414822 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbdad4-9593-428d-8e5e-2408b3abdc3d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:22.421491 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-394b2043-ef1d-4de6-8301-b07cec7a62a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca9288bed4347bfa1745e42a4b0f199', 'request_id': 'req-394b2043-ef1d-4de6-8301-b07cec7a62a1'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:22.433295 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-394b2043-ef1d-4de6-8301-b07cec7a62a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca9288bed4347bfa1745e42a4b0f199', 'request_id': 'req-394b2043-ef1d-4de6-8301-b07cec7a62a1'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:22.451581 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-394b2043-ef1d-4de6-8301-b07cec7a62a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca9288bed4347bfa1745e42a4b0f199', 'request_id': 'req-394b2043-ef1d-4de6-8301-b07cec7a62a1'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:22.532459 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf0640-bff8-4a23-8df8-f134992bcea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:22.533217 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf0640-bff8-4a23-8df8-f134992bcea0 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:22.534223 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf0640-bff8-4a23-8df8-f134992bcea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:22.534537 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf0640-bff8-4a23-8df8-f134992bcea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:22.550073 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-394b2043-ef1d-4de6-8301-b07cec7a62a1 admin admin] The token cache is being invalidate because project 5ca9288bed4347bfa1745e42a4b0f199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:37:22.550705 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-394b2043-ef1d-4de6-8301-b07cec7a62a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:22.552009 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf0640-bff8-4a23-8df8-f134992bcea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:22.553813 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf0640-bff8-4a23-8df8-f134992bcea0 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:22.556311 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-394b2043-ef1d-4de6-8301-b07cec7a62a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:22.570208 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 864/1746] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:37:22 2021] DELETE /identity/v3/projects/5ca9288bed4347bfa1745e42a4b0f199 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:37:22.572854 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7c989-75ee-4f0c-bdba-fc4a3005a957 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:22.573293 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7c989-75ee-4f0c-bdba-fc4a3005a957 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:22.573583 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7c989-75ee-4f0c-bdba-fc4a3005a957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:22.574473 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 883/1747] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:22 2021] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:22.575627 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf0640-bff8-4a23-8df8-f134992bcea0 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:22.577401 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-59bf0640-bff8-4a23-8df8-f134992bcea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:22.591551 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf0640-bff8-4a23-8df8-f134992bcea0 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:22.596954 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f1244-d40e-4390-9c85-2787cc8fc5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:22.598118 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f1244-d40e-4390-9c85-2787cc8fc5fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:22.598551 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f1244-d40e-4390-9c85-2787cc8fc5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:22.599002 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f1244-d40e-4390-9c85-2787cc8fc5fe admin admin] PATH_INFO: `/v3/projects/c51591ba0023471cb9f093f4a896e045/users/03307186743047b8995bce300e86881b/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:22.627718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-93a7c989-75ee-4f0c-bdba-fc4a3005a957 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:22.630267 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-93a7c989-75ee-4f0c-bdba-fc4a3005a957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:22.637514 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f1244-d40e-4390-9c85-2787cc8fc5fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c51591ba0023471cb9f093f4a896e045, user_id=03307186743047b8995bce300e86881b, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:22.645976 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f1244-d40e-4390-9c85-2787cc8fc5fe admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:22.671653 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 865/1748] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:37:22.678508 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 884/1749] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:22 2021] PUT /identity/v3/projects/c51591ba0023471cb9f093f4a896e045/users/03307186743047b8995bce300e86881b/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:22.679363 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0b76b-e8ce-4940-8f1f-769c9b968387 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:22.679574 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f1244-d40e-4390-9c85-2787cc8fc5fe admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:22.680124 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0b76b-e8ce-4940-8f1f-769c9b968387 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:22.680675 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0b76b-e8ce-4940-8f1f-769c9b968387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:22.724950 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-59e0b76b-e8ce-4940-8f1f-769c9b968387 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:22.726991 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-59e0b76b-e8ce-4940-8f1f-769c9b968387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:22.747697 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f1244-d40e-4390-9c85-2787cc8fc5fe admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:22.753406 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306e95b-7a29-4a85-95f8-80d9d8580b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:22.755305 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306e95b-7a29-4a85-95f8-80d9d8580b63 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:22.755693 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306e95b-7a29-4a85-95f8-80d9d8580b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:22.756139 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306e95b-7a29-4a85-95f8-80d9d8580b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:22.757168 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306e95b-7a29-4a85-95f8-80d9d8580b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:22.759357 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306e95b-7a29-4a85-95f8-80d9d8580b63 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:22.778556 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 885/1750] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:22 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:22.779709 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306e95b-7a29-4a85-95f8-80d9d8580b63 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:22.792045 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306e95b-7a29-4a85-95f8-80d9d8580b63 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:22.798494 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69508fae-5b5f-4202-a751-f8eae0f4818d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:22.799591 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69508fae-5b5f-4202-a751-f8eae0f4818d admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:22.800477 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69508fae-5b5f-4202-a751-f8eae0f4818d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:22.800953 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69508fae-5b5f-4202-a751-f8eae0f4818d admin admin] PATH_INFO: `/v3/projects/c51591ba0023471cb9f093f4a896e045/users/03307186743047b8995bce300e86881b/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:22.803200 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69508fae-5b5f-4202-a751-f8eae0f4818d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c51591ba0023471cb9f093f4a896e045, user_id=03307186743047b8995bce300e86881b, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:22.807780 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69508fae-5b5f-4202-a751-f8eae0f4818d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:22.826956 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 886/1751] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:22 2021] PUT /identity/v3/projects/c51591ba0023471cb9f093f4a896e045/users/03307186743047b8995bce300e86881b/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:22.836244 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e724be-1002-4a34-ad80-f4c2c178ad8d None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:22.836244 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e724be-1002-4a34-ad80-f4c2c178ad8d None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:22.836487 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e724be-1002-4a34-ad80-f4c2c178ad8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:22.892584 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-f9e724be-1002-4a34-ad80-f4c2c178ad8d None None] MFA Rules not processed for user `03307186743047b8995bce300e86881b`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:22.893966 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-f9e724be-1002-4a34-ad80-f4c2c178ad8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:22.917374 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 866/1752] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:22.925083 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0b76b-e8ce-4940-8f1f-769c9b968387 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:22.944711 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0b76b-e8ce-4940-8f1f-769c9b968387 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:23.017826 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 887/1753] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:22 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:37:23.019767 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e724be-1002-4a34-ad80-f4c2c178ad8d None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:23.021337 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-f9e724be-1002-4a34-ad80-f4c2c178ad8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:23.036137 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f679f7-045b-41a5-94b8-a9a2d8a82e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:23.037616 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f679f7-045b-41a5-94b8-a9a2d8a82e9c admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:23.037616 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f679f7-045b-41a5-94b8-a9a2d8a82e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:23.038055 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f679f7-045b-41a5-94b8-a9a2d8a82e9c admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:23.049058 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f679f7-045b-41a5-94b8-a9a2d8a82e9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:37:23.049786 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f679f7-045b-41a5-94b8-a9a2d8a82e9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:23.051575 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f679f7-045b-41a5-94b8-a9a2d8a82e9c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:23.078650 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 867/1754] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:37:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:37:23.083430 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f679f7-045b-41a5-94b8-a9a2d8a82e9c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:23.115971 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f679f7-045b-41a5-94b8-a9a2d8a82e9c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:23.129039 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba534d-f78b-4c00-9c0f-db1f865076bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:23.131555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba534d-f78b-4c00-9c0f-db1f865076bc admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:23.132797 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba534d-f78b-4c00-9c0f-db1f865076bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:23.133189 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba534d-f78b-4c00-9c0f-db1f865076bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:23.134625 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba534d-f78b-4c00-9c0f-db1f865076bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:23.138954 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba534d-f78b-4c00-9c0f-db1f865076bc admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:23.182256 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e724be-1002-4a34-ad80-f4c2c178ad8d None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:23.193412 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc0c3d-9a58-439d-8b72-9e602b533fb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:23.194461 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc0c3d-9a58-439d-8b72-9e602b533fb4 service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:23.194643 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc0c3d-9a58-439d-8b72-9e602b533fb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:23.195564 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc0c3d-9a58-439d-8b72-9e602b533fb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:23.208973 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc0c3d-9a58-439d-8b72-9e602b533fb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:23.211311 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc0c3d-9a58-439d-8b72-9e602b533fb4 service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:23.219047 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 868/1755] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:23 2021] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:23.221211 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba534d-f78b-4c00-9c0f-db1f865076bc admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:23.229799 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 888/1756] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:23 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:23.371448 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba534d-f78b-4c00-9c0f-db1f865076bc admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:23.383695 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83617105-842a-4e21-a9c4-99b512d37e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:23.386489 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83617105-842a-4e21-a9c4-99b512d37e00 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:23.386995 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83617105-842a-4e21-a9c4-99b512d37e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:23.388232 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83617105-842a-4e21-a9c4-99b512d37e00 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:23.390270 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83617105-842a-4e21-a9c4-99b512d37e00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:23.395556 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83617105-842a-4e21-a9c4-99b512d37e00 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:23.488325 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc0c3d-9a58-439d-8b72-9e602b533fb4 service cinder] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:23.500870 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 869/1757] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:23 2021] POST /identity/v3/users => generated 294 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:37:23.502089 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc0c3d-9a58-439d-8b72-9e602b533fb4 service cinder] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:23.507533 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85f300-4506-4604-8bf4-f8e2d87f8dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:23.508360 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85f300-4506-4604-8bf4-f8e2d87f8dda admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:23.508857 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85f300-4506-4604-8bf4-f8e2d87f8dda admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:23.509360 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85f300-4506-4604-8bf4-f8e2d87f8dda admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:23.510301 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85f300-4506-4604-8bf4-f8e2d87f8dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:23.512696 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85f300-4506-4604-8bf4-f8e2d87f8dda admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:23.557229 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75762b-dd2c-4e93-bf44-0e856ae2f5e3 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:23.557801 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75762b-dd2c-4e93-bf44-0e856ae2f5e3 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:23.558032 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75762b-dd2c-4e93-bf44-0e856ae2f5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:23.577438 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-4a75762b-dd2c-4e93-bf44-0e856ae2f5e3 None None] MFA Rules not processed for user `8b1e077f454b471ba851db9431f1011d`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:23.579272 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-4a75762b-dd2c-4e93-bf44-0e856ae2f5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:23.605092 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 889/1758] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:23 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:23.609748 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85f300-4506-4604-8bf4-f8e2d87f8dda admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:23.666144 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85f300-4506-4604-8bf4-f8e2d87f8dda admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:23.680246 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78089f3a-1166-40e3-8df4-d2ddef55e972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:23.681383 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78089f3a-1166-40e3-8df4-d2ddef55e972 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:23.681601 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78089f3a-1166-40e3-8df4-d2ddef55e972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:23.682313 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78089f3a-1166-40e3-8df4-d2ddef55e972 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:23.683408 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78089f3a-1166-40e3-8df4-d2ddef55e972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:23.684635 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 870/1759] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:23 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:37:23.685499 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78089f3a-1166-40e3-8df4-d2ddef55e972 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:23.701358 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 890/1760] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:23 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:23.705984 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75762b-dd2c-4e93-bf44-0e856ae2f5e3 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:23.726313 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75762b-dd2c-4e93-bf44-0e856ae2f5e3 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:23.737191 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f31dc-ee01-4c80-bd96-b7722c560a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:23.738211 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f31dc-ee01-4c80-bd96-b7722c560a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:23.738594 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f31dc-ee01-4c80-bd96-b7722c560a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:23.738858 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f31dc-ee01-4c80-bd96-b7722c560a3b admin admin] PATH_INFO: `/v3/projects/acbd00be60a24ea182da0e1d17bf8a4f/users/4925459b93dc4aa390dbbde4dee7ee2b/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:23.766130 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f31dc-ee01-4c80-bd96-b7722c560a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=acbd00be60a24ea182da0e1d17bf8a4f, user_id=4925459b93dc4aa390dbbde4dee7ee2b, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:23.786482 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f31dc-ee01-4c80-bd96-b7722c560a3b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:23.833858 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 871/1761] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:23 2021] PUT /identity/v3/projects/acbd00be60a24ea182da0e1d17bf8a4f/users/4925459b93dc4aa390dbbde4dee7ee2b/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:23.848084 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b7960-0be2-4a49-89a6-4ec702543acf None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:23.848724 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b7960-0be2-4a49-89a6-4ec702543acf None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:23.849137 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b7960-0be2-4a49-89a6-4ec702543acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:23.897400 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-a33b7960-0be2-4a49-89a6-4ec702543acf None None] MFA Rules not processed for user `4925459b93dc4aa390dbbde4dee7ee2b`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:23.898644 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a33b7960-0be2-4a49-89a6-4ec702543acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:23.925530 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f31dc-ee01-4c80-bd96-b7722c560a3b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:24.023861 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 891/1762] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:23 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:37:24.026006 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b7960-0be2-4a49-89a6-4ec702543acf None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:24.047738 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f31dc-ee01-4c80-bd96-b7722c560a3b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:24.066375 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1381de8-f2da-46a8-9b3b-e9712c2812b4 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03307186743047b8995bce300e86881b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c51591ba0023471cb9f093f4a896e045', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:24.067555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1381de8-f2da-46a8-9b3b-e9712c2812b4 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:24.067910 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1381de8-f2da-46a8-9b3b-e9712c2812b4 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:24.068354 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1381de8-f2da-46a8-9b3b-e9712c2812b4 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:24.069206 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1381de8-f2da-46a8-9b3b-e9712c2812b4 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:37:24.069589 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1381de8-f2da-46a8-9b3b-e9712c2812b4 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:24.073491 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1381de8-f2da-46a8-9b3b-e9712c2812b4 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:24.088391 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 872/1763] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:37:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:37:24.092786 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1381de8-f2da-46a8-9b3b-e9712c2812b4 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:24.112377 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1381de8-f2da-46a8-9b3b-e9712c2812b4 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:24.117473 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676c4db-c4fa-4911-9ea9-aab19f28d5d2 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03307186743047b8995bce300e86881b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c51591ba0023471cb9f093f4a896e045', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:24.118143 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676c4db-c4fa-4911-9ea9-aab19f28d5d2 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:24.118435 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676c4db-c4fa-4911-9ea9-aab19f28d5d2 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:24.119192 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676c4db-c4fa-4911-9ea9-aab19f28d5d2 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:24.119468 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676c4db-c4fa-4911-9ea9-aab19f28d5d2 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:24.121785 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676c4db-c4fa-4911-9ea9-aab19f28d5d2 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:24.138066 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b7960-0be2-4a49-89a6-4ec702543acf None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:24.146338 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afa2f0-6e9e-4888-9674-49d6d92b12fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:24.147474 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afa2f0-6e9e-4888-9674-49d6d92b12fc admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:24.148828 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afa2f0-6e9e-4888-9674-49d6d92b12fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:24.149340 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afa2f0-6e9e-4888-9674-49d6d92b12fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:24.150292 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afa2f0-6e9e-4888-9674-49d6d92b12fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:24.153372 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afa2f0-6e9e-4888-9674-49d6d92b12fc admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:24.194237 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 873/1764] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:24 2021] POST /identity/v3/projects => generated 354 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:24.198948 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676c4db-c4fa-4911-9ea9-aab19f28d5d2 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:24.234646 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 892/1765] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:24 2021] POST /identity/v3/projects => generated 387 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:24.236238 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afa2f0-6e9e-4888-9674-49d6d92b12fc admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:24.353554 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676c4db-c4fa-4911-9ea9-aab19f28d5d2 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:24.362445 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afa2f0-6e9e-4888-9674-49d6d92b12fc admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:24.369154 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc80e3-7810-4781-89a4-53204c19e5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:24.372025 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc80e3-7810-4781-89a4-53204c19e5c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:24.372439 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc80e3-7810-4781-89a4-53204c19e5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:24.373078 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc80e3-7810-4781-89a4-53204c19e5c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:24.374519 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc80e3-7810-4781-89a4-53204c19e5c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:24.378248 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc80e3-7810-4781-89a4-53204c19e5c8 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:24.434799 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 893/1766] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:24 2021] POST /identity/v3/users => generated 300 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:24.436183 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc80e3-7810-4781-89a4-53204c19e5c8 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:24.448597 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc80e3-7810-4781-89a4-53204c19e5c8 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:24.456868 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fe97b-e9ac-4424-8e0f-0997a4f697d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:24.458942 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fe97b-e9ac-4424-8e0f-0997a4f697d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:24.459434 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fe97b-e9ac-4424-8e0f-0997a4f697d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:24.459716 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fe97b-e9ac-4424-8e0f-0997a4f697d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:24.461264 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fe97b-e9ac-4424-8e0f-0997a4f697d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:24.464226 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fe97b-e9ac-4424-8e0f-0997a4f697d7 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:24.484375 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 894/1767] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:24 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:24.485590 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fe97b-e9ac-4424-8e0f-0997a4f697d7 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:24.487790 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103ee84-56d1-4c65-a987-ffcc87432a86 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03307186743047b8995bce300e86881b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c51591ba0023471cb9f093f4a896e045', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:24.488488 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103ee84-56d1-4c65-a987-ffcc87432a86 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:24.488774 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103ee84-56d1-4c65-a987-ffcc87432a86 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:24.489048 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103ee84-56d1-4c65-a987-ffcc87432a86 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:24.489808 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103ee84-56d1-4c65-a987-ffcc87432a86 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:37:24.497849 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103ee84-56d1-4c65-a987-ffcc87432a86 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:24.503740 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103ee84-56d1-4c65-a987-ffcc87432a86 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:24.507329 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fe97b-e9ac-4424-8e0f-0997a4f697d7 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:24.522146 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f1695-a7d6-4791-a2e7-4bb115319ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:24.525008 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f1695-a7d6-4791-a2e7-4bb115319ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:24.526544 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f1695-a7d6-4791-a2e7-4bb115319ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:24.527474 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f1695-a7d6-4791-a2e7-4bb115319ab7 admin admin] PATH_INFO: `/v3/projects/b7b83a6f80aa4832b3d21564ba756163/users/1f7d4dfeb02d403eb5eb3e74460bd900/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:24.544139 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 874/1768] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:37:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:37:24.562072 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f1695-a7d6-4791-a2e7-4bb115319ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7b83a6f80aa4832b3d21564ba756163, user_id=1f7d4dfeb02d403eb5eb3e74460bd900, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:24.565631 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f1695-a7d6-4791-a2e7-4bb115319ab7 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:24.597203 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 895/1769] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:24 2021] PUT /identity/v3/projects/b7b83a6f80aa4832b3d21564ba756163/users/1f7d4dfeb02d403eb5eb3e74460bd900/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:24.601230 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103ee84-56d1-4c65-a987-ffcc87432a86 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:24.616391 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103ee84-56d1-4c65-a987-ffcc87432a86 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:24.625003 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f1695-a7d6-4791-a2e7-4bb115319ab7 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:24.750818 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc761888-ea78-431c-822c-cb9af54b4897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:24.752531 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc761888-ea78-431c-822c-cb9af54b4897 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:24.754799 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc761888-ea78-431c-822c-cb9af54b4897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:24.755291 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc761888-ea78-431c-822c-cb9af54b4897 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:24.756235 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f1695-a7d6-4791-a2e7-4bb115319ab7 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:24.757070 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc761888-ea78-431c-822c-cb9af54b4897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:24.760862 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc761888-ea78-431c-822c-cb9af54b4897 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:24.768380 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924817ec-396a-4591-b820-7422b160b4d1 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03307186743047b8995bce300e86881b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c51591ba0023471cb9f093f4a896e045', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:24.769517 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924817ec-396a-4591-b820-7422b160b4d1 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:24.772193 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924817ec-396a-4591-b820-7422b160b4d1 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:24.772593 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924817ec-396a-4591-b820-7422b160b4d1 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] PATH_INFO: `/v3/projects/c48e8f3c8f5a447ba3a6f262e8147294` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:24.775653 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924817ec-396a-4591-b820-7422b160b4d1 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c48e8f3c8f5a447ba3a6f262e8147294)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:24.777852 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924817ec-396a-4591-b820-7422b160b4d1 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:24.785003 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 875/1770] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:24 2021] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:24.792973 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc761888-ea78-431c-822c-cb9af54b4897 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:24.796957 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-bc761888-ea78-431c-822c-cb9af54b4897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:24.824314 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc761888-ea78-431c-822c-cb9af54b4897 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:24.839431 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e017e-f3d9-4b59-985e-532cfd86ab5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:24.840449 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e017e-f3d9-4b59-985e-532cfd86ab5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:24.840875 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e017e-f3d9-4b59-985e-532cfd86ab5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:24.841154 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e017e-f3d9-4b59-985e-532cfd86ab5d admin admin] PATH_INFO: `/v3/users/c2143d967a064b2486227bfdd589ef7a` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:24.842454 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e017e-f3d9-4b59-985e-532cfd86ab5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2143d967a064b2486227bfdd589ef7a)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:24.844556 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e017e-f3d9-4b59-985e-532cfd86ab5d admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:24.867091 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-924817ec-396a-4591-b820-7422b160b4d1 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c48e8f3c8f5a447ba3a6f262e8147294', 'request_id': 'req-924817ec-396a-4591-b820-7422b160b4d1'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:24.876030 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-924817ec-396a-4591-b820-7422b160b4d1 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c48e8f3c8f5a447ba3a6f262e8147294', 'request_id': 'req-924817ec-396a-4591-b820-7422b160b4d1'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:24.885770 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-924817ec-396a-4591-b820-7422b160b4d1 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c48e8f3c8f5a447ba3a6f262e8147294', 'request_id': 'req-924817ec-396a-4591-b820-7422b160b4d1'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:24.902564 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-924817ec-396a-4591-b820-7422b160b4d1 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] The token cache is being invalidate because project c48e8f3c8f5a447ba3a6f262e8147294 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:37:24.903050 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-924817ec-396a-4591-b820-7422b160b4d1 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:24.903869 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-924817ec-396a-4591-b820-7422b160b4d1 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:24.909708 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 896/1771] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:37:24 2021] DELETE /identity/v3/projects/c48e8f3c8f5a447ba3a6f262e8147294 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:24.910863 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924817ec-396a-4591-b820-7422b160b4d1 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:24.913913 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-924817ec-396a-4591-b820-7422b160b4d1 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:24.962640 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-f70e017e-f3d9-4b59-985e-532cfd86ab5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2143d967a064b2486227bfdd589ef7a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:24.963387 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-f70e017e-f3d9-4b59-985e-532cfd86ab5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2143d967a064b2486227bfdd589ef7a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:24.982346 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-f70e017e-f3d9-4b59-985e-532cfd86ab5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2143d967a064b2486227bfdd589ef7a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:24.992931 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-f70e017e-f3d9-4b59-985e-532cfd86ab5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2143d967a064b2486227bfdd589ef7a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:25.020075 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-f70e017e-f3d9-4b59-985e-532cfd86ab5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2143d967a064b2486227bfdd589ef7a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:25.031819 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 876/1772] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:37:24 2021] DELETE /identity/v3/users/c2143d967a064b2486227bfdd589ef7a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:25.037412 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe210311-c36b-494b-b932-b5c85dd6cbcc None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:25.041926 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe210311-c36b-494b-b932-b5c85dd6cbcc None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:25.044105 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe210311-c36b-494b-b932-b5c85dd6cbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:25.080152 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924817ec-396a-4591-b820-7422b160b4d1 tempest-VolumeQuotaClassesTest-433510984 tempest-VolumeQuotaClassesTest-433510984-project-admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:25.085505 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-fe210311-c36b-494b-b932-b5c85dd6cbcc None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:25.098397 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-fe210311-c36b-494b-b932-b5c85dd6cbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:25.268289 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aabe9-6009-4343-8e33-13140f9407a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:25.269799 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aabe9-6009-4343-8e33-13140f9407a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:25.270337 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aabe9-6009-4343-8e33-13140f9407a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:25.270757 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aabe9-6009-4343-8e33-13140f9407a8 admin admin] PATH_INFO: `/v3/projects/b7b83a6f80aa4832b3d21564ba756163/users/1f7d4dfeb02d403eb5eb3e74460bd900/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:25.273418 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35aabe9-6009-4343-8e33-13140f9407a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7b83a6f80aa4832b3d21564ba756163, user_id=1f7d4dfeb02d403eb5eb3e74460bd900, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:25.278818 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35aabe9-6009-4343-8e33-13140f9407a8 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:25.285525 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 877/1773] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:25.297057 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 897/1774] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:24 2021] PUT /identity/v3/projects/b7b83a6f80aa4832b3d21564ba756163/users/1f7d4dfeb02d403eb5eb3e74460bd900/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:25.312868 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd302a1-6e43-49a4-b58a-c1dd025b0e6f None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:25.313237 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd302a1-6e43-49a4-b58a-c1dd025b0e6f None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:25.313750 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd302a1-6e43-49a4-b58a-c1dd025b0e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:25.328864 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aabe9-6009-4343-8e33-13140f9407a8 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:25.330574 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-c35aabe9-6009-4343-8e33-13140f9407a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:25.400106 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-5fd302a1-6e43-49a4-b58a-c1dd025b0e6f None None] MFA Rules not processed for user `1f7d4dfeb02d403eb5eb3e74460bd900`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:25.401726 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-5fd302a1-6e43-49a4-b58a-c1dd025b0e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:25.475992 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aabe9-6009-4343-8e33-13140f9407a8 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:25.481727 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f8a98-7c30-40bc-b843-e3d9a40bed42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:25.485194 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f8a98-7c30-40bc-b843-e3d9a40bed42 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:25.485489 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f8a98-7c30-40bc-b843-e3d9a40bed42 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:25.485770 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f8a98-7c30-40bc-b843-e3d9a40bed42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:25.616604 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 878/1775] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:25 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:25.621376 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd302a1-6e43-49a4-b58a-c1dd025b0e6f None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:25.636256 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-5fd302a1-6e43-49a4-b58a-c1dd025b0e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:25.655172 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f8a98-7c30-40bc-b843-e3d9a40bed42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:25.657662 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f8a98-7c30-40bc-b843-e3d9a40bed42 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:25.664046 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd302a1-6e43-49a4-b58a-c1dd025b0e6f None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:25.676269 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54a8c0-c7bf-4682-8549-4256cd0d13bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:25.677229 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54a8c0-c7bf-4682-8549-4256cd0d13bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:25.677513 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54a8c0-c7bf-4682-8549-4256cd0d13bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:25.677863 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54a8c0-c7bf-4682-8549-4256cd0d13bf admin admin] PATH_INFO: `/v3/users/a0d60ac0bc9b41d2a2d674272e22a362` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:25.681603 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54a8c0-c7bf-4682-8549-4256cd0d13bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0d60ac0bc9b41d2a2d674272e22a362)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:25.683808 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54a8c0-c7bf-4682-8549-4256cd0d13bf admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:25.692781 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 898/1776] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:25.693796 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f8a98-7c30-40bc-b843-e3d9a40bed42 service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:25.698853 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-b07f8a98-7c30-40bc-b843-e3d9a40bed42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:25.769275 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cb54a8c0-c7bf-4682-8549-4256cd0d13bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0d60ac0bc9b41d2a2d674272e22a362'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:25.770077 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cb54a8c0-c7bf-4682-8549-4256cd0d13bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0d60ac0bc9b41d2a2d674272e22a362'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:25.781894 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cb54a8c0-c7bf-4682-8549-4256cd0d13bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0d60ac0bc9b41d2a2d674272e22a362'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:25.803037 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cb54a8c0-c7bf-4682-8549-4256cd0d13bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0d60ac0bc9b41d2a2d674272e22a362'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:25.826400 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cb54a8c0-c7bf-4682-8549-4256cd0d13bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0d60ac0bc9b41d2a2d674272e22a362'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:25.836588 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 879/1777] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:37:25 2021] DELETE /identity/v3/users/a0d60ac0bc9b41d2a2d674272e22a362 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:25.836588 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985895b6-ba8a-48b6-b6c1-44171045efba None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:25.836588 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985895b6-ba8a-48b6-b6c1-44171045efba None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:25.836588 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985895b6-ba8a-48b6-b6c1-44171045efba None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:25.839021 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 880/1778] 10.222.0.79 () {54 vars in 921 bytes} [Thu Oct 28 14:37:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:37:25.840266 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5c3ca-cbed-451f-aa58-5672b986cee4 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:25.840554 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5c3ca-cbed-451f-aa58-5672b986cee4 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:25.840829 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5c3ca-cbed-451f-aa58-5672b986cee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:25.850840 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f8a98-7c30-40bc-b843-e3d9a40bed42 service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:25.867453 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-3cd5c3ca-cbed-451f-aa58-5672b986cee4 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:25.869282 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-3cd5c3ca-cbed-451f-aa58-5672b986cee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:25.954315 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 881/1779] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:25.955924 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b95dd-7bcf-4998-92f3-85c901890eaa None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:25.956214 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b95dd-7bcf-4998-92f3-85c901890eaa None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:25.956494 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b95dd-7bcf-4998-92f3-85c901890eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:25.984678 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-8d7b95dd-7bcf-4998-92f3-85c901890eaa None None] MFA Rules not processed for user `18cd6636ae7847c78be910824410d295`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:25.986143 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-8d7b95dd-7bcf-4998-92f3-85c901890eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:26.005512 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7b376-c4b1-4c43-880c-2908748fddb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:26.006225 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7b376-c4b1-4c43-880c-2908748fddb5 service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:26.006453 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7b376-c4b1-4c43-880c-2908748fddb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:26.008391 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7b376-c4b1-4c43-880c-2908748fddb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:26.014070 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-89d7b376-c4b1-4c43-880c-2908748fddb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:26.112824 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 882/1780] 10.222.0.79 () {58 vars in 1018 bytes} [Thu Oct 28 14:37:25 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:26.113462 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b95dd-7bcf-4998-92f3-85c901890eaa None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:26.115726 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-8d7b95dd-7bcf-4998-92f3-85c901890eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:26.167814 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7b376-c4b1-4c43-880c-2908748fddb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:26.172732 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7b376-c4b1-4c43-880c-2908748fddb5 service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:26.193279 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 899/1781] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:25 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:26.194360 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7b376-c4b1-4c43-880c-2908748fddb5 service cinder] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:26.196429 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-89d7b376-c4b1-4c43-880c-2908748fddb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:26.235581 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7b376-c4b1-4c43-880c-2908748fddb5 service cinder] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:26.249459 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300092aa-09ce-442d-9e8b-bb85664a5f15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:26.250449 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300092aa-09ce-442d-9e8b-bb85664a5f15 service nova] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:26.252380 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300092aa-09ce-442d-9e8b-bb85664a5f15 service nova] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:26.252609 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300092aa-09ce-442d-9e8b-bb85664a5f15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:26.272701 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b95dd-7bcf-4998-92f3-85c901890eaa None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:26.285626 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300092aa-09ce-442d-9e8b-bb85664a5f15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:26.287280 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300092aa-09ce-442d-9e8b-bb85664a5f15 service nova] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:26.302490 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e652a-bc14-4fbf-a473-0bb6bb643e34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:26.305239 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e652a-bc14-4fbf-a473-0bb6bb643e34 service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:26.305854 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e652a-bc14-4fbf-a473-0bb6bb643e34 service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:26.306503 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e652a-bc14-4fbf-a473-0bb6bb643e34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:26.314861 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 900/1782] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:26 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:26.317699 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300092aa-09ce-442d-9e8b-bb85664a5f15 service nova] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:26.320616 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-300092aa-09ce-442d-9e8b-bb85664a5f15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:26.354108 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300092aa-09ce-442d-9e8b-bb85664a5f15 service nova] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:26.366311 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e652a-bc14-4fbf-a473-0bb6bb643e34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:26.366436 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267cce7-b41e-4432-b97f-dfa6b94f64f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:26.367388 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267cce7-b41e-4432-b97f-dfa6b94f64f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:26.367658 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267cce7-b41e-4432-b97f-dfa6b94f64f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:26.367926 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267cce7-b41e-4432-b97f-dfa6b94f64f9 admin admin] PATH_INFO: `/v3/users/4925459b93dc4aa390dbbde4dee7ee2b` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:26.371333 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267cce7-b41e-4432-b97f-dfa6b94f64f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4925459b93dc4aa390dbbde4dee7ee2b)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:26.373632 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e652a-bc14-4fbf-a473-0bb6bb643e34 service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:26.375721 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267cce7-b41e-4432-b97f-dfa6b94f64f9 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:26.419689 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 883/1783] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:26.420873 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e652a-bc14-4fbf-a473-0bb6bb643e34 service neutron] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:26.422995 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-fc2e652a-bc14-4fbf-a473-0bb6bb643e34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:26.445153 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e652a-bc14-4fbf-a473-0bb6bb643e34 service neutron] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:26.465286 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8335a2b-6dda-4033-9c7f-b351331ed83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:26.466589 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8335a2b-6dda-4033-9c7f-b351331ed83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:26.468102 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8335a2b-6dda-4033-9c7f-b351331ed83c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:26.472018 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8335a2b-6dda-4033-9c7f-b351331ed83c admin admin] PATH_INFO: `/v3/projects/9cfc4f5ec60748dfbf9edbe8defbb9e3` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:26.484703 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8335a2b-6dda-4033-9c7f-b351331ed83c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cfc4f5ec60748dfbf9edbe8defbb9e3)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:26.490773 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8335a2b-6dda-4033-9c7f-b351331ed83c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:26.507901 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-5267cce7-b41e-4432-b97f-dfa6b94f64f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4925459b93dc4aa390dbbde4dee7ee2b'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:26.524287 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-5267cce7-b41e-4432-b97f-dfa6b94f64f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4925459b93dc4aa390dbbde4dee7ee2b'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:26.525196 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-5267cce7-b41e-4432-b97f-dfa6b94f64f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4925459b93dc4aa390dbbde4dee7ee2b'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:26.559697 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-5267cce7-b41e-4432-b97f-dfa6b94f64f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4925459b93dc4aa390dbbde4dee7ee2b'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:26.575634 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-5267cce7-b41e-4432-b97f-dfa6b94f64f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4925459b93dc4aa390dbbde4dee7ee2b'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:26.588144 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 901/1784] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:37:26 2021] DELETE /identity/v3/users/4925459b93dc4aa390dbbde4dee7ee2b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:26.593197 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c118b-8eb5-4d38-bcd3-4d89460788c9 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:26.593553 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c118b-8eb5-4d38-bcd3-4d89460788c9 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:26.593903 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c118b-8eb5-4d38-bcd3-4d89460788c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:26.621395 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-209c118b-8eb5-4d38-bcd3-4d89460788c9 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:26.622635 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d8335a2b-6dda-4033-9c7f-b351331ed83c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cfc4f5ec60748dfbf9edbe8defbb9e3', 'request_id': 'req-d8335a2b-6dda-4033-9c7f-b351331ed83c'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:26.623835 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-209c118b-8eb5-4d38-bcd3-4d89460788c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:26.644509 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d8335a2b-6dda-4033-9c7f-b351331ed83c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cfc4f5ec60748dfbf9edbe8defbb9e3', 'request_id': 'req-d8335a2b-6dda-4033-9c7f-b351331ed83c'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:26.669033 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d8335a2b-6dda-4033-9c7f-b351331ed83c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cfc4f5ec60748dfbf9edbe8defbb9e3', 'request_id': 'req-d8335a2b-6dda-4033-9c7f-b351331ed83c'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:26.693129 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d8335a2b-6dda-4033-9c7f-b351331ed83c admin admin] The token cache is being invalidate because project 9cfc4f5ec60748dfbf9edbe8defbb9e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:37:26.694211 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d8335a2b-6dda-4033-9c7f-b351331ed83c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:26.696711 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d8335a2b-6dda-4033-9c7f-b351331ed83c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:26.700930 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 884/1785] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:37:26 2021] DELETE /identity/v3/projects/9cfc4f5ec60748dfbf9edbe8defbb9e3 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:26.709323 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8335a2b-6dda-4033-9c7f-b351331ed83c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:26.712985 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-d8335a2b-6dda-4033-9c7f-b351331ed83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:26.785422 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 902/1786] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:26.826431 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8335a2b-6dda-4033-9c7f-b351331ed83c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:26.832486 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee4811-3fde-4266-ab28-cd0cbe00d4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:26.834472 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee4811-3fde-4266-ab28-cd0cbe00d4c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:26.835029 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee4811-3fde-4266-ab28-cd0cbe00d4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:26.835500 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee4811-3fde-4266-ab28-cd0cbe00d4c9 admin admin] PATH_INFO: `/v3/users/b850005cb08e4d78b762d17d8e295b51` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:26.837142 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee4811-3fde-4266-ab28-cd0cbe00d4c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b850005cb08e4d78b762d17d8e295b51)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:26.839712 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee4811-3fde-4266-ab28-cd0cbe00d4c9 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:26.857454 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c118b-8eb5-4d38-bcd3-4d89460788c9 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:26.858984 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-209c118b-8eb5-4d38-bcd3-4d89460788c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:26.931251 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-0dee4811-3fde-4266-ab28-cd0cbe00d4c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b850005cb08e4d78b762d17d8e295b51'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:26.932315 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-0dee4811-3fde-4266-ab28-cd0cbe00d4c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b850005cb08e4d78b762d17d8e295b51'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:26.966408 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-0dee4811-3fde-4266-ab28-cd0cbe00d4c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b850005cb08e4d78b762d17d8e295b51'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:26.979087 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-0dee4811-3fde-4266-ab28-cd0cbe00d4c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b850005cb08e4d78b762d17d8e295b51'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:27.005749 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c118b-8eb5-4d38-bcd3-4d89460788c9 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:27.008229 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-0dee4811-3fde-4266-ab28-cd0cbe00d4c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b850005cb08e4d78b762d17d8e295b51'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:27.015393 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3838e4c-6ae0-40ec-b31f-f1d9ea6612b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:27.016102 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3838e4c-6ae0-40ec-b31f-f1d9ea6612b5 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:27.016373 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3838e4c-6ae0-40ec-b31f-f1d9ea6612b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:27.016648 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3838e4c-6ae0-40ec-b31f-f1d9ea6612b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:27.021218 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-f3838e4c-6ae0-40ec-b31f-f1d9ea6612b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:27.022517 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 885/1787] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:37:26 2021] DELETE /identity/v3/users/b850005cb08e4d78b762d17d8e295b51 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:27.036732 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3838e4c-6ae0-40ec-b31f-f1d9ea6612b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:27.038344 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3838e4c-6ae0-40ec-b31f-f1d9ea6612b5 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:27.051741 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 903/1788] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:27.562999 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee4811-3fde-4266-ab28-cd0cbe00d4c9 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:27.565691 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-0dee4811-3fde-4266-ab28-cd0cbe00d4c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:27.695286 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee4811-3fde-4266-ab28-cd0cbe00d4c9 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:27.701745 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053a6aa-ae56-4271-8a06-9b82b3013d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:27.703166 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053a6aa-ae56-4271-8a06-9b82b3013d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:27.703449 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053a6aa-ae56-4271-8a06-9b82b3013d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:27.703723 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053a6aa-ae56-4271-8a06-9b82b3013d55 admin admin] PATH_INFO: `/v3/projects/ad4fc3b6ccff4a0e892df19f5e40855d` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:27.706052 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053a6aa-ae56-4271-8a06-9b82b3013d55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad4fc3b6ccff4a0e892df19f5e40855d)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:27.710527 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053a6aa-ae56-4271-8a06-9b82b3013d55 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:27.794735 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9053a6aa-ae56-4271-8a06-9b82b3013d55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad4fc3b6ccff4a0e892df19f5e40855d', 'request_id': 'req-9053a6aa-ae56-4271-8a06-9b82b3013d55'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:27.803427 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9053a6aa-ae56-4271-8a06-9b82b3013d55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad4fc3b6ccff4a0e892df19f5e40855d', 'request_id': 'req-9053a6aa-ae56-4271-8a06-9b82b3013d55'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:27.815242 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9053a6aa-ae56-4271-8a06-9b82b3013d55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad4fc3b6ccff4a0e892df19f5e40855d', 'request_id': 'req-9053a6aa-ae56-4271-8a06-9b82b3013d55'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:27.834842 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9053a6aa-ae56-4271-8a06-9b82b3013d55 admin admin] The token cache is being invalidate because project ad4fc3b6ccff4a0e892df19f5e40855d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:37:27.835206 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9053a6aa-ae56-4271-8a06-9b82b3013d55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:27.835948 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9053a6aa-ae56-4271-8a06-9b82b3013d55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:27.838187 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 886/1789] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:37:27 2021] DELETE /identity/v3/projects/ad4fc3b6ccff4a0e892df19f5e40855d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:27.843193 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3838e4c-6ae0-40ec-b31f-f1d9ea6612b5 service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:27.854639 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3838e4c-6ae0-40ec-b31f-f1d9ea6612b5 service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:27.932219 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3401402-99ee-46da-9a09-dc6e3498e285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:27.933447 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3401402-99ee-46da-9a09-dc6e3498e285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:27.933976 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3401402-99ee-46da-9a09-dc6e3498e285 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:27.934443 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3401402-99ee-46da-9a09-dc6e3498e285 admin admin] PATH_INFO: `/v3/users/03307186743047b8995bce300e86881b` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:27.936195 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3401402-99ee-46da-9a09-dc6e3498e285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03307186743047b8995bce300e86881b)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:27.938707 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3401402-99ee-46da-9a09-dc6e3498e285 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:28.015264 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c3401402-99ee-46da-9a09-dc6e3498e285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03307186743047b8995bce300e86881b'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:28.036764 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c3401402-99ee-46da-9a09-dc6e3498e285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03307186743047b8995bce300e86881b'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:28.037487 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c3401402-99ee-46da-9a09-dc6e3498e285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03307186743047b8995bce300e86881b'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:28.084116 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c3401402-99ee-46da-9a09-dc6e3498e285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03307186743047b8995bce300e86881b'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:28.099351 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c3401402-99ee-46da-9a09-dc6e3498e285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03307186743047b8995bce300e86881b'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:28.108104 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053a6aa-ae56-4271-8a06-9b82b3013d55 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:28.109726 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-9053a6aa-ae56-4271-8a06-9b82b3013d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:28.114343 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 904/1790] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:37:27 2021] DELETE /identity/v3/users/03307186743047b8995bce300e86881b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:28.125456 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053a6aa-ae56-4271-8a06-9b82b3013d55 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:28.187430 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3401402-99ee-46da-9a09-dc6e3498e285 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:28.188937 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-c3401402-99ee-46da-9a09-dc6e3498e285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:28.221067 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337905c-c773-4dd5-965c-dce2b126fb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:28.221978 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337905c-c773-4dd5-965c-dce2b126fb1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:28.224895 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337905c-c773-4dd5-965c-dce2b126fb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:28.225358 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337905c-c773-4dd5-965c-dce2b126fb1e admin admin] PATH_INFO: `/v3/projects/c35e2fb84c3f475093af7ffbecf58e0f` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:28.227120 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337905c-c773-4dd5-965c-dce2b126fb1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c35e2fb84c3f475093af7ffbecf58e0f)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:28.229296 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337905c-c773-4dd5-965c-dce2b126fb1e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:28.320217 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1337905c-c773-4dd5-965c-dce2b126fb1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c35e2fb84c3f475093af7ffbecf58e0f', 'request_id': 'req-1337905c-c773-4dd5-965c-dce2b126fb1e'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:28.330041 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1337905c-c773-4dd5-965c-dce2b126fb1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c35e2fb84c3f475093af7ffbecf58e0f', 'request_id': 'req-1337905c-c773-4dd5-965c-dce2b126fb1e'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:28.356859 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1337905c-c773-4dd5-965c-dce2b126fb1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c35e2fb84c3f475093af7ffbecf58e0f', 'request_id': 'req-1337905c-c773-4dd5-965c-dce2b126fb1e'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:28.372062 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3401402-99ee-46da-9a09-dc6e3498e285 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:28.407816 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1337905c-c773-4dd5-965c-dce2b126fb1e admin admin] The token cache is being invalidate because project c35e2fb84c3f475093af7ffbecf58e0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:37:28.408109 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1337905c-c773-4dd5-965c-dce2b126fb1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:28.408884 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1337905c-c773-4dd5-965c-dce2b126fb1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:28.411010 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 887/1791] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:37:28 2021] DELETE /identity/v3/projects/c35e2fb84c3f475093af7ffbecf58e0f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:28.416822 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97fdf5-6db1-4596-87f3-a823f0773289 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:28.417052 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97fdf5-6db1-4596-87f3-a823f0773289 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:28.417325 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97fdf5-6db1-4596-87f3-a823f0773289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:28.445973 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-bf97fdf5-6db1-4596-87f3-a823f0773289 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:28.447307 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-bf97fdf5-6db1-4596-87f3-a823f0773289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:28.449271 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4fe8a-3149-40bc-ad8d-6428040eed10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:28.450487 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4fe8a-3149-40bc-ad8d-6428040eed10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:28.450816 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4fe8a-3149-40bc-ad8d-6428040eed10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:28.451190 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4fe8a-3149-40bc-ad8d-6428040eed10 admin admin] PATH_INFO: `/v3/projects/acbd00be60a24ea182da0e1d17bf8a4f` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:28.452410 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4fe8a-3149-40bc-ad8d-6428040eed10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acbd00be60a24ea182da0e1d17bf8a4f)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:28.454633 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4fe8a-3149-40bc-ad8d-6428040eed10 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:28.456154 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 888/1792] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:37:28.466448 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09aacc-caf4-4fa5-b8f3-acd6c7b15164 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:28.466884 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09aacc-caf4-4fa5-b8f3-acd6c7b15164 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:28.467256 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09aacc-caf4-4fa5-b8f3-acd6c7b15164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:28.485661 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-7e09aacc-caf4-4fa5-b8f3-acd6c7b15164 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:28.487054 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-7e09aacc-caf4-4fa5-b8f3-acd6c7b15164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:28.496942 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 889/1793] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:28.501154 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09aacc-caf4-4fa5-b8f3-acd6c7b15164 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:28.510369 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09aacc-caf4-4fa5-b8f3-acd6c7b15164 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:28.527200 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a1e4fe8a-3149-40bc-ad8d-6428040eed10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acbd00be60a24ea182da0e1d17bf8a4f', 'request_id': 'req-a1e4fe8a-3149-40bc-ad8d-6428040eed10'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:28.535939 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a1e4fe8a-3149-40bc-ad8d-6428040eed10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acbd00be60a24ea182da0e1d17bf8a4f', 'request_id': 'req-a1e4fe8a-3149-40bc-ad8d-6428040eed10'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:28.548829 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a1e4fe8a-3149-40bc-ad8d-6428040eed10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acbd00be60a24ea182da0e1d17bf8a4f', 'request_id': 'req-a1e4fe8a-3149-40bc-ad8d-6428040eed10'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:28.564990 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a1e4fe8a-3149-40bc-ad8d-6428040eed10 admin admin] The token cache is being invalidate because project acbd00be60a24ea182da0e1d17bf8a4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:37:28.565719 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a1e4fe8a-3149-40bc-ad8d-6428040eed10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:28.566928 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a1e4fe8a-3149-40bc-ad8d-6428040eed10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:28.569641 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 905/1794] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:37:28 2021] DELETE /identity/v3/projects/acbd00be60a24ea182da0e1d17bf8a4f => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:28.574041 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4fe8a-3149-40bc-ad8d-6428040eed10 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:28.577814 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a1e4fe8a-3149-40bc-ad8d-6428040eed10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:28.593659 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54091229-9370-4d61-9045-bca6430b6e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:28.594948 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54091229-9370-4d61-9045-bca6430b6e4b admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:28.594948 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54091229-9370-4d61-9045-bca6430b6e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:28.595281 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54091229-9370-4d61-9045-bca6430b6e4b admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:28.596147 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54091229-9370-4d61-9045-bca6430b6e4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:37:28.596540 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54091229-9370-4d61-9045-bca6430b6e4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:28.599402 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54091229-9370-4d61-9045-bca6430b6e4b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:28.618313 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 890/1795] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:37:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:37:28.620601 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54091229-9370-4d61-9045-bca6430b6e4b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:28.623137 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-54091229-9370-4d61-9045-bca6430b6e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:28.639212 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54091229-9370-4d61-9045-bca6430b6e4b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:28.662071 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7f712-122f-4c54-8477-6faab122a36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:28.665564 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7f712-122f-4c54-8477-6faab122a36f admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:28.666904 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7f712-122f-4c54-8477-6faab122a36f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:28.667194 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7f712-122f-4c54-8477-6faab122a36f admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:28.667949 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7f712-122f-4c54-8477-6faab122a36f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:28.674002 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7f712-122f-4c54-8477-6faab122a36f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:28.700519 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4fe8a-3149-40bc-ad8d-6428040eed10 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:28.715753 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eeccc7-bb63-4dae-b882-b7993aa18c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:28.718209 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eeccc7-bb63-4dae-b882-b7993aa18c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:28.718718 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eeccc7-bb63-4dae-b882-b7993aa18c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:28.719142 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eeccc7-bb63-4dae-b882-b7993aa18c84 admin admin] PATH_INFO: `/v3/users/1f7d4dfeb02d403eb5eb3e74460bd900` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:28.720971 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eeccc7-bb63-4dae-b882-b7993aa18c84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f7d4dfeb02d403eb5eb3e74460bd900)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:28.730419 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eeccc7-bb63-4dae-b882-b7993aa18c84 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:28.776622 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 891/1796] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:28 2021] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:28.781242 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7f712-122f-4c54-8477-6faab122a36f admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:28.863432 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-50eeccc7-bb63-4dae-b882-b7993aa18c84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f7d4dfeb02d403eb5eb3e74460bd900'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:28.873749 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7f712-122f-4c54-8477-6faab122a36f admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:28.882875 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad8228-798a-45b5-8b84-792509073897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:28.883588 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-50eeccc7-bb63-4dae-b882-b7993aa18c84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f7d4dfeb02d403eb5eb3e74460bd900'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:28.884019 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad8228-798a-45b5-8b84-792509073897 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:28.884375 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad8228-798a-45b5-8b84-792509073897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:28.884748 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad8228-798a-45b5-8b84-792509073897 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:28.884931 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-50eeccc7-bb63-4dae-b882-b7993aa18c84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f7d4dfeb02d403eb5eb3e74460bd900'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:28.886043 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad8228-798a-45b5-8b84-792509073897 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:28.888712 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad8228-798a-45b5-8b84-792509073897 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:28.909916 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-50eeccc7-bb63-4dae-b882-b7993aa18c84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f7d4dfeb02d403eb5eb3e74460bd900'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:28.927790 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 892/1797] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:28 2021] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:37:28.928541 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad8228-798a-45b5-8b84-792509073897 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:28.932390 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-03ad8228-798a-45b5-8b84-792509073897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:28.947010 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-50eeccc7-bb63-4dae-b882-b7993aa18c84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f7d4dfeb02d403eb5eb3e74460bd900'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:28.954834 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 906/1798] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:37:28 2021] DELETE /identity/v3/users/1f7d4dfeb02d403eb5eb3e74460bd900 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:28.955709 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eeccc7-bb63-4dae-b882-b7993aa18c84 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:28.957896 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-50eeccc7-bb63-4dae-b882-b7993aa18c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:28.961543 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad8228-798a-45b5-8b84-792509073897 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:29.084138 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2192c3-dcbc-45bf-a2eb-df99532d450b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:29.088965 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2192c3-dcbc-45bf-a2eb-df99532d450b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:29.089515 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2192c3-dcbc-45bf-a2eb-df99532d450b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:29.089962 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2192c3-dcbc-45bf-a2eb-df99532d450b admin admin] PATH_INFO: `/v3/projects/c51591ba0023471cb9f093f4a896e045` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:29.092362 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2192c3-dcbc-45bf-a2eb-df99532d450b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c51591ba0023471cb9f093f4a896e045)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:29.095209 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2192c3-dcbc-45bf-a2eb-df99532d450b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:29.100289 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eeccc7-bb63-4dae-b882-b7993aa18c84 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:29.106964 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdd845-1c70-40a4-b319-96557f0f7838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:29.107568 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdd845-1c70-40a4-b319-96557f0f7838 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:29.107851 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdd845-1c70-40a4-b319-96557f0f7838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:29.108127 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdd845-1c70-40a4-b319-96557f0f7838 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:29.108890 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdd845-1c70-40a4-b319-96557f0f7838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:29.110668 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdd845-1c70-40a4-b319-96557f0f7838 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:29.124925 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 907/1799] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:28 2021] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:29.129671 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdd845-1c70-40a4-b319-96557f0f7838 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:29.152005 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdd845-1c70-40a4-b319-96557f0f7838 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:29.170973 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e72f5c-e2f7-4d71-bed6-c3210d842496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:29.171699 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e72f5c-e2f7-4d71-bed6-c3210d842496 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:29.171961 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e72f5c-e2f7-4d71-bed6-c3210d842496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:29.172236 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e72f5c-e2f7-4d71-bed6-c3210d842496 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:29.172982 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e72f5c-e2f7-4d71-bed6-c3210d842496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:29.174822 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e72f5c-e2f7-4d71-bed6-c3210d842496 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:29.201947 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 908/1800] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:29 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:29.203874 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e72f5c-e2f7-4d71-bed6-c3210d842496 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:29.224050 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e72f5c-e2f7-4d71-bed6-c3210d842496 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:29.236682 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ac2192c3-dcbc-45bf-a2eb-df99532d450b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c51591ba0023471cb9f093f4a896e045', 'request_id': 'req-ac2192c3-dcbc-45bf-a2eb-df99532d450b'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:29.246508 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ac2192c3-dcbc-45bf-a2eb-df99532d450b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c51591ba0023471cb9f093f4a896e045', 'request_id': 'req-ac2192c3-dcbc-45bf-a2eb-df99532d450b'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:29.272344 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ac2192c3-dcbc-45bf-a2eb-df99532d450b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c51591ba0023471cb9f093f4a896e045', 'request_id': 'req-ac2192c3-dcbc-45bf-a2eb-df99532d450b'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:29.308292 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ac2192c3-dcbc-45bf-a2eb-df99532d450b admin admin] The token cache is being invalidate because project c51591ba0023471cb9f093f4a896e045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:37:29.308617 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ac2192c3-dcbc-45bf-a2eb-df99532d450b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:29.309517 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ac2192c3-dcbc-45bf-a2eb-df99532d450b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:29.312141 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 893/1801] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:37:28 2021] DELETE /identity/v3/projects/c51591ba0023471cb9f093f4a896e045 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:29.320307 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad16041-2aab-45f8-925a-a641a71fe0a4 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:29.320594 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad16041-2aab-45f8-925a-a641a71fe0a4 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:29.320868 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad16041-2aab-45f8-925a-a641a71fe0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:29.374247 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-4ad16041-2aab-45f8-925a-a641a71fe0a4 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:29.375417 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-4ad16041-2aab-45f8-925a-a641a71fe0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:29.392089 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 894/1802] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:29.392295 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48398436-d3ee-4538-bbed-f0d989d49fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:29.392295 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48398436-d3ee-4538-bbed-f0d989d49fd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:29.392295 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48398436-d3ee-4538-bbed-f0d989d49fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:29.392295 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48398436-d3ee-4538-bbed-f0d989d49fd6 admin admin] PATH_INFO: `/v3/projects/26f4ba54aaf044b3badc3a12220df236/users/25c4865598954a6dbde13e5e447acdae/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:29.394025 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fdf4d-c70c-46c1-af31-2f1708084bc9 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:29.394426 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fdf4d-c70c-46c1-af31-2f1708084bc9 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:29.394800 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fdf4d-c70c-46c1-af31-2f1708084bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:29.424270 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-d11fdf4d-c70c-46c1-af31-2f1708084bc9 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:29.425802 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-d11fdf4d-c70c-46c1-af31-2f1708084bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:29.451146 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48398436-d3ee-4538-bbed-f0d989d49fd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26f4ba54aaf044b3badc3a12220df236, user_id=25c4865598954a6dbde13e5e447acdae, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:29.456149 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 895/1803] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:29.456347 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48398436-d3ee-4538-bbed-f0d989d49fd6 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:29.457272 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11fdf4d-c70c-46c1-af31-2f1708084bc9 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:29.498068 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11fdf4d-c70c-46c1-af31-2f1708084bc9 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:29.507565 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 909/1804] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:29 2021] PUT /identity/v3/projects/26f4ba54aaf044b3badc3a12220df236/users/25c4865598954a6dbde13e5e447acdae/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:29.518036 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b38e74-46f2-4473-bd05-4f3937edc1a7 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:29.518593 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b38e74-46f2-4473-bd05-4f3937edc1a7 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:29.518593 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b38e74-46f2-4473-bd05-4f3937edc1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:29.580103 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-c0b38e74-46f2-4473-bd05-4f3937edc1a7 None None] MFA Rules not processed for user `25c4865598954a6dbde13e5e447acdae`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:29.583843 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-c0b38e74-46f2-4473-bd05-4f3937edc1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:29.650346 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000699c0-029b-45b9-85f8-bc0802085373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:29.652505 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000699c0-029b-45b9-85f8-bc0802085373 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:29.652992 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000699c0-029b-45b9-85f8-bc0802085373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:29.653638 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000699c0-029b-45b9-85f8-bc0802085373 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:29.654816 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000699c0-029b-45b9-85f8-bc0802085373 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:37:29.654972 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000699c0-029b-45b9-85f8-bc0802085373 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:29.656982 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000699c0-029b-45b9-85f8-bc0802085373 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:29.676275 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 896/1805] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:37:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:37:29.681058 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000699c0-029b-45b9-85f8-bc0802085373 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:29.694882 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000699c0-029b-45b9-85f8-bc0802085373 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:29.721565 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c29c76-830b-475c-b462-9a8d5e9144ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:29.723045 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c29c76-830b-475c-b462-9a8d5e9144ef admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:29.723478 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c29c76-830b-475c-b462-9a8d5e9144ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:29.723905 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c29c76-830b-475c-b462-9a8d5e9144ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:29.724819 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c29c76-830b-475c-b462-9a8d5e9144ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:29.727984 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c29c76-830b-475c-b462-9a8d5e9144ef admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:29.797305 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 897/1806] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:29 2021] POST /identity/v3/projects => generated 391 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:29.811949 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 910/1807] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:29 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:29.812191 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c29c76-830b-475c-b462-9a8d5e9144ef admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:29.813031 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b38e74-46f2-4473-bd05-4f3937edc1a7 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:29.814314 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-b5c29c76-830b-475c-b462-9a8d5e9144ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:29.828244 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b38e74-46f2-4473-bd05-4f3937edc1a7 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:29.960440 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560de99-b19d-4401-bc4d-2d64885a8b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:29.961354 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c29c76-830b-475c-b462-9a8d5e9144ef admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:29.962240 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560de99-b19d-4401-bc4d-2d64885a8b49 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:29.965047 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560de99-b19d-4401-bc4d-2d64885a8b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:29.965495 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560de99-b19d-4401-bc4d-2d64885a8b49 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:29.966340 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0624e-4e63-4f62-a98b-4069a8666fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:29.966571 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560de99-b19d-4401-bc4d-2d64885a8b49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:29.967258 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0624e-4e63-4f62-a98b-4069a8666fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:29.967623 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0624e-4e63-4f62-a98b-4069a8666fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:29.967782 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0624e-4e63-4f62-a98b-4069a8666fc4 admin admin] PATH_INFO: `/v3/projects/b7b83a6f80aa4832b3d21564ba756163` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:29.970977 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560de99-b19d-4401-bc4d-2d64885a8b49 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:29.980859 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0624e-4e63-4f62-a98b-4069a8666fc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7b83a6f80aa4832b3d21564ba756163)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:29.987394 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0624e-4e63-4f62-a98b-4069a8666fc4 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:30.001948 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 911/1808] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:29 2021] POST /identity/v3/users => generated 296 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:30.003356 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560de99-b19d-4401-bc4d-2d64885a8b49 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:30.005402 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-f560de99-b19d-4401-bc4d-2d64885a8b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:30.022710 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560de99-b19d-4401-bc4d-2d64885a8b49 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:30.028286 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cb503-3ceb-4a54-9195-91f35a772246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:30.029075 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cb503-3ceb-4a54-9195-91f35a772246 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:30.029465 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cb503-3ceb-4a54-9195-91f35a772246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:30.029829 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cb503-3ceb-4a54-9195-91f35a772246 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:30.030829 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001cb503-3ceb-4a54-9195-91f35a772246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:30.033167 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001cb503-3ceb-4a54-9195-91f35a772246 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:30.067466 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 912/1809] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:30 2021] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:30.068417 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cb503-3ceb-4a54-9195-91f35a772246 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:30.077746 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-81a0624e-4e63-4f62-a98b-4069a8666fc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7b83a6f80aa4832b3d21564ba756163', 'request_id': 'req-81a0624e-4e63-4f62-a98b-4069a8666fc4'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:30.085034 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-81a0624e-4e63-4f62-a98b-4069a8666fc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7b83a6f80aa4832b3d21564ba756163', 'request_id': 'req-81a0624e-4e63-4f62-a98b-4069a8666fc4'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:30.095128 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-81a0624e-4e63-4f62-a98b-4069a8666fc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7b83a6f80aa4832b3d21564ba756163', 'request_id': 'req-81a0624e-4e63-4f62-a98b-4069a8666fc4'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:30.114809 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-81a0624e-4e63-4f62-a98b-4069a8666fc4 admin admin] The token cache is being invalidate because project b7b83a6f80aa4832b3d21564ba756163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:37:30.116086 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-81a0624e-4e63-4f62-a98b-4069a8666fc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:30.117869 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-81a0624e-4e63-4f62-a98b-4069a8666fc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:30.120632 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 898/1810] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:37:29 2021] DELETE /identity/v3/projects/b7b83a6f80aa4832b3d21564ba756163 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:30.122114 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0624e-4e63-4f62-a98b-4069a8666fc4 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:30.123921 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-81a0624e-4e63-4f62-a98b-4069a8666fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:30.140944 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cb503-3ceb-4a54-9195-91f35a772246 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:30.146796 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32d4e7-625f-4d16-99a7-5cf5a883305c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:30.147472 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32d4e7-625f-4d16-99a7-5cf5a883305c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:30.147911 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32d4e7-625f-4d16-99a7-5cf5a883305c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:30.148189 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32d4e7-625f-4d16-99a7-5cf5a883305c admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:30.148966 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32d4e7-625f-4d16-99a7-5cf5a883305c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:30.150553 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32d4e7-625f-4d16-99a7-5cf5a883305c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:30.165692 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 913/1811] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:30 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:30.165692 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3099d70-4556-4da8-a510-990938892fb8 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:30.165692 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3099d70-4556-4da8-a510-990938892fb8 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:30.165692 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3099d70-4556-4da8-a510-990938892fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:30.185140 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-a3099d70-4556-4da8-a510-990938892fb8 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:30.186456 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a3099d70-4556-4da8-a510-990938892fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:30.196031 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 914/1812] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:30.203155 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3099d70-4556-4da8-a510-990938892fb8 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:30.204879 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a3099d70-4556-4da8-a510-990938892fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:30.210793 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0624e-4e63-4f62-a98b-4069a8666fc4 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:30.217143 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b146334-e3e6-47cc-b54f-0a4a65f414fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:30.218113 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b146334-e3e6-47cc-b54f-0a4a65f414fe admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:30.218540 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b146334-e3e6-47cc-b54f-0a4a65f414fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:30.219001 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b146334-e3e6-47cc-b54f-0a4a65f414fe admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:30.220345 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b146334-e3e6-47cc-b54f-0a4a65f414fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:30.222533 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b146334-e3e6-47cc-b54f-0a4a65f414fe admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:30.230059 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3099d70-4556-4da8-a510-990938892fb8 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:30.235216 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabeb222-a678-4e73-a184-ca4364f4bc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:30.236165 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeb222-a678-4e73-a184-ca4364f4bc40 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:30.236432 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeb222-a678-4e73-a184-ca4364f4bc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:30.236785 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeb222-a678-4e73-a184-ca4364f4bc40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:30.237600 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabeb222-a678-4e73-a184-ca4364f4bc40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:30.239528 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabeb222-a678-4e73-a184-ca4364f4bc40 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:30.249606 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 899/1813] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:30 2021] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:30.252385 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c532d1c-df80-43ca-9905-fec3120edb18 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:30.252860 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c532d1c-df80-43ca-9905-fec3120edb18 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:30.253031 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 915/1814] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:30 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:30.253512 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c532d1c-df80-43ca-9905-fec3120edb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:30.260038 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabeb222-a678-4e73-a184-ca4364f4bc40 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:30.273244 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabeb222-a678-4e73-a184-ca4364f4bc40 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:30.275503 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-4c532d1c-df80-43ca-9905-fec3120edb18 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:30.277295 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-4c532d1c-df80-43ca-9905-fec3120edb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:30.278749 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb36a55-adad-4d4e-8a1c-dd68b72134d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:30.279538 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb36a55-adad-4d4e-8a1c-dd68b72134d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:30.279855 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb36a55-adad-4d4e-8a1c-dd68b72134d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:30.280200 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb36a55-adad-4d4e-8a1c-dd68b72134d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:30.281016 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb36a55-adad-4d4e-8a1c-dd68b72134d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:30.282655 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb36a55-adad-4d4e-8a1c-dd68b72134d8 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:30.287890 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 900/1815] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:30.288895 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c532d1c-df80-43ca-9905-fec3120edb18 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:30.300884 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c532d1c-df80-43ca-9905-fec3120edb18 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:30.301273 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 916/1816] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:30 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:30.302241 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb36a55-adad-4d4e-8a1c-dd68b72134d8 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:30.307162 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51684e-76f4-4304-9261-bfb20874377d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:30.308454 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51684e-76f4-4304-9261-bfb20874377d admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:30.308912 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51684e-76f4-4304-9261-bfb20874377d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:30.309375 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51684e-76f4-4304-9261-bfb20874377d admin admin] PATH_INFO: `/v3/projects/04faa19be06240baaebc1807f9bfa302/users/b16de291bc984f90bc8871428b217189/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:30.317903 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb36a55-adad-4d4e-8a1c-dd68b72134d8 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:30.324359 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e605b9-1cfa-4090-850a-da0c5d7297a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:30.325232 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e605b9-1cfa-4090-850a-da0c5d7297a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:30.325681 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e605b9-1cfa-4090-850a-da0c5d7297a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:30.325953 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e605b9-1cfa-4090-850a-da0c5d7297a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:30.326717 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e605b9-1cfa-4090-850a-da0c5d7297a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:37:30.327019 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e605b9-1cfa-4090-850a-da0c5d7297a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:30.328739 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e605b9-1cfa-4090-850a-da0c5d7297a4 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:30.330208 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51684e-76f4-4304-9261-bfb20874377d admin admin] RBAC: Authorizing `identity:create_grant(project_id=04faa19be06240baaebc1807f9bfa302, user_id=b16de291bc984f90bc8871428b217189, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:30.334019 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51684e-76f4-4304-9261-bfb20874377d admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:30.349602 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 917/1817] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:37:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:37:30.350948 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e605b9-1cfa-4090-850a-da0c5d7297a4 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:30.361959 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 901/1818] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:30 2021] PUT /identity/v3/projects/04faa19be06240baaebc1807f9bfa302/users/b16de291bc984f90bc8871428b217189/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:30.363570 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51684e-76f4-4304-9261-bfb20874377d admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:30.372502 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e605b9-1cfa-4090-850a-da0c5d7297a4 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:30.473040 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51684e-76f4-4304-9261-bfb20874377d admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:30.474915 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbedf5-0a89-423a-944f-a8c229663b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:30.476345 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbedf5-0a89-423a-944f-a8c229663b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:30.476725 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbedf5-0a89-423a-944f-a8c229663b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:30.477069 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbedf5-0a89-423a-944f-a8c229663b55 admin admin] PATH_INFO: `/v3/projects/4cb1e74f16a942128b5c53c389dedd38/users/bf8c8ce640194e41a18d38cff487f57f/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:30.479050 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c509f7-f2da-4158-a236-0f52d73e9ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:30.479972 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c509f7-f2da-4158-a236-0f52d73e9ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:30.480259 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c509f7-f2da-4158-a236-0f52d73e9ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:30.481295 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c509f7-f2da-4158-a236-0f52d73e9ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:30.481402 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c509f7-f2da-4158-a236-0f52d73e9ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:30.483353 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c509f7-f2da-4158-a236-0f52d73e9ae7 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:30.492853 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbedf5-0a89-423a-944f-a8c229663b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb1e74f16a942128b5c53c389dedd38, user_id=bf8c8ce640194e41a18d38cff487f57f, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:30.495696 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbedf5-0a89-423a-944f-a8c229663b55 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:30.513072 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 902/1819] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:30 2021] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:30.514569 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74813fab-9800-4386-9cfe-287a5dfb48a5 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:30.514775 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74813fab-9800-4386-9cfe-287a5dfb48a5 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:30.515029 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74813fab-9800-4386-9cfe-287a5dfb48a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:30.517342 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 918/1820] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:30 2021] PUT /identity/v3/projects/4cb1e74f16a942128b5c53c389dedd38/users/bf8c8ce640194e41a18d38cff487f57f/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:30.518401 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbedf5-0a89-423a-944f-a8c229663b55 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:30.549635 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-74813fab-9800-4386-9cfe-287a5dfb48a5 None None] MFA Rules not processed for user `b16de291bc984f90bc8871428b217189`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:30.550891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-74813fab-9800-4386-9cfe-287a5dfb48a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:30.586106 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbedf5-0a89-423a-944f-a8c229663b55 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:30.627833 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 903/1821] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:30 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:30.629395 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74813fab-9800-4386-9cfe-287a5dfb48a5 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:30.674747 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dcb35-a7e1-48f5-8f42-a3262e746181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:30.677084 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dcb35-a7e1-48f5-8f42-a3262e746181 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:30.677791 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dcb35-a7e1-48f5-8f42-a3262e746181 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:30.678613 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dcb35-a7e1-48f5-8f42-a3262e746181 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:30.679690 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dcb35-a7e1-48f5-8f42-a3262e746181 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:30.684068 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dcb35-a7e1-48f5-8f42-a3262e746181 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:30.733939 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74813fab-9800-4386-9cfe-287a5dfb48a5 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:30.734511 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 919/1822] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:30 2021] POST /identity/v3/users => generated 290 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:30.735537 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dcb35-a7e1-48f5-8f42-a3262e746181 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:30.745843 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0387e-45fc-4199-8d29-246712557349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:30.746619 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0387e-45fc-4199-8d29-246712557349 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:30.746930 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0387e-45fc-4199-8d29-246712557349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:30.747202 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0387e-45fc-4199-8d29-246712557349 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:30.747968 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0387e-45fc-4199-8d29-246712557349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:30.749910 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0387e-45fc-4199-8d29-246712557349 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:30.761450 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 904/1823] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:30 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:30.762311 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0387e-45fc-4199-8d29-246712557349 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:30.764908 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dcb35-a7e1-48f5-8f42-a3262e746181 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:30.778964 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0387e-45fc-4199-8d29-246712557349 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:30.780841 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b9bd2-19ae-4f88-8f31-bc948e48a04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:30.781740 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b9bd2-19ae-4f88-8f31-bc948e48a04e admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:30.782022 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b9bd2-19ae-4f88-8f31-bc948e48a04e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:30.782481 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b9bd2-19ae-4f88-8f31-bc948e48a04e admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:30.785137 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b9bd2-19ae-4f88-8f31-bc948e48a04e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:30.787763 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b9bd2-19ae-4f88-8f31-bc948e48a04e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:30.800436 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb96660-09cc-4b93-8f2d-d9c42cbd4e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:30.800971 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb96660-09cc-4b93-8f2d-d9c42cbd4e62 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:30.801225 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb96660-09cc-4b93-8f2d-d9c42cbd4e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:30.801492 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb96660-09cc-4b93-8f2d-d9c42cbd4e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:30.808385 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb96660-09cc-4b93-8f2d-d9c42cbd4e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:30.810014 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb96660-09cc-4b93-8f2d-d9c42cbd4e62 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:30.826213 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 905/1824] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:30 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:30.827384 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb96660-09cc-4b93-8f2d-d9c42cbd4e62 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:30.841987 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb96660-09cc-4b93-8f2d-d9c42cbd4e62 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:30.847057 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbce9f5-142f-4976-b28f-01a7226452f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:30.847494 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 920/1825] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:30 2021] POST /identity/v3/projects => generated 391 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:30.848412 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b9bd2-19ae-4f88-8f31-bc948e48a04e admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:30.852128 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbce9f5-142f-4976-b28f-01a7226452f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:30.852466 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbce9f5-142f-4976-b28f-01a7226452f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:30.852745 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbce9f5-142f-4976-b28f-01a7226452f8 admin admin] PATH_INFO: `/v3/projects/4cb1e74f16a942128b5c53c389dedd38/users/bf8c8ce640194e41a18d38cff487f57f/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:30.855411 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbce9f5-142f-4976-b28f-01a7226452f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb1e74f16a942128b5c53c389dedd38, user_id=bf8c8ce640194e41a18d38cff487f57f, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:30.859495 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbce9f5-142f-4976-b28f-01a7226452f8 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:30.873335 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 906/1826] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:30 2021] PUT /identity/v3/projects/4cb1e74f16a942128b5c53c389dedd38/users/bf8c8ce640194e41a18d38cff487f57f/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:30.874223 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbce9f5-142f-4976-b28f-01a7226452f8 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:30.986009 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b9bd2-19ae-4f88-8f31-bc948e48a04e admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:31.019769 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbce9f5-142f-4976-b28f-01a7226452f8 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:31.026775 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6758f2-7001-4ca7-b556-d2fe6c291ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:31.027648 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6758f2-7001-4ca7-b556-d2fe6c291ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:31.028498 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6758f2-7001-4ca7-b556-d2fe6c291ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:31.029014 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6758f2-7001-4ca7-b556-d2fe6c291ae1 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:31.030032 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6758f2-7001-4ca7-b556-d2fe6c291ae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:31.033604 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6758f2-7001-4ca7-b556-d2fe6c291ae1 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:31.085444 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 907/1827] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:30 2021] POST /identity/v3/users => generated 302 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:31.090424 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7742004-30d0-4c49-86bd-743c4b299b4d None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:31.091255 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7742004-30d0-4c49-86bd-743c4b299b4d None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:31.091552 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7742004-30d0-4c49-86bd-743c4b299b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:31.166621 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944db5b-cd7d-418a-96cf-1a308fe9892b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:31.167474 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944db5b-cd7d-418a-96cf-1a308fe9892b admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:31.169861 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944db5b-cd7d-418a-96cf-1a308fe9892b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:31.171834 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944db5b-cd7d-418a-96cf-1a308fe9892b admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:31.172688 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944db5b-cd7d-418a-96cf-1a308fe9892b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:31.179045 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944db5b-cd7d-418a-96cf-1a308fe9892b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:31.193896 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-a7742004-30d0-4c49-86bd-743c4b299b4d None None] MFA Rules not processed for user `bf8c8ce640194e41a18d38cff487f57f`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:31.195448 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-a7742004-30d0-4c49-86bd-743c4b299b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:31.212305 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 921/1828] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:30 2021] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:31.213639 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944db5b-cd7d-418a-96cf-1a308fe9892b admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:31.227919 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944db5b-cd7d-418a-96cf-1a308fe9892b admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:31.234952 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed0652-9484-42ed-947e-12a3654d5808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:31.235637 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed0652-9484-42ed-947e-12a3654d5808 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:31.236297 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed0652-9484-42ed-947e-12a3654d5808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:31.236575 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed0652-9484-42ed-947e-12a3654d5808 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:31.237328 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed0652-9484-42ed-947e-12a3654d5808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:31.240024 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed0652-9484-42ed-947e-12a3654d5808 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:31.263055 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 922/1829] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:31 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:31.264293 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed0652-9484-42ed-947e-12a3654d5808 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:31.276938 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed0652-9484-42ed-947e-12a3654d5808 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:31.283571 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b993f-11e0-4130-ab24-19b127175ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:31.284775 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b993f-11e0-4130-ab24-19b127175ebd admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:31.285119 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b993f-11e0-4130-ab24-19b127175ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:31.285456 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b993f-11e0-4130-ab24-19b127175ebd admin admin] PATH_INFO: `/v3/projects/2b77749d1e6341e3b3b28b539ede48cc/users/1c88570392294830870164e1b266dcc4/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:31.305799 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b993f-11e0-4130-ab24-19b127175ebd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b77749d1e6341e3b3b28b539ede48cc, user_id=1c88570392294830870164e1b266dcc4, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:31.310078 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b993f-11e0-4130-ab24-19b127175ebd admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:31.335136 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 923/1830] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:31 2021] PUT /identity/v3/projects/2b77749d1e6341e3b3b28b539ede48cc/users/1c88570392294830870164e1b266dcc4/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:31.336285 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b993f-11e0-4130-ab24-19b127175ebd admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:31.385830 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 908/1831] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:31 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:31.385830 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba929f60-f4ae-4283-9813-35b4490326d9 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:31.385830 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba929f60-f4ae-4283-9813-35b4490326d9 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:31.385830 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba929f60-f4ae-4283-9813-35b4490326d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:31.428221 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b993f-11e0-4130-ab24-19b127175ebd admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:31.435555 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30ff7d-2f99-4641-ace5-8dbbb6f0ec81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:31.437451 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30ff7d-2f99-4641-ace5-8dbbb6f0ec81 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:31.437791 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30ff7d-2f99-4641-ace5-8dbbb6f0ec81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:31.438072 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30ff7d-2f99-4641-ace5-8dbbb6f0ec81 admin admin] PATH_INFO: `/v3/projects/ef8021d556704eddb8758bc177a994b6/users/6ac3262a9d3848f3a06ecda66215403e/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:31.459373 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30ff7d-2f99-4641-ace5-8dbbb6f0ec81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef8021d556704eddb8758bc177a994b6, user_id=6ac3262a9d3848f3a06ecda66215403e, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:31.463615 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30ff7d-2f99-4641-ace5-8dbbb6f0ec81 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:31.474192 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-ba929f60-f4ae-4283-9813-35b4490326d9 None None] MFA Rules not processed for user `1c88570392294830870164e1b266dcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:31.475498 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-ba929f60-f4ae-4283-9813-35b4490326d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:31.493120 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 924/1832] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:31 2021] PUT /identity/v3/projects/ef8021d556704eddb8758bc177a994b6/users/6ac3262a9d3848f3a06ecda66215403e/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:31.493120 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30ff7d-2f99-4641-ace5-8dbbb6f0ec81 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:31.495157 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-1b30ff7d-2f99-4641-ace5-8dbbb6f0ec81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:31.610848 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30ff7d-2f99-4641-ace5-8dbbb6f0ec81 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:31.617307 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96f9a2-0dc5-4f02-9b32-d9976076c1e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:31.618658 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96f9a2-0dc5-4f02-9b32-d9976076c1e0 service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:31.618971 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96f9a2-0dc5-4f02-9b32-d9976076c1e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:31.619240 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96f9a2-0dc5-4f02-9b32-d9976076c1e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:31.621513 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-3d96f9a2-0dc5-4f02-9b32-d9976076c1e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:31.647145 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 909/1833] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:31 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:31.648705 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba929f60-f4ae-4283-9813-35b4490326d9 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:31.703954 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96f9a2-0dc5-4f02-9b32-d9976076c1e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:31.705725 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96f9a2-0dc5-4f02-9b32-d9976076c1e0 service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:31.717809 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 925/1834] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:31 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:31.718975 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96f9a2-0dc5-4f02-9b32-d9976076c1e0 service cinder] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:31.788266 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba929f60-f4ae-4283-9813-35b4490326d9 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:31.800987 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c93817-4071-402e-b193-0acecd312de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:31.803286 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c93817-4071-402e-b193-0acecd312de5 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:31.803286 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c93817-4071-402e-b193-0acecd312de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:31.803286 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c93817-4071-402e-b193-0acecd312de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:31.804457 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c93817-4071-402e-b193-0acecd312de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:31.806783 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c93817-4071-402e-b193-0acecd312de5 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:31.838628 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 910/1835] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:31 2021] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:31.841269 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c93817-4071-402e-b193-0acecd312de5 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:31.855786 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96f9a2-0dc5-4f02-9b32-d9976076c1e0 service cinder] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:31.858194 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c93817-4071-402e-b193-0acecd312de5 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:31.865327 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed624f-da86-4600-bcfa-7faaf8457496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:31.865715 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fc3bd-d4b6-4810-a6da-c5c98380fb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:31.866232 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed624f-da86-4600-bcfa-7faaf8457496 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:31.866508 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed624f-da86-4600-bcfa-7faaf8457496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:31.866619 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fc3bd-d4b6-4810-a6da-c5c98380fb34 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:31.866819 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed624f-da86-4600-bcfa-7faaf8457496 admin admin] PATH_INFO: `/v3/projects/ef8021d556704eddb8758bc177a994b6/users/6ac3262a9d3848f3a06ecda66215403e/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:31.866915 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fc3bd-d4b6-4810-a6da-c5c98380fb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:31.867154 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fc3bd-d4b6-4810-a6da-c5c98380fb34 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:31.868650 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fc3bd-d4b6-4810-a6da-c5c98380fb34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:31.868833 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed624f-da86-4600-bcfa-7faaf8457496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef8021d556704eddb8758bc177a994b6, user_id=6ac3262a9d3848f3a06ecda66215403e, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:31.870425 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fc3bd-d4b6-4810-a6da-c5c98380fb34 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:31.873228 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed624f-da86-4600-bcfa-7faaf8457496 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:31.886718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 911/1836] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:31 2021] PUT /identity/v3/projects/ef8021d556704eddb8758bc177a994b6/users/6ac3262a9d3848f3a06ecda66215403e/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:31.904438 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1620d31-a53b-4954-8a2f-7cfecad2b75e None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:31.905050 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1620d31-a53b-4954-8a2f-7cfecad2b75e None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:31.905834 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1620d31-a53b-4954-8a2f-7cfecad2b75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:31.937996 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 926/1837] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:31 2021] POST /identity/v3/projects => generated 377 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:31.942258 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fc3bd-d4b6-4810-a6da-c5c98380fb34 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:31.955019 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-b1620d31-a53b-4954-8a2f-7cfecad2b75e None None] MFA Rules not processed for user `6ac3262a9d3848f3a06ecda66215403e`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:31.956217 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-b1620d31-a53b-4954-8a2f-7cfecad2b75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:32.052834 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fc3bd-d4b6-4810-a6da-c5c98380fb34 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:32.058271 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20177d3-5c7f-4589-98be-31b160fcde9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:32.061247 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20177d3-5c7f-4589-98be-31b160fcde9c admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:32.061538 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20177d3-5c7f-4589-98be-31b160fcde9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:32.061813 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20177d3-5c7f-4589-98be-31b160fcde9c admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:32.062536 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20177d3-5c7f-4589-98be-31b160fcde9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:32.064495 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20177d3-5c7f-4589-98be-31b160fcde9c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:32.070783 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 912/1838] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:31 2021] POST /identity/v3/auth/tokens => generated 3478 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:32.080419 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1620d31-a53b-4954-8a2f-7cfecad2b75e None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:32.081823 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-b1620d31-a53b-4954-8a2f-7cfecad2b75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:32.108197 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 927/1839] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:31 2021] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:32.111688 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20177d3-5c7f-4589-98be-31b160fcde9c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:32.130396 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20177d3-5c7f-4589-98be-31b160fcde9c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:32.142900 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a0f70-1543-4d3d-bea9-7a70e6ab67af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:32.143605 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a0f70-1543-4d3d-bea9-7a70e6ab67af admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:32.143888 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a0f70-1543-4d3d-bea9-7a70e6ab67af admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:32.144166 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a0f70-1543-4d3d-bea9-7a70e6ab67af admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:32.145046 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a0f70-1543-4d3d-bea9-7a70e6ab67af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:32.152353 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a0f70-1543-4d3d-bea9-7a70e6ab67af admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:32.176122 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 928/1840] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:32 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:32.177209 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a0f70-1543-4d3d-bea9-7a70e6ab67af admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:32.184394 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1620d31-a53b-4954-8a2f-7cfecad2b75e None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:32.189392 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727e233-6d51-4504-af5a-f1ec09bc36d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:32.190064 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727e233-6d51-4504-af5a-f1ec09bc36d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:32.190361 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727e233-6d51-4504-af5a-f1ec09bc36d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:32.190621 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727e233-6d51-4504-af5a-f1ec09bc36d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:32.200872 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a0f70-1543-4d3d-bea9-7a70e6ab67af admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:32.203291 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727e233-6d51-4504-af5a-f1ec09bc36d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:32.204808 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727e233-6d51-4504-af5a-f1ec09bc36d3 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:32.207645 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741d950-c14a-40a0-8f53-222b1c5931b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:32.208594 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741d950-c14a-40a0-8f53-222b1c5931b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:32.208995 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741d950-c14a-40a0-8f53-222b1c5931b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:32.209311 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741d950-c14a-40a0-8f53-222b1c5931b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:32.210474 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741d950-c14a-40a0-8f53-222b1c5931b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:32.213181 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741d950-c14a-40a0-8f53-222b1c5931b0 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:32.222531 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 913/1841] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:32 2021] GET /identity/v3/auth/tokens => generated 3478 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:37:32.239789 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 929/1842] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:32 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:32.244264 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727e233-6d51-4504-af5a-f1ec09bc36d3 service cinder] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:32.264467 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727e233-6d51-4504-af5a-f1ec09bc36d3 service cinder] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:32.273754 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24503c8d-a1b5-4640-af83-2b4829518b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:32.274797 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24503c8d-a1b5-4640-af83-2b4829518b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:32.275149 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24503c8d-a1b5-4640-af83-2b4829518b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:32.275511 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24503c8d-a1b5-4640-af83-2b4829518b3c admin admin] PATH_INFO: `/v3/projects/b46c284875d548849501a53012ee866e/users/0f2a578858aa4cf484a4e883c214f5ea/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:32.282018 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741d950-c14a-40a0-8f53-222b1c5931b0 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:32.294407 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24503c8d-a1b5-4640-af83-2b4829518b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b46c284875d548849501a53012ee866e, user_id=0f2a578858aa4cf484a4e883c214f5ea, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:32.298592 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741d950-c14a-40a0-8f53-222b1c5931b0 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:32.299491 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24503c8d-a1b5-4640-af83-2b4829518b3c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:32.306463 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f7107-a14d-44ea-ae84-b3ef9d974e22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:32.307343 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f7107-a14d-44ea-ae84-b3ef9d974e22 service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:32.307893 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f7107-a14d-44ea-ae84-b3ef9d974e22 service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:32.308163 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f7107-a14d-44ea-ae84-b3ef9d974e22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:32.317925 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 914/1843] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:32 2021] PUT /identity/v3/projects/b46c284875d548849501a53012ee866e/users/0f2a578858aa4cf484a4e883c214f5ea/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:37:32.332287 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913d046-5ee2-4dcc-a2d0-2d94e3fa48d5 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:32.332578 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913d046-5ee2-4dcc-a2d0-2d94e3fa48d5 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:32.332852 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913d046-5ee2-4dcc-a2d0-2d94e3fa48d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:32.358805 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-8913d046-5ee2-4dcc-a2d0-2d94e3fa48d5 None None] MFA Rules not processed for user `0f2a578858aa4cf484a4e883c214f5ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:32.360022 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-8913d046-5ee2-4dcc-a2d0-2d94e3fa48d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:32.366920 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f7107-a14d-44ea-ae84-b3ef9d974e22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:32.368346 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f7107-a14d-44ea-ae84-b3ef9d974e22 service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:32.377199 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 930/1844] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:32 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:37:32.425075 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 915/1845] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:32 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:32.429650 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f7107-a14d-44ea-ae84-b3ef9d974e22 service cinder] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:32.440671 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f7107-a14d-44ea-ae84-b3ef9d974e22 service cinder] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:32.496294 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996da36f-71fd-4c3c-84a4-b24da56c0710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:32.497005 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996da36f-71fd-4c3c-84a4-b24da56c0710 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:32.497292 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996da36f-71fd-4c3c-84a4-b24da56c0710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:32.497582 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996da36f-71fd-4c3c-84a4-b24da56c0710 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:32.498279 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996da36f-71fd-4c3c-84a4-b24da56c0710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:32.500408 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996da36f-71fd-4c3c-84a4-b24da56c0710 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:32.527841 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 931/1846] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:32 2021] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:37:32.531795 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913d046-5ee2-4dcc-a2d0-2d94e3fa48d5 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:32.544226 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913d046-5ee2-4dcc-a2d0-2d94e3fa48d5 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:32.629455 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c4bd8-a5da-41a7-b3eb-91777d72d452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:32.631385 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c4bd8-a5da-41a7-b3eb-91777d72d452 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:32.631673 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c4bd8-a5da-41a7-b3eb-91777d72d452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:32.635129 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c4bd8-a5da-41a7-b3eb-91777d72d452 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:32.636707 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c4bd8-a5da-41a7-b3eb-91777d72d452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:32.639392 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c4bd8-a5da-41a7-b3eb-91777d72d452 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:32.672272 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 916/1847] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:32 2021] POST /identity/v3/users => generated 295 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:37:32.673528 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996da36f-71fd-4c3c-84a4-b24da56c0710 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:32.688866 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996da36f-71fd-4c3c-84a4-b24da56c0710 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:32.699411 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c944d-0a83-476b-8b52-0aa82ad92346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:32.700120 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c944d-0a83-476b-8b52-0aa82ad92346 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:32.700719 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c944d-0a83-476b-8b52-0aa82ad92346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:32.700827 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c944d-0a83-476b-8b52-0aa82ad92346 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:32.701577 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c944d-0a83-476b-8b52-0aa82ad92346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:32.703813 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c944d-0a83-476b-8b52-0aa82ad92346 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:32.720792 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 932/1848] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:32 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:32.722053 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c4bd8-a5da-41a7-b3eb-91777d72d452 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:32.732693 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c4bd8-a5da-41a7-b3eb-91777d72d452 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:32.740766 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448101f-5428-416d-91dd-823460bfcac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:32.741844 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448101f-5428-416d-91dd-823460bfcac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:32.742152 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448101f-5428-416d-91dd-823460bfcac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:32.742484 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448101f-5428-416d-91dd-823460bfcac8 admin admin] PATH_INFO: `/v3/projects/427c770d3694413c905d3589a19e235c/users/e252b7187ea746d1889a0c2b7cfef526/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:32.771004 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448101f-5428-416d-91dd-823460bfcac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=427c770d3694413c905d3589a19e235c, user_id=e252b7187ea746d1889a0c2b7cfef526, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:32.776549 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448101f-5428-416d-91dd-823460bfcac8 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:32.804923 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 917/1849] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:32 2021] PUT /identity/v3/projects/427c770d3694413c905d3589a19e235c/users/e252b7187ea746d1889a0c2b7cfef526/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:32.806170 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c944d-0a83-476b-8b52-0aa82ad92346 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:32.821131 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c944d-0a83-476b-8b52-0aa82ad92346 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:32.888031 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5ac62-53ec-48f4-8005-f14c1da65a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:32.889196 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5ac62-53ec-48f4-8005-f14c1da65a60 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:32.889196 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5ac62-53ec-48f4-8005-f14c1da65a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:32.889627 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5ac62-53ec-48f4-8005-f14c1da65a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:32.890592 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5ac62-53ec-48f4-8005-f14c1da65a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:32.892472 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5ac62-53ec-48f4-8005-f14c1da65a60 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:32.909502 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 933/1850] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:32 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:32.913580 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448101f-5428-416d-91dd-823460bfcac8 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:32.925139 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448101f-5428-416d-91dd-823460bfcac8 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:32.932523 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9080d53-8af5-4a33-aa3a-7474b24b5f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:32.933941 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9080d53-8af5-4a33-aa3a-7474b24b5f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:32.934424 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9080d53-8af5-4a33-aa3a-7474b24b5f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:32.934905 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9080d53-8af5-4a33-aa3a-7474b24b5f6b admin admin] PATH_INFO: `/v3/projects/427c770d3694413c905d3589a19e235c/users/e252b7187ea746d1889a0c2b7cfef526/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:32.937191 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9080d53-8af5-4a33-aa3a-7474b24b5f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=427c770d3694413c905d3589a19e235c, user_id=e252b7187ea746d1889a0c2b7cfef526, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:32.939978 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9080d53-8af5-4a33-aa3a-7474b24b5f6b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:32.962673 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 918/1851] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:32 2021] PUT /identity/v3/projects/427c770d3694413c905d3589a19e235c/users/e252b7187ea746d1889a0c2b7cfef526/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:32.980514 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d34c5b-c7d4-4550-ba2e-d2279407d4b9 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:32.981068 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d34c5b-c7d4-4550-ba2e-d2279407d4b9 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:32.981544 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d34c5b-c7d4-4550-ba2e-d2279407d4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:33.038850 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-c3d34c5b-c7d4-4550-ba2e-d2279407d4b9 None None] MFA Rules not processed for user `e252b7187ea746d1889a0c2b7cfef526`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:33.040433 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-c3d34c5b-c7d4-4550-ba2e-d2279407d4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:33.186519 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 934/1852] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:32 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:33.253263 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9080d53-8af5-4a33-aa3a-7474b24b5f6b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:33.327935 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9080d53-8af5-4a33-aa3a-7474b24b5f6b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:33.334364 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9da01-e8f6-433d-bc2c-42fd6f79fb0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:33.335378 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9da01-e8f6-433d-bc2c-42fd6f79fb0b service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:33.337234 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9da01-e8f6-433d-bc2c-42fd6f79fb0b service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:33.337827 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9da01-e8f6-433d-bc2c-42fd6f79fb0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:33.349773 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9da01-e8f6-433d-bc2c-42fd6f79fb0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:33.351308 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9da01-e8f6-433d-bc2c-42fd6f79fb0b service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:33.364421 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 919/1853] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:33 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:33.514512 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d34c5b-c7d4-4550-ba2e-d2279407d4b9 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:33.526208 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d34c5b-c7d4-4550-ba2e-d2279407d4b9 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:33.530547 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c2f4c-cd81-41a5-bd7f-95458a70c154 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:33.531227 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c2f4c-cd81-41a5-bd7f-95458a70c154 service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:33.531501 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c2f4c-cd81-41a5-bd7f-95458a70c154 service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:33.531768 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c2f4c-cd81-41a5-bd7f-95458a70c154 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:33.619575 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c2f4c-cd81-41a5-bd7f-95458a70c154 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:33.622471 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c2f4c-cd81-41a5-bd7f-95458a70c154 service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:33.637490 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 935/1854] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:33 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:38.820880 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9da01-e8f6-433d-bc2c-42fd6f79fb0b service cinder] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:38.831460 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9da01-e8f6-433d-bc2c-42fd6f79fb0b service cinder] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:38.835839 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1884bbd-8954-474b-8085-270aa94a9adf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:38.836289 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1884bbd-8954-474b-8085-270aa94a9adf service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:38.836706 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1884bbd-8954-474b-8085-270aa94a9adf service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:38.836981 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1884bbd-8954-474b-8085-270aa94a9adf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:38.937873 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1884bbd-8954-474b-8085-270aa94a9adf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:38.940796 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1884bbd-8954-474b-8085-270aa94a9adf service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:38.955864 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 920/1855] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:38 2021] GET /identity/v3/auth/tokens => generated 3462 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:39.981348 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c2f4c-cd81-41a5-bd7f-95458a70c154 service cinder] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:40.040796 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c2f4c-cd81-41a5-bd7f-95458a70c154 service cinder] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:40.046271 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54636d1b-40ba-43ce-aa6f-e60ed6eac359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:40.047159 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54636d1b-40ba-43ce-aa6f-e60ed6eac359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:40.047431 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54636d1b-40ba-43ce-aa6f-e60ed6eac359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:40.047677 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54636d1b-40ba-43ce-aa6f-e60ed6eac359 admin admin] PATH_INFO: `/v3/users/b16de291bc984f90bc8871428b217189` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:40.049006 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54636d1b-40ba-43ce-aa6f-e60ed6eac359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b16de291bc984f90bc8871428b217189)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:40.051102 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54636d1b-40ba-43ce-aa6f-e60ed6eac359 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:40.096830 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-54636d1b-40ba-43ce-aa6f-e60ed6eac359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b16de291bc984f90bc8871428b217189'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:40.105048 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-54636d1b-40ba-43ce-aa6f-e60ed6eac359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b16de291bc984f90bc8871428b217189'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:40.105753 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-54636d1b-40ba-43ce-aa6f-e60ed6eac359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b16de291bc984f90bc8871428b217189'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:40.117613 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-54636d1b-40ba-43ce-aa6f-e60ed6eac359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b16de291bc984f90bc8871428b217189'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:40.124800 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-54636d1b-40ba-43ce-aa6f-e60ed6eac359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b16de291bc984f90bc8871428b217189'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:40.131155 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 936/1856] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:37:39 2021] DELETE /identity/v3/users/b16de291bc984f90bc8871428b217189 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:40.135822 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e733f2f-c9a5-42c1-bef6-24ac12ed2cf1 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:40.136333 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e733f2f-c9a5-42c1-bef6-24ac12ed2cf1 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:40.136333 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e733f2f-c9a5-42c1-bef6-24ac12ed2cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:40.153840 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-7e733f2f-c9a5-42c1-bef6-24ac12ed2cf1 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:40.155111 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-7e733f2f-c9a5-42c1-bef6-24ac12ed2cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:40.227746 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 921/1857] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:37:40.237838 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54636d1b-40ba-43ce-aa6f-e60ed6eac359 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:40.239503 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-54636d1b-40ba-43ce-aa6f-e60ed6eac359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:40.295881 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54636d1b-40ba-43ce-aa6f-e60ed6eac359 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:40.299732 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681efacb-84be-4703-9770-197fa8201f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:40.300383 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681efacb-84be-4703-9770-197fa8201f68 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:40.300658 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681efacb-84be-4703-9770-197fa8201f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:40.300920 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681efacb-84be-4703-9770-197fa8201f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:40.310190 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681efacb-84be-4703-9770-197fa8201f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:40.311621 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681efacb-84be-4703-9770-197fa8201f68 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:40.320591 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 937/1858] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:40.604384 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e733f2f-c9a5-42c1-bef6-24ac12ed2cf1 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:40.605941 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-7e733f2f-c9a5-42c1-bef6-24ac12ed2cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:40.618413 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e733f2f-c9a5-42c1-bef6-24ac12ed2cf1 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:40.623601 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c817bd-4afc-43d4-9479-55df2a15786c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:40.624521 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c817bd-4afc-43d4-9479-55df2a15786c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:40.624825 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c817bd-4afc-43d4-9479-55df2a15786c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:40.625099 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c817bd-4afc-43d4-9479-55df2a15786c admin admin] PATH_INFO: `/v3/projects/04faa19be06240baaebc1807f9bfa302` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:40.627197 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c817bd-4afc-43d4-9479-55df2a15786c admin admin] RBAC: Authorizing `identity:delete_project(project_id=04faa19be06240baaebc1807f9bfa302)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:40.629502 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c817bd-4afc-43d4-9479-55df2a15786c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:40.678659 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e3c817bd-4afc-43d4-9479-55df2a15786c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04faa19be06240baaebc1807f9bfa302', 'request_id': 'req-e3c817bd-4afc-43d4-9479-55df2a15786c'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:40.688634 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e3c817bd-4afc-43d4-9479-55df2a15786c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04faa19be06240baaebc1807f9bfa302', 'request_id': 'req-e3c817bd-4afc-43d4-9479-55df2a15786c'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:40.700322 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e3c817bd-4afc-43d4-9479-55df2a15786c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04faa19be06240baaebc1807f9bfa302', 'request_id': 'req-e3c817bd-4afc-43d4-9479-55df2a15786c'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:40.711357 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e3c817bd-4afc-43d4-9479-55df2a15786c admin admin] The token cache is being invalidate because project 04faa19be06240baaebc1807f9bfa302 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:37:40.711728 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e3c817bd-4afc-43d4-9479-55df2a15786c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:40.712443 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e3c817bd-4afc-43d4-9479-55df2a15786c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:40.714076 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 922/1859] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:37:40 2021] DELETE /identity/v3/projects/04faa19be06240baaebc1807f9bfa302 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:40.718444 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681efacb-84be-4703-9770-197fa8201f68 service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:40.728260 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681efacb-84be-4703-9770-197fa8201f68 service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:40.782765 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829218d-9440-4987-a8a8-a78cd4390dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:40.783649 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829218d-9440-4987-a8a8-a78cd4390dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:40.783925 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829218d-9440-4987-a8a8-a78cd4390dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:40.784191 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829218d-9440-4987-a8a8-a78cd4390dc5 admin admin] PATH_INFO: `/v3/users/6ac3262a9d3848f3a06ecda66215403e` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:40.785377 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829218d-9440-4987-a8a8-a78cd4390dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ac3262a9d3848f3a06ecda66215403e)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:40.787301 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829218d-9440-4987-a8a8-a78cd4390dc5 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:40.843555 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-9829218d-9440-4987-a8a8-a78cd4390dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ac3262a9d3848f3a06ecda66215403e'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:40.851860 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-9829218d-9440-4987-a8a8-a78cd4390dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ac3262a9d3848f3a06ecda66215403e'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:40.852420 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-9829218d-9440-4987-a8a8-a78cd4390dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ac3262a9d3848f3a06ecda66215403e'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:40.864485 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-9829218d-9440-4987-a8a8-a78cd4390dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ac3262a9d3848f3a06ecda66215403e'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:40.871965 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-9829218d-9440-4987-a8a8-a78cd4390dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ac3262a9d3848f3a06ecda66215403e'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:40.878583 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 938/1860] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:37:40 2021] DELETE /identity/v3/users/6ac3262a9d3848f3a06ecda66215403e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:41.215718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c817bd-4afc-43d4-9479-55df2a15786c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:41.217220 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e3c817bd-4afc-43d4-9479-55df2a15786c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:41.231249 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c817bd-4afc-43d4-9479-55df2a15786c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:41.290987 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af794e0-f0dc-45ab-905e-d3f2f204957a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:41.291886 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af794e0-f0dc-45ab-905e-d3f2f204957a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:41.292183 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af794e0-f0dc-45ab-905e-d3f2f204957a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:41.292450 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af794e0-f0dc-45ab-905e-d3f2f204957a admin admin] PATH_INFO: `/v3/projects/ef8021d556704eddb8758bc177a994b6` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:41.293672 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af794e0-f0dc-45ab-905e-d3f2f204957a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef8021d556704eddb8758bc177a994b6)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:41.296007 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af794e0-f0dc-45ab-905e-d3f2f204957a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:41.341744 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-0af794e0-f0dc-45ab-905e-d3f2f204957a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef8021d556704eddb8758bc177a994b6', 'request_id': 'req-0af794e0-f0dc-45ab-905e-d3f2f204957a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:41.348389 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-0af794e0-f0dc-45ab-905e-d3f2f204957a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef8021d556704eddb8758bc177a994b6', 'request_id': 'req-0af794e0-f0dc-45ab-905e-d3f2f204957a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:41.357554 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-0af794e0-f0dc-45ab-905e-d3f2f204957a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef8021d556704eddb8758bc177a994b6', 'request_id': 'req-0af794e0-f0dc-45ab-905e-d3f2f204957a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:41.368172 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-0af794e0-f0dc-45ab-905e-d3f2f204957a admin admin] The token cache is being invalidate because project ef8021d556704eddb8758bc177a994b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:37:41.368460 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-0af794e0-f0dc-45ab-905e-d3f2f204957a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:41.369075 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-0af794e0-f0dc-45ab-905e-d3f2f204957a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:41.370673 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 923/1861] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:37:41 2021] DELETE /identity/v3/projects/ef8021d556704eddb8758bc177a994b6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:41.376822 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70862ac9-1a67-46c9-9784-3e22d658a31c None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:41.377341 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70862ac9-1a67-46c9-9784-3e22d658a31c None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:41.377341 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70862ac9-1a67-46c9-9784-3e22d658a31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:41.394592 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-70862ac9-1a67-46c9-9784-3e22d658a31c None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:41.395742 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-70862ac9-1a67-46c9-9784-3e22d658a31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:41.462527 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 939/1862] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:41.470437 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47744826-a9a0-4aa6-a3f3-c8b8a94ccb8a None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:41.471099 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47744826-a9a0-4aa6-a3f3-c8b8a94ccb8a None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:41.471099 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47744826-a9a0-4aa6-a3f3-c8b8a94ccb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:41.492630 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-47744826-a9a0-4aa6-a3f3-c8b8a94ccb8a None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:41.494111 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-47744826-a9a0-4aa6-a3f3-c8b8a94ccb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:41.503940 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 924/1863] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:37:41.508274 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70862ac9-1a67-46c9-9784-3e22d658a31c None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:41.522527 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70862ac9-1a67-46c9-9784-3e22d658a31c None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:41.527688 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4d05d-56f0-4fe5-9585-4f7bc931f006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:41.528369 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4d05d-56f0-4fe5-9585-4f7bc931f006 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:41.528658 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4d05d-56f0-4fe5-9585-4f7bc931f006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:41.528924 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4d05d-56f0-4fe5-9585-4f7bc931f006 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:41.529695 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4d05d-56f0-4fe5-9585-4f7bc931f006 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:37:41.529992 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4d05d-56f0-4fe5-9585-4f7bc931f006 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:41.531616 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4d05d-56f0-4fe5-9585-4f7bc931f006 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:41.543636 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 940/1864] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:37:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:37:41.548605 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47744826-a9a0-4aa6-a3f3-c8b8a94ccb8a None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:41.558281 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47744826-a9a0-4aa6-a3f3-c8b8a94ccb8a None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:41.563731 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833da0a-b03e-4a91-a8ab-8468a075abe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:41.564384 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833da0a-b03e-4a91-a8ab-8468a075abe7 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:41.564664 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833da0a-b03e-4a91-a8ab-8468a075abe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:41.564931 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833da0a-b03e-4a91-a8ab-8468a075abe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:41.565639 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833da0a-b03e-4a91-a8ab-8468a075abe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:41.567585 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833da0a-b03e-4a91-a8ab-8468a075abe7 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:41.594530 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 925/1865] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:41 2021] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:41.599124 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4d05d-56f0-4fe5-9585-4f7bc931f006 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:41.612783 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4d05d-56f0-4fe5-9585-4f7bc931f006 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:41.670766 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442109c5-6f10-4ca0-8b8e-4dd20cbd651b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:41.671434 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442109c5-6f10-4ca0-8b8e-4dd20cbd651b admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:41.671709 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442109c5-6f10-4ca0-8b8e-4dd20cbd651b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:41.671979 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442109c5-6f10-4ca0-8b8e-4dd20cbd651b admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:41.672675 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442109c5-6f10-4ca0-8b8e-4dd20cbd651b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:41.674575 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442109c5-6f10-4ca0-8b8e-4dd20cbd651b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:41.697790 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 941/1866] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:41 2021] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:41.702322 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833da0a-b03e-4a91-a8ab-8468a075abe7 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:41.713022 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833da0a-b03e-4a91-a8ab-8468a075abe7 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:41.718144 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17833b-8a2f-42fd-a22b-0139e773ea1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:41.718952 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17833b-8a2f-42fd-a22b-0139e773ea1f admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:41.719212 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17833b-8a2f-42fd-a22b-0139e773ea1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:41.719488 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17833b-8a2f-42fd-a22b-0139e773ea1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:41.720293 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17833b-8a2f-42fd-a22b-0139e773ea1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:41.722055 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17833b-8a2f-42fd-a22b-0139e773ea1f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:41.732704 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 926/1867] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:41 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:41.737524 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442109c5-6f10-4ca0-8b8e-4dd20cbd651b admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:41.750256 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442109c5-6f10-4ca0-8b8e-4dd20cbd651b admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:41.759551 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c108087-6635-498e-ae40-2fa902c458f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:41.760267 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c108087-6635-498e-ae40-2fa902c458f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:41.760547 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c108087-6635-498e-ae40-2fa902c458f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:41.760816 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c108087-6635-498e-ae40-2fa902c458f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:41.761628 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c108087-6635-498e-ae40-2fa902c458f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:41.763340 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c108087-6635-498e-ae40-2fa902c458f2 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:41.774466 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 942/1868] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:41 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:41.779519 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17833b-8a2f-42fd-a22b-0139e773ea1f admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:41.794433 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17833b-8a2f-42fd-a22b-0139e773ea1f admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:41.800465 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587b789-ccc1-48a3-8a08-70b43c488378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:41.801368 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587b789-ccc1-48a3-8a08-70b43c488378 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:41.801640 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587b789-ccc1-48a3-8a08-70b43c488378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:41.801911 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587b789-ccc1-48a3-8a08-70b43c488378 admin admin] PATH_INFO: `/v3/projects/2c2a9f7a2bd94a6c93c82d1e0e0954ae/users/0448fb3c5bdc40179df8aafc42ea5b07/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:41.819278 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587b789-ccc1-48a3-8a08-70b43c488378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c2a9f7a2bd94a6c93c82d1e0e0954ae, user_id=0448fb3c5bdc40179df8aafc42ea5b07, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:41.822014 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587b789-ccc1-48a3-8a08-70b43c488378 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:41.836586 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 927/1869] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:41 2021] PUT /identity/v3/projects/2c2a9f7a2bd94a6c93c82d1e0e0954ae/users/0448fb3c5bdc40179df8aafc42ea5b07/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:41.847900 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ad5b0-e0ce-40ef-a1d6-af9aa7bed090 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:41.848276 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ad5b0-e0ce-40ef-a1d6-af9aa7bed090 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:41.848675 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ad5b0-e0ce-40ef-a1d6-af9aa7bed090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:41.877177 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-3f6ad5b0-e0ce-40ef-a1d6-af9aa7bed090 None None] MFA Rules not processed for user `0448fb3c5bdc40179df8aafc42ea5b07`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:41.878524 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-3f6ad5b0-e0ce-40ef-a1d6-af9aa7bed090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:41.946206 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 943/1870] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:41 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:41.951002 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587b789-ccc1-48a3-8a08-70b43c488378 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:42.012581 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587b789-ccc1-48a3-8a08-70b43c488378 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:42.017775 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cf371-be10-4c02-99a8-e3995f7b658a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:42.018449 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cf371-be10-4c02-99a8-e3995f7b658a admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:42.018758 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cf371-be10-4c02-99a8-e3995f7b658a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:42.019039 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cf371-be10-4c02-99a8-e3995f7b658a admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:42.019750 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cf371-be10-4c02-99a8-e3995f7b658a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:42.021669 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cf371-be10-4c02-99a8-e3995f7b658a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:42.049186 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 928/1871] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:41 2021] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:42.053371 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ad5b0-e0ce-40ef-a1d6-af9aa7bed090 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:42.064301 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ad5b0-e0ce-40ef-a1d6-af9aa7bed090 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:42.120364 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb20258-a77d-4856-8b31-6da27709e9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:42.121045 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb20258-a77d-4856-8b31-6da27709e9fd admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:42.121318 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb20258-a77d-4856-8b31-6da27709e9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:42.121571 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb20258-a77d-4856-8b31-6da27709e9fd admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:42.122273 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb20258-a77d-4856-8b31-6da27709e9fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:42.124257 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb20258-a77d-4856-8b31-6da27709e9fd admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:42.147451 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 944/1872] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:42 2021] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:42.148674 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cf371-be10-4c02-99a8-e3995f7b658a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:42.159214 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cf371-be10-4c02-99a8-e3995f7b658a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:42.164488 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cb1ef-87e3-4ac5-ad10-4e0cb9e8a23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:42.165168 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cb1ef-87e3-4ac5-ad10-4e0cb9e8a23f admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:42.165447 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cb1ef-87e3-4ac5-ad10-4e0cb9e8a23f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:42.166258 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cb1ef-87e3-4ac5-ad10-4e0cb9e8a23f admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:42.166459 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7cb1ef-87e3-4ac5-ad10-4e0cb9e8a23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:42.168206 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7cb1ef-87e3-4ac5-ad10-4e0cb9e8a23f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:42.179828 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 929/1873] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:42 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:37:42.184046 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb20258-a77d-4856-8b31-6da27709e9fd admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:42.194720 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb20258-a77d-4856-8b31-6da27709e9fd admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:42.199886 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f4b6a-3a0d-4437-9ee8-20321b90f131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:42.200786 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f4b6a-3a0d-4437-9ee8-20321b90f131 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:42.201060 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f4b6a-3a0d-4437-9ee8-20321b90f131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:42.201323 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f4b6a-3a0d-4437-9ee8-20321b90f131 admin admin] PATH_INFO: `/v3/projects/78060810f66a4973a3c8d4b4651b3829/users/66009f0d0f8540a593bb4b15d3da1be5/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:42.218043 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f4b6a-3a0d-4437-9ee8-20321b90f131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78060810f66a4973a3c8d4b4651b3829, user_id=66009f0d0f8540a593bb4b15d3da1be5, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:42.220817 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f4b6a-3a0d-4437-9ee8-20321b90f131 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:42.235285 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 945/1874] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:42 2021] PUT /identity/v3/projects/78060810f66a4973a3c8d4b4651b3829/users/66009f0d0f8540a593bb4b15d3da1be5/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:37:42.239377 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cb1ef-87e3-4ac5-ad10-4e0cb9e8a23f admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:42.249322 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cb1ef-87e3-4ac5-ad10-4e0cb9e8a23f admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:42.305514 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ba528-072d-4165-8706-ba05f6feff64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:42.306321 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ba528-072d-4165-8706-ba05f6feff64 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:42.306577 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ba528-072d-4165-8706-ba05f6feff64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:42.306968 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ba528-072d-4165-8706-ba05f6feff64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:42.307742 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ba528-072d-4165-8706-ba05f6feff64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:42.309391 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ba528-072d-4165-8706-ba05f6feff64 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:42.319417 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 930/1875] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:42 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:42.323763 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f4b6a-3a0d-4437-9ee8-20321b90f131 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:42.334965 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f4b6a-3a0d-4437-9ee8-20321b90f131 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:42.340956 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45b7fa-3df5-4405-91a2-9cb31da5973c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:42.341898 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45b7fa-3df5-4405-91a2-9cb31da5973c admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:42.342175 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45b7fa-3df5-4405-91a2-9cb31da5973c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:42.342438 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45b7fa-3df5-4405-91a2-9cb31da5973c admin admin] PATH_INFO: `/v3/projects/78060810f66a4973a3c8d4b4651b3829/users/66009f0d0f8540a593bb4b15d3da1be5/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:42.344690 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45b7fa-3df5-4405-91a2-9cb31da5973c admin admin] RBAC: Authorizing `identity:create_grant(project_id=78060810f66a4973a3c8d4b4651b3829, user_id=66009f0d0f8540a593bb4b15d3da1be5, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:42.347315 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45b7fa-3df5-4405-91a2-9cb31da5973c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:42.359514 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 946/1876] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:42 2021] PUT /identity/v3/projects/78060810f66a4973a3c8d4b4651b3829/users/66009f0d0f8540a593bb4b15d3da1be5/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:42.369847 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da79f2-dd7f-4175-9d56-3c8498426847 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:42.370141 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da79f2-dd7f-4175-9d56-3c8498426847 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:42.370413 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da79f2-dd7f-4175-9d56-3c8498426847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:42.398488 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-e6da79f2-dd7f-4175-9d56-3c8498426847 None None] MFA Rules not processed for user `66009f0d0f8540a593bb4b15d3da1be5`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:42.399735 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e6da79f2-dd7f-4175-9d56-3c8498426847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:42.469666 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 931/1877] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:42 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:42.480811 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45b7fa-3df5-4405-91a2-9cb31da5973c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:42.482889 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-5c45b7fa-3df5-4405-91a2-9cb31da5973c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:42.546282 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45b7fa-3df5-4405-91a2-9cb31da5973c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:42.550710 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94ccf5-eefc-46f4-8a40-252cb8bc9f3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:42.552058 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94ccf5-eefc-46f4-8a40-252cb8bc9f3e service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:42.552341 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94ccf5-eefc-46f4-8a40-252cb8bc9f3e service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:42.552609 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94ccf5-eefc-46f4-8a40-252cb8bc9f3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:42.562930 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec94ccf5-eefc-46f4-8a40-252cb8bc9f3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:42.564375 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec94ccf5-eefc-46f4-8a40-252cb8bc9f3e service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:42.575078 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 947/1878] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:42 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:42.656475 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da79f2-dd7f-4175-9d56-3c8498426847 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:42.666102 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da79f2-dd7f-4175-9d56-3c8498426847 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:42.670059 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a642b4-f0c1-4fb4-b0e6-527119abef06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:42.671073 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a642b4-f0c1-4fb4-b0e6-527119abef06 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:42.671347 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a642b4-f0c1-4fb4-b0e6-527119abef06 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:42.671616 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a642b4-f0c1-4fb4-b0e6-527119abef06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:42.738917 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a642b4-f0c1-4fb4-b0e6-527119abef06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:42.740725 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a642b4-f0c1-4fb4-b0e6-527119abef06 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:42.749514 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 932/1879] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:42 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:44.353791 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94ccf5-eefc-46f4-8a40-252cb8bc9f3e service cinder] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:44.355522 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-ec94ccf5-eefc-46f4-8a40-252cb8bc9f3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:44.434082 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94ccf5-eefc-46f4-8a40-252cb8bc9f3e service cinder] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:44.442593 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77f382-57ff-42d3-a855-910588f2a423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:44.443613 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77f382-57ff-42d3-a855-910588f2a423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:44.443904 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77f382-57ff-42d3-a855-910588f2a423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:44.444199 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77f382-57ff-42d3-a855-910588f2a423 admin admin] PATH_INFO: `/v3/users/1c88570392294830870164e1b266dcc4` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:44.445560 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77f382-57ff-42d3-a855-910588f2a423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c88570392294830870164e1b266dcc4)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:44.447496 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77f382-57ff-42d3-a855-910588f2a423 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:44.508912 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-6f77f382-57ff-42d3-a855-910588f2a423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c88570392294830870164e1b266dcc4'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:44.517401 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-6f77f382-57ff-42d3-a855-910588f2a423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c88570392294830870164e1b266dcc4'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:44.518098 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-6f77f382-57ff-42d3-a855-910588f2a423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c88570392294830870164e1b266dcc4'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:44.532795 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-6f77f382-57ff-42d3-a855-910588f2a423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c88570392294830870164e1b266dcc4'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:44.542084 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-6f77f382-57ff-42d3-a855-910588f2a423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c88570392294830870164e1b266dcc4'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:44.549291 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 948/1880] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:37:44 2021] DELETE /identity/v3/users/1c88570392294830870164e1b266dcc4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:44.559631 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfb8cb-a8ed-4459-a6b4-ca3144620e29 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:44.560210 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfb8cb-a8ed-4459-a6b4-ca3144620e29 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:44.560210 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfb8cb-a8ed-4459-a6b4-ca3144620e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:44.578381 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-e4dfb8cb-a8ed-4459-a6b4-ca3144620e29 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:44.579702 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e4dfb8cb-a8ed-4459-a6b4-ca3144620e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:44.637345 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 933/1881] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:37:44.647291 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77f382-57ff-42d3-a855-910588f2a423 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:44.648732 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-6f77f382-57ff-42d3-a855-910588f2a423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:44.702493 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77f382-57ff-42d3-a855-910588f2a423 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:44.706933 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bccd9-2cef-46f2-b5c0-c5d0db53cc54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:44.707515 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bccd9-2cef-46f2-b5c0-c5d0db53cc54 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:44.707790 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bccd9-2cef-46f2-b5c0-c5d0db53cc54 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:44.708057 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bccd9-2cef-46f2-b5c0-c5d0db53cc54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:44.717534 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bccd9-2cef-46f2-b5c0-c5d0db53cc54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:44.718947 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bccd9-2cef-46f2-b5c0-c5d0db53cc54 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:44.728073 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 949/1882] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:45.080919 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfb8cb-a8ed-4459-a6b4-ca3144620e29 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:45.082356 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e4dfb8cb-a8ed-4459-a6b4-ca3144620e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:45.095899 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfb8cb-a8ed-4459-a6b4-ca3144620e29 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:45.100549 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b81b3-a2db-4677-bf14-897402ceebc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:45.101452 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b81b3-a2db-4677-bf14-897402ceebc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:45.101734 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b81b3-a2db-4677-bf14-897402ceebc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:45.102005 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b81b3-a2db-4677-bf14-897402ceebc7 admin admin] PATH_INFO: `/v3/projects/2b77749d1e6341e3b3b28b539ede48cc` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:45.104356 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b81b3-a2db-4677-bf14-897402ceebc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b77749d1e6341e3b3b28b539ede48cc)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:45.106424 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b81b3-a2db-4677-bf14-897402ceebc7 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:45.156268 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1f0b81b3-a2db-4677-bf14-897402ceebc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b77749d1e6341e3b3b28b539ede48cc', 'request_id': 'req-1f0b81b3-a2db-4677-bf14-897402ceebc7'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:45.162910 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1f0b81b3-a2db-4677-bf14-897402ceebc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b77749d1e6341e3b3b28b539ede48cc', 'request_id': 'req-1f0b81b3-a2db-4677-bf14-897402ceebc7'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:45.172240 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1f0b81b3-a2db-4677-bf14-897402ceebc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b77749d1e6341e3b3b28b539ede48cc', 'request_id': 'req-1f0b81b3-a2db-4677-bf14-897402ceebc7'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:45.183577 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1f0b81b3-a2db-4677-bf14-897402ceebc7 admin admin] The token cache is being invalidate because project 2b77749d1e6341e3b3b28b539ede48cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:37:45.183864 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1f0b81b3-a2db-4677-bf14-897402ceebc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:45.184524 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1f0b81b3-a2db-4677-bf14-897402ceebc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:45.186499 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 934/1883] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:37:45 2021] DELETE /identity/v3/projects/2b77749d1e6341e3b3b28b539ede48cc => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:45.190959 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bccd9-2cef-46f2-b5c0-c5d0db53cc54 service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:45.201843 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bccd9-2cef-46f2-b5c0-c5d0db53cc54 service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:45.276030 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae53c8-e5f9-4e1a-b0a5-677778b03c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:45.276945 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae53c8-e5f9-4e1a-b0a5-677778b03c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:45.277210 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae53c8-e5f9-4e1a-b0a5-677778b03c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:45.279262 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae53c8-e5f9-4e1a-b0a5-677778b03c2c admin admin] PATH_INFO: `/v3/users/0f2a578858aa4cf484a4e883c214f5ea` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:45.280514 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae53c8-e5f9-4e1a-b0a5-677778b03c2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f2a578858aa4cf484a4e883c214f5ea)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:45.282448 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae53c8-e5f9-4e1a-b0a5-677778b03c2c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:45.341091 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a5ae53c8-e5f9-4e1a-b0a5-677778b03c2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f2a578858aa4cf484a4e883c214f5ea'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:45.354227 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a5ae53c8-e5f9-4e1a-b0a5-677778b03c2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f2a578858aa4cf484a4e883c214f5ea'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:45.356144 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a5ae53c8-e5f9-4e1a-b0a5-677778b03c2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f2a578858aa4cf484a4e883c214f5ea'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:45.371846 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a5ae53c8-e5f9-4e1a-b0a5-677778b03c2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f2a578858aa4cf484a4e883c214f5ea'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:45.381188 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a5ae53c8-e5f9-4e1a-b0a5-677778b03c2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f2a578858aa4cf484a4e883c214f5ea'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:45.388051 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 950/1884] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:37:45 2021] DELETE /identity/v3/users/0f2a578858aa4cf484a4e883c214f5ea => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:45.704885 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b81b3-a2db-4677-bf14-897402ceebc7 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:45.710244 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-1f0b81b3-a2db-4677-bf14-897402ceebc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:45.724358 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b81b3-a2db-4677-bf14-897402ceebc7 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:45.799392 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42b16a-1e1e-4bb7-ba13-1408cee79450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:45.800744 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42b16a-1e1e-4bb7-ba13-1408cee79450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:45.801120 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42b16a-1e1e-4bb7-ba13-1408cee79450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:45.801582 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42b16a-1e1e-4bb7-ba13-1408cee79450 admin admin] PATH_INFO: `/v3/projects/b46c284875d548849501a53012ee866e` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:45.807242 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42b16a-1e1e-4bb7-ba13-1408cee79450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b46c284875d548849501a53012ee866e)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:45.807242 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42b16a-1e1e-4bb7-ba13-1408cee79450 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:45.866714 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-3c42b16a-1e1e-4bb7-ba13-1408cee79450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b46c284875d548849501a53012ee866e', 'request_id': 'req-3c42b16a-1e1e-4bb7-ba13-1408cee79450'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:45.875263 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-3c42b16a-1e1e-4bb7-ba13-1408cee79450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b46c284875d548849501a53012ee866e', 'request_id': 'req-3c42b16a-1e1e-4bb7-ba13-1408cee79450'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:45.889419 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-3c42b16a-1e1e-4bb7-ba13-1408cee79450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b46c284875d548849501a53012ee866e', 'request_id': 'req-3c42b16a-1e1e-4bb7-ba13-1408cee79450'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:45.908303 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-3c42b16a-1e1e-4bb7-ba13-1408cee79450 admin admin] The token cache is being invalidate because project b46c284875d548849501a53012ee866e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:37:45.908701 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-3c42b16a-1e1e-4bb7-ba13-1408cee79450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:45.909379 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-3c42b16a-1e1e-4bb7-ba13-1408cee79450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:45.911111 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 935/1885] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:37:45 2021] DELETE /identity/v3/projects/b46c284875d548849501a53012ee866e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:45.915308 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae53c8-e5f9-4e1a-b0a5-677778b03c2c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:45.916750 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a5ae53c8-e5f9-4e1a-b0a5-677778b03c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:45.929917 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae53c8-e5f9-4e1a-b0a5-677778b03c2c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:46.000666 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee405536-d217-43aa-ba53-407e3565de34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:46.001792 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee405536-d217-43aa-ba53-407e3565de34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:46.002252 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee405536-d217-43aa-ba53-407e3565de34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:46.002796 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee405536-d217-43aa-ba53-407e3565de34 admin admin] PATH_INFO: `/v3/users/e252b7187ea746d1889a0c2b7cfef526` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:46.004607 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee405536-d217-43aa-ba53-407e3565de34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e252b7187ea746d1889a0c2b7cfef526)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:46.007168 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee405536-d217-43aa-ba53-407e3565de34 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:46.079465 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-ee405536-d217-43aa-ba53-407e3565de34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e252b7187ea746d1889a0c2b7cfef526'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:46.090167 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-ee405536-d217-43aa-ba53-407e3565de34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e252b7187ea746d1889a0c2b7cfef526'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:46.090893 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-ee405536-d217-43aa-ba53-407e3565de34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e252b7187ea746d1889a0c2b7cfef526'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:46.103189 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-ee405536-d217-43aa-ba53-407e3565de34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e252b7187ea746d1889a0c2b7cfef526'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:46.110117 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-ee405536-d217-43aa-ba53-407e3565de34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e252b7187ea746d1889a0c2b7cfef526'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:46.122176 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 951/1886] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:37:45 2021] DELETE /identity/v3/users/e252b7187ea746d1889a0c2b7cfef526 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:46.443107 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42b16a-1e1e-4bb7-ba13-1408cee79450 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:46.444849 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-3c42b16a-1e1e-4bb7-ba13-1408cee79450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:46.484176 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42b16a-1e1e-4bb7-ba13-1408cee79450 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:46.554609 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07d094-5dae-4917-8b81-d3784af2bc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:46.555594 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07d094-5dae-4917-8b81-d3784af2bc8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:46.555938 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07d094-5dae-4917-8b81-d3784af2bc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:46.556275 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07d094-5dae-4917-8b81-d3784af2bc8e admin admin] PATH_INFO: `/v3/projects/427c770d3694413c905d3589a19e235c` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:46.557538 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07d094-5dae-4917-8b81-d3784af2bc8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=427c770d3694413c905d3589a19e235c)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:46.560761 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07d094-5dae-4917-8b81-d3784af2bc8e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:46.606360 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-fc07d094-5dae-4917-8b81-d3784af2bc8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '427c770d3694413c905d3589a19e235c', 'request_id': 'req-fc07d094-5dae-4917-8b81-d3784af2bc8e'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:46.613025 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-fc07d094-5dae-4917-8b81-d3784af2bc8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '427c770d3694413c905d3589a19e235c', 'request_id': 'req-fc07d094-5dae-4917-8b81-d3784af2bc8e'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:46.621281 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-fc07d094-5dae-4917-8b81-d3784af2bc8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '427c770d3694413c905d3589a19e235c', 'request_id': 'req-fc07d094-5dae-4917-8b81-d3784af2bc8e'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:46.633732 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-fc07d094-5dae-4917-8b81-d3784af2bc8e admin admin] The token cache is being invalidate because project 427c770d3694413c905d3589a19e235c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:37:46.634119 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-fc07d094-5dae-4917-8b81-d3784af2bc8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:46.634873 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-fc07d094-5dae-4917-8b81-d3784af2bc8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:46.637007 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 936/1887] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:37:46 2021] DELETE /identity/v3/projects/427c770d3694413c905d3589a19e235c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:37:46.643591 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494b617-b5e7-4a1a-b3c8-e44caf59df88 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:46.644186 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494b617-b5e7-4a1a-b3c8-e44caf59df88 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:46.644298 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494b617-b5e7-4a1a-b3c8-e44caf59df88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:46.662984 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-d494b617-b5e7-4a1a-b3c8-e44caf59df88 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:46.664201 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-d494b617-b5e7-4a1a-b3c8-e44caf59df88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:46.722791 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 952/1888] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:46.732117 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f1263-8272-47b1-8c5f-872e91be43a3 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:46.732678 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f1263-8272-47b1-8c5f-872e91be43a3 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:46.732678 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f1263-8272-47b1-8c5f-872e91be43a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:46.753569 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-774f1263-8272-47b1-8c5f-872e91be43a3 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:46.754829 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-774f1263-8272-47b1-8c5f-872e91be43a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:46.763460 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 937/1889] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:46.767964 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494b617-b5e7-4a1a-b3c8-e44caf59df88 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:46.777442 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494b617-b5e7-4a1a-b3c8-e44caf59df88 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:46.782017 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8b5d6-50d9-4961-8872-5aa1433d14dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:46.782727 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8b5d6-50d9-4961-8872-5aa1433d14dd admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:46.783008 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8b5d6-50d9-4961-8872-5aa1433d14dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:46.783295 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8b5d6-50d9-4961-8872-5aa1433d14dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:46.784035 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8b5d6-50d9-4961-8872-5aa1433d14dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:37:46.784343 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8b5d6-50d9-4961-8872-5aa1433d14dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:46.785935 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8b5d6-50d9-4961-8872-5aa1433d14dd admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:46.801425 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 953/1890] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:37:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:37:46.802555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f1263-8272-47b1-8c5f-872e91be43a3 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:46.811956 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f1263-8272-47b1-8c5f-872e91be43a3 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:46.817000 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624e12e-e10b-499d-b7c7-4fb458ed960d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:46.817666 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624e12e-e10b-499d-b7c7-4fb458ed960d admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:46.817945 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624e12e-e10b-499d-b7c7-4fb458ed960d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:46.818220 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624e12e-e10b-499d-b7c7-4fb458ed960d admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:46.819025 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624e12e-e10b-499d-b7c7-4fb458ed960d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:46.820956 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624e12e-e10b-499d-b7c7-4fb458ed960d admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:46.855257 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 938/1891] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:46 2021] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:37:46.856664 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8b5d6-50d9-4961-8872-5aa1433d14dd admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:46.868139 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8b5d6-50d9-4961-8872-5aa1433d14dd admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:46.929691 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5851a5-3b36-4b9f-86a9-cda9ce4fa330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:46.930410 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5851a5-3b36-4b9f-86a9-cda9ce4fa330 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:46.930671 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5851a5-3b36-4b9f-86a9-cda9ce4fa330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:46.930969 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5851a5-3b36-4b9f-86a9-cda9ce4fa330 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:46.931694 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5851a5-3b36-4b9f-86a9-cda9ce4fa330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:46.933609 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5851a5-3b36-4b9f-86a9-cda9ce4fa330 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:46.957949 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 954/1892] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:46 2021] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:37:46.963077 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624e12e-e10b-499d-b7c7-4fb458ed960d admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:46.974392 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624e12e-e10b-499d-b7c7-4fb458ed960d admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:46.980656 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121effff-a61c-4003-b5c1-76621a88e123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:46.981138 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121effff-a61c-4003-b5c1-76621a88e123 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:46.981417 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121effff-a61c-4003-b5c1-76621a88e123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:46.981688 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121effff-a61c-4003-b5c1-76621a88e123 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:46.982434 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121effff-a61c-4003-b5c1-76621a88e123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:46.984091 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121effff-a61c-4003-b5c1-76621a88e123 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:46.998212 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 939/1893] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:46 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:46.999474 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5851a5-3b36-4b9f-86a9-cda9ce4fa330 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:47.009423 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5851a5-3b36-4b9f-86a9-cda9ce4fa330 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:47.014025 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf3857-820c-48d2-8ec9-9ac50f7d1709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:47.014710 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf3857-820c-48d2-8ec9-9ac50f7d1709 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:47.014991 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf3857-820c-48d2-8ec9-9ac50f7d1709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:47.015257 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf3857-820c-48d2-8ec9-9ac50f7d1709 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:47.015987 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf3857-820c-48d2-8ec9-9ac50f7d1709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:47.017587 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf3857-820c-48d2-8ec9-9ac50f7d1709 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:47.028441 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 955/1894] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:46 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:47.036714 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121effff-a61c-4003-b5c1-76621a88e123 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:47.065658 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121effff-a61c-4003-b5c1-76621a88e123 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:47.076433 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d569c-cd7c-4753-80ee-be87192a1b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:47.077553 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d569c-cd7c-4753-80ee-be87192a1b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:47.079194 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d569c-cd7c-4753-80ee-be87192a1b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:47.083085 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d569c-cd7c-4753-80ee-be87192a1b80 admin admin] PATH_INFO: `/v3/projects/6809c9e8eb704f95bee93348b827d2e4/users/51a606520686469e808bbe5f02499c8e/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:47.100647 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d569c-cd7c-4753-80ee-be87192a1b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6809c9e8eb704f95bee93348b827d2e4, user_id=51a606520686469e808bbe5f02499c8e, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:47.103564 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d569c-cd7c-4753-80ee-be87192a1b80 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:47.122257 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 940/1895] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:47 2021] PUT /identity/v3/projects/6809c9e8eb704f95bee93348b827d2e4/users/51a606520686469e808bbe5f02499c8e/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:47.133689 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03d1b6-dc08-4278-a0bb-b28158c7c216 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:47.133935 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03d1b6-dc08-4278-a0bb-b28158c7c216 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:47.134236 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03d1b6-dc08-4278-a0bb-b28158c7c216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:47.163825 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-6d03d1b6-dc08-4278-a0bb-b28158c7c216 None None] MFA Rules not processed for user `51a606520686469e808bbe5f02499c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:47.165344 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-6d03d1b6-dc08-4278-a0bb-b28158c7c216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:47.238927 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 956/1896] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:47 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:47.240509 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d569c-cd7c-4753-80ee-be87192a1b80 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:47.308374 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d569c-cd7c-4753-80ee-be87192a1b80 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:47.313555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80e411-7cac-4b4b-a0f6-bb9a23ba888c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:47.314231 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80e411-7cac-4b4b-a0f6-bb9a23ba888c admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:47.314515 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80e411-7cac-4b4b-a0f6-bb9a23ba888c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:47.314827 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80e411-7cac-4b4b-a0f6-bb9a23ba888c admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:47.315586 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80e411-7cac-4b4b-a0f6-bb9a23ba888c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:47.317543 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80e411-7cac-4b4b-a0f6-bb9a23ba888c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:47.348833 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 941/1897] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:47 2021] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:47.350100 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03d1b6-dc08-4278-a0bb-b28158c7c216 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:47.360938 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03d1b6-dc08-4278-a0bb-b28158c7c216 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:47.416624 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7328e1-8d10-4bdd-922d-b3d75556ae1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:47.417217 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7328e1-8d10-4bdd-922d-b3d75556ae1d admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:47.417488 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7328e1-8d10-4bdd-922d-b3d75556ae1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:47.417743 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7328e1-8d10-4bdd-922d-b3d75556ae1d admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:47.418547 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7328e1-8d10-4bdd-922d-b3d75556ae1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:47.421005 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7328e1-8d10-4bdd-922d-b3d75556ae1d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:47.442119 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 957/1898] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:47 2021] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:37:47.446132 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80e411-7cac-4b4b-a0f6-bb9a23ba888c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:47.457090 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80e411-7cac-4b4b-a0f6-bb9a23ba888c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:47.462403 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef043fa-3b00-4047-9430-2939322a78e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:47.463164 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef043fa-3b00-4047-9430-2939322a78e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:47.463485 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef043fa-3b00-4047-9430-2939322a78e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:47.463775 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef043fa-3b00-4047-9430-2939322a78e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:47.464620 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef043fa-3b00-4047-9430-2939322a78e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:47.466561 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef043fa-3b00-4047-9430-2939322a78e0 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:47.478649 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 942/1899] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:47 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:47.483243 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7328e1-8d10-4bdd-922d-b3d75556ae1d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:47.493354 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7328e1-8d10-4bdd-922d-b3d75556ae1d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:47.498150 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198f0d6-1fff-425b-8832-55dde5c68306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:47.499146 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198f0d6-1fff-425b-8832-55dde5c68306 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:47.499432 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198f0d6-1fff-425b-8832-55dde5c68306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:47.499707 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198f0d6-1fff-425b-8832-55dde5c68306 admin admin] PATH_INFO: `/v3/projects/f1fc31f86f4546268533306f87656061/users/adb9304d084842879c54e43eb3da6028/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:47.514926 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198f0d6-1fff-425b-8832-55dde5c68306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1fc31f86f4546268533306f87656061, user_id=adb9304d084842879c54e43eb3da6028, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:47.517576 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198f0d6-1fff-425b-8832-55dde5c68306 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:47.531164 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 958/1900] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:47 2021] PUT /identity/v3/projects/f1fc31f86f4546268533306f87656061/users/adb9304d084842879c54e43eb3da6028/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:47.535268 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef043fa-3b00-4047-9430-2939322a78e0 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:47.547724 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef043fa-3b00-4047-9430-2939322a78e0 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:47.615742 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd2ecb-4686-40b6-9a76-dcc76c1ae741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:47.616560 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd2ecb-4686-40b6-9a76-dcc76c1ae741 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:47.616736 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd2ecb-4686-40b6-9a76-dcc76c1ae741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:47.616993 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd2ecb-4686-40b6-9a76-dcc76c1ae741 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:47.617913 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd2ecb-4686-40b6-9a76-dcc76c1ae741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:47.619967 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd2ecb-4686-40b6-9a76-dcc76c1ae741 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:47.631952 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 943/1901] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:47 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:47.636071 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198f0d6-1fff-425b-8832-55dde5c68306 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:47.649490 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198f0d6-1fff-425b-8832-55dde5c68306 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:47.656372 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12032e5a-1c63-4705-9adc-155eeb76dae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:47.657433 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12032e5a-1c63-4705-9adc-155eeb76dae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:47.659232 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12032e5a-1c63-4705-9adc-155eeb76dae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:47.659526 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12032e5a-1c63-4705-9adc-155eeb76dae2 admin admin] PATH_INFO: `/v3/projects/f1fc31f86f4546268533306f87656061/users/adb9304d084842879c54e43eb3da6028/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:47.662198 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12032e5a-1c63-4705-9adc-155eeb76dae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1fc31f86f4546268533306f87656061, user_id=adb9304d084842879c54e43eb3da6028, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:47.665606 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12032e5a-1c63-4705-9adc-155eeb76dae2 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:47.678391 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 959/1902] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:47 2021] PUT /identity/v3/projects/f1fc31f86f4546268533306f87656061/users/adb9304d084842879c54e43eb3da6028/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:47.689589 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97193dec-7c34-4ac4-af27-d9981b26f424 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:47.689875 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97193dec-7c34-4ac4-af27-d9981b26f424 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:47.690322 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97193dec-7c34-4ac4-af27-d9981b26f424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:47.721599 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-97193dec-7c34-4ac4-af27-d9981b26f424 None None] MFA Rules not processed for user `adb9304d084842879c54e43eb3da6028`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:47.722867 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-97193dec-7c34-4ac4-af27-d9981b26f424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:47.803847 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 944/1903] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:47 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:37:47.814770 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12032e5a-1c63-4705-9adc-155eeb76dae2 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:47.816587 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-12032e5a-1c63-4705-9adc-155eeb76dae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:47.873486 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12032e5a-1c63-4705-9adc-155eeb76dae2 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:47.877957 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52871b03-2bed-4d1c-a763-26823ea2bdae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:47.878738 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52871b03-2bed-4d1c-a763-26823ea2bdae service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:47.879016 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52871b03-2bed-4d1c-a763-26823ea2bdae service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:47.879288 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52871b03-2bed-4d1c-a763-26823ea2bdae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:47.888831 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52871b03-2bed-4d1c-a763-26823ea2bdae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:47.890252 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52871b03-2bed-4d1c-a763-26823ea2bdae service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:47.899836 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 960/1904] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:47 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:37:47.970236 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97193dec-7c34-4ac4-af27-d9981b26f424 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:47.983295 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97193dec-7c34-4ac4-af27-d9981b26f424 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:47.988713 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cf94e-14be-4b39-b495-45b1d2d1c001 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:47.989386 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cf94e-14be-4b39-b495-45b1d2d1c001 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:47.989664 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cf94e-14be-4b39-b495-45b1d2d1c001 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:47.989998 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cf94e-14be-4b39-b495-45b1d2d1c001 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:48.053569 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cf94e-14be-4b39-b495-45b1d2d1c001 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:48.055048 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cf94e-14be-4b39-b495-45b1d2d1c001 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:48.065059 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 945/1905] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:47 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:48.345990 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52871b03-2bed-4d1c-a763-26823ea2bdae service cinder] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:48.417856 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52871b03-2bed-4d1c-a763-26823ea2bdae service cinder] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:48.422973 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676140e-2230-495b-879a-68b6e5459492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:48.423876 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676140e-2230-495b-879a-68b6e5459492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:48.424158 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676140e-2230-495b-879a-68b6e5459492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:48.424432 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676140e-2230-495b-879a-68b6e5459492 admin admin] PATH_INFO: `/v3/users/51a606520686469e808bbe5f02499c8e` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:48.425770 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676140e-2230-495b-879a-68b6e5459492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51a606520686469e808bbe5f02499c8e)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:48.427737 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676140e-2230-495b-879a-68b6e5459492 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:48.479756 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4676140e-2230-495b-879a-68b6e5459492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51a606520686469e808bbe5f02499c8e'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:48.488499 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4676140e-2230-495b-879a-68b6e5459492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51a606520686469e808bbe5f02499c8e'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:48.489263 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4676140e-2230-495b-879a-68b6e5459492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51a606520686469e808bbe5f02499c8e'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:48.502566 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4676140e-2230-495b-879a-68b6e5459492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51a606520686469e808bbe5f02499c8e'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:48.510083 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4676140e-2230-495b-879a-68b6e5459492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51a606520686469e808bbe5f02499c8e'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:48.518633 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 961/1906] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:37:48 2021] DELETE /identity/v3/users/51a606520686469e808bbe5f02499c8e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:48.521735 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6de2a-40e7-4dd2-9070-23cfb172a749 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:48.522028 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6de2a-40e7-4dd2-9070-23cfb172a749 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:48.522294 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6de2a-40e7-4dd2-9070-23cfb172a749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:48.541272 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-c7d6de2a-40e7-4dd2-9070-23cfb172a749 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:48.543311 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-c7d6de2a-40e7-4dd2-9070-23cfb172a749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:48.605994 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 946/1907] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:48.616449 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676140e-2230-495b-879a-68b6e5459492 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:48.617865 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-4676140e-2230-495b-879a-68b6e5459492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:48.683774 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676140e-2230-495b-879a-68b6e5459492 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:48.688049 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae93702-b257-4329-811c-0f150d54b671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:48.688697 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae93702-b257-4329-811c-0f150d54b671 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:48.688970 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae93702-b257-4329-811c-0f150d54b671 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:48.689235 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae93702-b257-4329-811c-0f150d54b671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:48.699628 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae93702-b257-4329-811c-0f150d54b671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:48.701115 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae93702-b257-4329-811c-0f150d54b671 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:48.711286 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 962/1908] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:49.028905 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6de2a-40e7-4dd2-9070-23cfb172a749 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:49.030950 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-c7d6de2a-40e7-4dd2-9070-23cfb172a749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:49.046530 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6de2a-40e7-4dd2-9070-23cfb172a749 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:49.052208 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f255a-d962-4f37-a245-78c3fbd89879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:49.053299 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f255a-d962-4f37-a245-78c3fbd89879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:49.053601 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f255a-d962-4f37-a245-78c3fbd89879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:49.053853 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f255a-d962-4f37-a245-78c3fbd89879 admin admin] PATH_INFO: `/v3/projects/6809c9e8eb704f95bee93348b827d2e4` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:49.055191 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f255a-d962-4f37-a245-78c3fbd89879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6809c9e8eb704f95bee93348b827d2e4)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:49.057120 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f255a-d962-4f37-a245-78c3fbd89879 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:49.108772 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-8f4f255a-d962-4f37-a245-78c3fbd89879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6809c9e8eb704f95bee93348b827d2e4', 'request_id': 'req-8f4f255a-d962-4f37-a245-78c3fbd89879'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:49.115602 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-8f4f255a-d962-4f37-a245-78c3fbd89879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6809c9e8eb704f95bee93348b827d2e4', 'request_id': 'req-8f4f255a-d962-4f37-a245-78c3fbd89879'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:49.125223 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-8f4f255a-d962-4f37-a245-78c3fbd89879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6809c9e8eb704f95bee93348b827d2e4', 'request_id': 'req-8f4f255a-d962-4f37-a245-78c3fbd89879'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:49.136547 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-8f4f255a-d962-4f37-a245-78c3fbd89879 admin admin] The token cache is being invalidate because project 6809c9e8eb704f95bee93348b827d2e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:37:49.136830 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-8f4f255a-d962-4f37-a245-78c3fbd89879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:49.137459 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-8f4f255a-d962-4f37-a245-78c3fbd89879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:49.139203 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 947/1909] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:37:49 2021] DELETE /identity/v3/projects/6809c9e8eb704f95bee93348b827d2e4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:49.143813 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae93702-b257-4329-811c-0f150d54b671 service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:49.154067 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae93702-b257-4329-811c-0f150d54b671 service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:49.216469 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c0934-94f4-4a5e-8316-aed0c02c28e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:49.217345 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c0934-94f4-4a5e-8316-aed0c02c28e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:49.217623 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c0934-94f4-4a5e-8316-aed0c02c28e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:49.217915 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c0934-94f4-4a5e-8316-aed0c02c28e5 admin admin] PATH_INFO: `/v3/users/adb9304d084842879c54e43eb3da6028` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:49.219237 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c0934-94f4-4a5e-8316-aed0c02c28e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adb9304d084842879c54e43eb3da6028)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:49.221146 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c0934-94f4-4a5e-8316-aed0c02c28e5 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:49.276247 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-206c0934-94f4-4a5e-8316-aed0c02c28e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adb9304d084842879c54e43eb3da6028'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:49.289017 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-206c0934-94f4-4a5e-8316-aed0c02c28e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adb9304d084842879c54e43eb3da6028'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:49.290298 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-206c0934-94f4-4a5e-8316-aed0c02c28e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adb9304d084842879c54e43eb3da6028'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:49.303246 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-206c0934-94f4-4a5e-8316-aed0c02c28e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adb9304d084842879c54e43eb3da6028'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:49.310325 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-206c0934-94f4-4a5e-8316-aed0c02c28e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adb9304d084842879c54e43eb3da6028'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:49.316175 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 963/1910] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:37:49 2021] DELETE /identity/v3/users/adb9304d084842879c54e43eb3da6028 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:49.862024 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f255a-d962-4f37-a245-78c3fbd89879 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:49.863595 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-8f4f255a-d962-4f37-a245-78c3fbd89879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:49.877741 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f255a-d962-4f37-a245-78c3fbd89879 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:49.938386 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b65aa-4878-41c9-bbe4-3b851c529c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:49.939296 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b65aa-4878-41c9-bbe4-3b851c529c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:49.939576 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b65aa-4878-41c9-bbe4-3b851c529c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:49.939844 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b65aa-4878-41c9-bbe4-3b851c529c22 admin admin] PATH_INFO: `/v3/projects/f1fc31f86f4546268533306f87656061` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:49.941024 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b65aa-4878-41c9-bbe4-3b851c529c22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1fc31f86f4546268533306f87656061)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:49.943317 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b65aa-4878-41c9-bbe4-3b851c529c22 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:49.993221 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cc0b65aa-4878-41c9-bbe4-3b851c529c22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1fc31f86f4546268533306f87656061', 'request_id': 'req-cc0b65aa-4878-41c9-bbe4-3b851c529c22'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:50.000029 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cc0b65aa-4878-41c9-bbe4-3b851c529c22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1fc31f86f4546268533306f87656061', 'request_id': 'req-cc0b65aa-4878-41c9-bbe4-3b851c529c22'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:50.008597 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cc0b65aa-4878-41c9-bbe4-3b851c529c22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1fc31f86f4546268533306f87656061', 'request_id': 'req-cc0b65aa-4878-41c9-bbe4-3b851c529c22'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:50.019995 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cc0b65aa-4878-41c9-bbe4-3b851c529c22 admin admin] The token cache is being invalidate because project f1fc31f86f4546268533306f87656061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:37:50.020287 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cc0b65aa-4878-41c9-bbe4-3b851c529c22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:50.020959 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cc0b65aa-4878-41c9-bbe4-3b851c529c22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:50.022553 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 948/1911] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:37:49 2021] DELETE /identity/v3/projects/f1fc31f86f4546268533306f87656061 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:37:50.028379 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb81c94-605a-449b-8183-f35c27d65e72 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:50.028886 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb81c94-605a-449b-8183-f35c27d65e72 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:50.028996 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb81c94-605a-449b-8183-f35c27d65e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:50.047186 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-ccb81c94-605a-449b-8183-f35c27d65e72 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:50.048420 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-ccb81c94-605a-449b-8183-f35c27d65e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:50.108773 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 964/1912] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:37:50.116911 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdddf67c-a80f-45a6-83ff-ed97af70e9f0 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:50.117496 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdddf67c-a80f-45a6-83ff-ed97af70e9f0 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:50.117496 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdddf67c-a80f-45a6-83ff-ed97af70e9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:50.136575 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-fdddf67c-a80f-45a6-83ff-ed97af70e9f0 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:50.137841 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-fdddf67c-a80f-45a6-83ff-ed97af70e9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:50.146325 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 949/1913] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:50.150692 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb81c94-605a-449b-8183-f35c27d65e72 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:50.160819 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb81c94-605a-449b-8183-f35c27d65e72 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:50.165700 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23024b06-fcb6-4b97-957c-4da19e14c897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:50.166376 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23024b06-fcb6-4b97-957c-4da19e14c897 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:50.166653 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23024b06-fcb6-4b97-957c-4da19e14c897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:50.166964 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23024b06-fcb6-4b97-957c-4da19e14c897 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:50.167714 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23024b06-fcb6-4b97-957c-4da19e14c897 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:37:50.168011 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23024b06-fcb6-4b97-957c-4da19e14c897 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:50.169675 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23024b06-fcb6-4b97-957c-4da19e14c897 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:50.184000 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 965/1914] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:37:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:37:50.188043 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdddf67c-a80f-45a6-83ff-ed97af70e9f0 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:50.199848 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdddf67c-a80f-45a6-83ff-ed97af70e9f0 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:50.204680 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8f0f9-1983-4718-bec2-3e15263542f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:50.205555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8f0f9-1983-4718-bec2-3e15263542f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:50.205838 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8f0f9-1983-4718-bec2-3e15263542f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:50.206114 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8f0f9-1983-4718-bec2-3e15263542f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:50.206891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8f0f9-1983-4718-bec2-3e15263542f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:50.210015 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8f0f9-1983-4718-bec2-3e15263542f1 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:50.242451 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 950/1915] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:50 2021] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:50.246722 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23024b06-fcb6-4b97-957c-4da19e14c897 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:50.265965 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23024b06-fcb6-4b97-957c-4da19e14c897 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:50.328065 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec912d-670b-4e89-8887-9910cedca15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:50.328755 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec912d-670b-4e89-8887-9910cedca15f admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:50.329038 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec912d-670b-4e89-8887-9910cedca15f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:50.329362 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec912d-670b-4e89-8887-9910cedca15f admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:50.330271 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec912d-670b-4e89-8887-9910cedca15f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:50.333088 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec912d-670b-4e89-8887-9910cedca15f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:50.359385 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 966/1916] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:50 2021] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:50.363439 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8f0f9-1983-4718-bec2-3e15263542f1 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:50.375276 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8f0f9-1983-4718-bec2-3e15263542f1 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:50.379984 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636fc366-1016-4731-a6eb-5488e3dbe9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:50.380659 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fc366-1016-4731-a6eb-5488e3dbe9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:50.380941 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fc366-1016-4731-a6eb-5488e3dbe9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:50.381218 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fc366-1016-4731-a6eb-5488e3dbe9a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:50.382124 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636fc366-1016-4731-a6eb-5488e3dbe9a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:50.383776 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636fc366-1016-4731-a6eb-5488e3dbe9a4 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:50.394431 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 951/1917] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:50 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:50.398559 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec912d-670b-4e89-8887-9910cedca15f admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:50.408809 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec912d-670b-4e89-8887-9910cedca15f admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:50.415193 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b540611-16e2-4cb5-8d1e-7b0f35eb87ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:50.415880 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b540611-16e2-4cb5-8d1e-7b0f35eb87ab admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:50.416163 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b540611-16e2-4cb5-8d1e-7b0f35eb87ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:50.416440 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b540611-16e2-4cb5-8d1e-7b0f35eb87ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:50.417190 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b540611-16e2-4cb5-8d1e-7b0f35eb87ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:50.418942 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b540611-16e2-4cb5-8d1e-7b0f35eb87ab admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:50.433972 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 967/1918] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:50 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:50.435569 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636fc366-1016-4731-a6eb-5488e3dbe9a4 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:50.445696 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636fc366-1016-4731-a6eb-5488e3dbe9a4 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:50.450881 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd8e83-78a9-4c9f-a2f9-a9d461354a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:50.451864 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd8e83-78a9-4c9f-a2f9-a9d461354a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:50.452217 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd8e83-78a9-4c9f-a2f9-a9d461354a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:50.452557 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd8e83-78a9-4c9f-a2f9-a9d461354a88 admin admin] PATH_INFO: `/v3/projects/ce48d1c7b4a74bbaadc82d6769764e5b/users/0391a70326d0417a9a71b498921c63df/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:50.469264 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd8e83-78a9-4c9f-a2f9-a9d461354a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce48d1c7b4a74bbaadc82d6769764e5b, user_id=0391a70326d0417a9a71b498921c63df, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:50.472244 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd8e83-78a9-4c9f-a2f9-a9d461354a88 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:50.488523 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 952/1919] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:50 2021] PUT /identity/v3/projects/ce48d1c7b4a74bbaadc82d6769764e5b/users/0391a70326d0417a9a71b498921c63df/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:50.498775 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0841ddc-4dad-48d8-b833-5177cb464c5a None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:50.499068 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0841ddc-4dad-48d8-b833-5177cb464c5a None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:50.499346 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0841ddc-4dad-48d8-b833-5177cb464c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:50.526742 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-d0841ddc-4dad-48d8-b833-5177cb464c5a None None] MFA Rules not processed for user `0391a70326d0417a9a71b498921c63df`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:50.528289 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-d0841ddc-4dad-48d8-b833-5177cb464c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:50.598205 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 968/1920] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:50 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:50.602853 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd8e83-78a9-4c9f-a2f9-a9d461354a88 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:50.668172 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd8e83-78a9-4c9f-a2f9-a9d461354a88 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:50.673856 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66024dc0-0a44-40d3-8a5d-cc0217e06ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:50.674789 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66024dc0-0a44-40d3-8a5d-cc0217e06ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:50.675216 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66024dc0-0a44-40d3-8a5d-cc0217e06ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:50.675485 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66024dc0-0a44-40d3-8a5d-cc0217e06ef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:50.676201 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66024dc0-0a44-40d3-8a5d-cc0217e06ef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:50.678129 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66024dc0-0a44-40d3-8a5d-cc0217e06ef2 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:50.708149 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 953/1921] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:50 2021] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:50.712140 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0841ddc-4dad-48d8-b833-5177cb464c5a None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:50.724515 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0841ddc-4dad-48d8-b833-5177cb464c5a None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:50.783865 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221437d-08f3-41fe-adf6-95bf282146a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:50.784552 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221437d-08f3-41fe-adf6-95bf282146a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:50.784832 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221437d-08f3-41fe-adf6-95bf282146a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:50.785102 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221437d-08f3-41fe-adf6-95bf282146a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:50.785829 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221437d-08f3-41fe-adf6-95bf282146a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:50.790652 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221437d-08f3-41fe-adf6-95bf282146a7 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:50.815985 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 969/1922] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:50 2021] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:50.817232 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66024dc0-0a44-40d3-8a5d-cc0217e06ef2 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:50.828808 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66024dc0-0a44-40d3-8a5d-cc0217e06ef2 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:50.833701 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb834c2-83ab-40d6-9b44-8851b83e4839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:50.834422 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb834c2-83ab-40d6-9b44-8851b83e4839 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:50.834817 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb834c2-83ab-40d6-9b44-8851b83e4839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:50.835123 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb834c2-83ab-40d6-9b44-8851b83e4839 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:50.835949 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb834c2-83ab-40d6-9b44-8851b83e4839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:50.837560 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb834c2-83ab-40d6-9b44-8851b83e4839 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:50.848380 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 954/1923] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:50 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:50.852393 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221437d-08f3-41fe-adf6-95bf282146a7 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:50.860606 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb834c2-83ab-40d6-9b44-8851b83e4839 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:50.862597 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-7bb834c2-83ab-40d6-9b44-8851b83e4839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:50.863325 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221437d-08f3-41fe-adf6-95bf282146a7 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:50.868706 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66e5a6-d012-4833-867d-90d207d8a83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:50.869314 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66e5a6-d012-4833-867d-90d207d8a83d admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:50.869591 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66e5a6-d012-4833-867d-90d207d8a83d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:50.869889 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66e5a6-d012-4833-867d-90d207d8a83d admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:50.870662 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66e5a6-d012-4833-867d-90d207d8a83d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:50.872374 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66e5a6-d012-4833-867d-90d207d8a83d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:50.875541 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb834c2-83ab-40d6-9b44-8851b83e4839 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:50.885906 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 970/1924] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:50 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:50.887574 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66e5a6-d012-4833-867d-90d207d8a83d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:50.888133 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be032f-6b65-45bc-b1ee-9a8ace9dd476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:50.889025 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be032f-6b65-45bc-b1ee-9a8ace9dd476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:50.889421 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be032f-6b65-45bc-b1ee-9a8ace9dd476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:50.889793 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be032f-6b65-45bc-b1ee-9a8ace9dd476 admin admin] PATH_INFO: `/v3/users/0448fb3c5bdc40179df8aafc42ea5b07` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:50.891169 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be032f-6b65-45bc-b1ee-9a8ace9dd476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0448fb3c5bdc40179df8aafc42ea5b07)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:50.893284 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be032f-6b65-45bc-b1ee-9a8ace9dd476 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:50.897614 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66e5a6-d012-4833-867d-90d207d8a83d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:50.902746 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f5e11-dfe8-400c-9505-b9e7a9d17fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:50.903818 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f5e11-dfe8-400c-9505-b9e7a9d17fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:50.904256 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f5e11-dfe8-400c-9505-b9e7a9d17fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:50.904535 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f5e11-dfe8-400c-9505-b9e7a9d17fc9 admin admin] PATH_INFO: `/v3/projects/0a08b330700544508d32644dcf4a60a4/users/0c6ffd0e078344aebf02c3463d8c4bd4/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:50.922576 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f5e11-dfe8-400c-9505-b9e7a9d17fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a08b330700544508d32644dcf4a60a4, user_id=0c6ffd0e078344aebf02c3463d8c4bd4, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:50.925625 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f5e11-dfe8-400c-9505-b9e7a9d17fc9 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:50.941345 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 971/1925] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:50 2021] PUT /identity/v3/projects/0a08b330700544508d32644dcf4a60a4/users/0c6ffd0e078344aebf02c3463d8c4bd4/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:50.947664 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-57be032f-6b65-45bc-b1ee-9a8ace9dd476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0448fb3c5bdc40179df8aafc42ea5b07'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:50.948419 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-57be032f-6b65-45bc-b1ee-9a8ace9dd476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0448fb3c5bdc40179df8aafc42ea5b07'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:50.952561 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79351d-eb6e-4244-a3f2-2374d4dcf0a0 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:50.952995 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79351d-eb6e-4244-a3f2-2374d4dcf0a0 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:50.953177 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79351d-eb6e-4244-a3f2-2374d4dcf0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:50.956448 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-57be032f-6b65-45bc-b1ee-9a8ace9dd476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0448fb3c5bdc40179df8aafc42ea5b07'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:50.963592 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-57be032f-6b65-45bc-b1ee-9a8ace9dd476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0448fb3c5bdc40179df8aafc42ea5b07'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:50.974913 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-57be032f-6b65-45bc-b1ee-9a8ace9dd476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0448fb3c5bdc40179df8aafc42ea5b07'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:50.978966 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-5a79351d-eb6e-4244-a3f2-2374d4dcf0a0 None None] MFA Rules not processed for user `0c6ffd0e078344aebf02c3463d8c4bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:50.980271 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-5a79351d-eb6e-4244-a3f2-2374d4dcf0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:50.980850 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 955/1926] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:37:50 2021] DELETE /identity/v3/users/0448fb3c5bdc40179df8aafc42ea5b07 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:37:50.985468 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866b3ce-de65-4649-83d5-cb1cacdf4b1b None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:50.985761 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866b3ce-de65-4649-83d5-cb1cacdf4b1b None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:50.986037 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866b3ce-de65-4649-83d5-cb1cacdf4b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:51.002666 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-7866b3ce-de65-4649-83d5-cb1cacdf4b1b None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:51.004187 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-7866b3ce-de65-4649-83d5-cb1cacdf4b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:51.048671 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 972/1927] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:50 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:37:51.053130 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79351d-eb6e-4244-a3f2-2374d4dcf0a0 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:51.054551 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-5a79351d-eb6e-4244-a3f2-2374d4dcf0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:51.062663 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 956/1928] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:37:51.073938 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866b3ce-de65-4649-83d5-cb1cacdf4b1b None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:51.075344 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-7866b3ce-de65-4649-83d5-cb1cacdf4b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:51.127229 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79351d-eb6e-4244-a3f2-2374d4dcf0a0 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:51.132401 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5648d-8a2f-4d9f-8940-e3184b47ee10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:51.133070 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5648d-8a2f-4d9f-8940-e3184b47ee10 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:51.133352 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5648d-8a2f-4d9f-8940-e3184b47ee10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:51.133626 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5648d-8a2f-4d9f-8940-e3184b47ee10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:51.134338 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5648d-8a2f-4d9f-8940-e3184b47ee10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:51.135787 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866b3ce-de65-4649-83d5-cb1cacdf4b1b None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:51.136336 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5648d-8a2f-4d9f-8940-e3184b47ee10 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:51.139582 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8215c7-333e-4293-8725-22b044e17ab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:51.140235 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8215c7-333e-4293-8725-22b044e17ab6 service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:51.140515 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8215c7-333e-4293-8725-22b044e17ab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:51.140826 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8215c7-333e-4293-8725-22b044e17ab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:51.149975 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8215c7-333e-4293-8725-22b044e17ab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:51.151431 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8215c7-333e-4293-8725-22b044e17ab6 service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:51.162344 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 957/1929] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:37:51.166037 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 973/1930] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:51 2021] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:37:51.170381 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8215c7-333e-4293-8725-22b044e17ab6 service neutron] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:51.180048 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8215c7-333e-4293-8725-22b044e17ab6 service neutron] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:51.248024 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db9e1e-137d-4942-a8b3-7df1b7d07fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:51.248843 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db9e1e-137d-4942-a8b3-7df1b7d07fce admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:51.249497 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db9e1e-137d-4942-a8b3-7df1b7d07fce admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:51.249497 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db9e1e-137d-4942-a8b3-7df1b7d07fce admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:51.250472 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db9e1e-137d-4942-a8b3-7df1b7d07fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:51.252563 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db9e1e-137d-4942-a8b3-7df1b7d07fce admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:51.276418 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 958/1931] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:51 2021] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:51.281410 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5648d-8a2f-4d9f-8940-e3184b47ee10 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:51.292504 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5648d-8a2f-4d9f-8940-e3184b47ee10 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:51.300345 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e494fb4-edd4-45ea-bf57-b6b330e6e6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:51.301126 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e494fb4-edd4-45ea-bf57-b6b330e6e6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:51.301460 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e494fb4-edd4-45ea-bf57-b6b330e6e6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:51.301798 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e494fb4-edd4-45ea-bf57-b6b330e6e6b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:51.302621 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e494fb4-edd4-45ea-bf57-b6b330e6e6b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:51.304679 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e494fb4-edd4-45ea-bf57-b6b330e6e6b3 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:51.318442 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 974/1932] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:51 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:51.322535 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db9e1e-137d-4942-a8b3-7df1b7d07fce admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:51.339926 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db9e1e-137d-4942-a8b3-7df1b7d07fce admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:51.346040 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce45ef3-0cce-47ad-a77f-9b4da7f22c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:51.347891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce45ef3-0cce-47ad-a77f-9b4da7f22c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:51.347891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce45ef3-0cce-47ad-a77f-9b4da7f22c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:51.348117 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce45ef3-0cce-47ad-a77f-9b4da7f22c2c admin admin] PATH_INFO: `/v3/projects/ab7c344ba86a4f19ba2d8163d50f23f5/users/2447f6ddd6be4a3888042c78e94bd0b4/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:51.365290 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce45ef3-0cce-47ad-a77f-9b4da7f22c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7c344ba86a4f19ba2d8163d50f23f5, user_id=2447f6ddd6be4a3888042c78e94bd0b4, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:51.368398 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce45ef3-0cce-47ad-a77f-9b4da7f22c2c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:51.390763 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 959/1933] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:51 2021] PUT /identity/v3/projects/ab7c344ba86a4f19ba2d8163d50f23f5/users/2447f6ddd6be4a3888042c78e94bd0b4/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:51.395636 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e494fb4-edd4-45ea-bf57-b6b330e6e6b3 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:51.410515 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e494fb4-edd4-45ea-bf57-b6b330e6e6b3 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:51.477855 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce45ef3-0cce-47ad-a77f-9b4da7f22c2c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:51.481078 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-5ce45ef3-0cce-47ad-a77f-9b4da7f22c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:51.486650 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f1910-b18a-4f74-9ede-ce6b18a52860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:51.487550 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f1910-b18a-4f74-9ede-ce6b18a52860 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:51.487762 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f1910-b18a-4f74-9ede-ce6b18a52860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:51.488040 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f1910-b18a-4f74-9ede-ce6b18a52860 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:51.489252 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f1910-b18a-4f74-9ede-ce6b18a52860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:51.497300 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce45ef3-0cce-47ad-a77f-9b4da7f22c2c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:51.500294 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f1910-b18a-4f74-9ede-ce6b18a52860 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:51.502646 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c5b09-6bd7-4efa-8466-c9ec35a06af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:51.503546 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c5b09-6bd7-4efa-8466-c9ec35a06af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:51.503817 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c5b09-6bd7-4efa-8466-c9ec35a06af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:51.504084 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c5b09-6bd7-4efa-8466-c9ec35a06af1 admin admin] PATH_INFO: `/v3/projects/2c2a9f7a2bd94a6c93c82d1e0e0954ae` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:51.505831 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c5b09-6bd7-4efa-8466-c9ec35a06af1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c2a9f7a2bd94a6c93c82d1e0e0954ae)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:51.507775 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c5b09-6bd7-4efa-8466-c9ec35a06af1 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:51.516831 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 975/1934] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:51 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:51.518876 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f1910-b18a-4f74-9ede-ce6b18a52860 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:51.531472 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f1910-b18a-4f74-9ede-ce6b18a52860 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:51.537345 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2e07a-7e64-4106-8afc-309c10a59db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:51.538364 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2e07a-7e64-4106-8afc-309c10a59db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:51.538766 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2e07a-7e64-4106-8afc-309c10a59db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:51.539047 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2e07a-7e64-4106-8afc-309c10a59db7 admin admin] PATH_INFO: `/v3/projects/ab7c344ba86a4f19ba2d8163d50f23f5/users/2447f6ddd6be4a3888042c78e94bd0b4/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:51.541769 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2e07a-7e64-4106-8afc-309c10a59db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7c344ba86a4f19ba2d8163d50f23f5, user_id=2447f6ddd6be4a3888042c78e94bd0b4, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:51.544619 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2e07a-7e64-4106-8afc-309c10a59db7 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:51.556816 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 976/1935] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:51 2021] PUT /identity/v3/projects/ab7c344ba86a4f19ba2d8163d50f23f5/users/2447f6ddd6be4a3888042c78e94bd0b4/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:51.560185 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-214c5b09-6bd7-4efa-8466-c9ec35a06af1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c2a9f7a2bd94a6c93c82d1e0e0954ae', 'request_id': 'req-214c5b09-6bd7-4efa-8466-c9ec35a06af1'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:51.567754 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-214c5b09-6bd7-4efa-8466-c9ec35a06af1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c2a9f7a2bd94a6c93c82d1e0e0954ae', 'request_id': 'req-214c5b09-6bd7-4efa-8466-c9ec35a06af1'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:51.568861 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b22330-45b9-44e5-af4c-ba3800ffbb6e None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:51.569242 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b22330-45b9-44e5-af4c-ba3800ffbb6e None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:51.569850 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b22330-45b9-44e5-af4c-ba3800ffbb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:51.576427 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-214c5b09-6bd7-4efa-8466-c9ec35a06af1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c2a9f7a2bd94a6c93c82d1e0e0954ae', 'request_id': 'req-214c5b09-6bd7-4efa-8466-c9ec35a06af1'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:51.587684 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-214c5b09-6bd7-4efa-8466-c9ec35a06af1 admin admin] The token cache is being invalidate because project 2c2a9f7a2bd94a6c93c82d1e0e0954ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:37:51.587970 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-214c5b09-6bd7-4efa-8466-c9ec35a06af1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:51.588745 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-214c5b09-6bd7-4efa-8466-c9ec35a06af1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:51.590812 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 960/1936] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:37:51 2021] DELETE /identity/v3/projects/2c2a9f7a2bd94a6c93c82d1e0e0954ae => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:37:51.595545 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c5b09-6bd7-4efa-8466-c9ec35a06af1 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:51.597972 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-214c5b09-6bd7-4efa-8466-c9ec35a06af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:51.598609 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-99b22330-45b9-44e5-af4c-ba3800ffbb6e None None] MFA Rules not processed for user `2447f6ddd6be4a3888042c78e94bd0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:51.600492 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-99b22330-45b9-44e5-af4c-ba3800ffbb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:51.669356 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c5b09-6bd7-4efa-8466-c9ec35a06af1 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:51.708360 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 977/1937] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:51 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:37:51.719183 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b22330-45b9-44e5-af4c-ba3800ffbb6e None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:51.720717 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-99b22330-45b9-44e5-af4c-ba3800ffbb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:51.729531 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e3686-045b-4eb0-a6da-507f7da1fc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:51.730424 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e3686-045b-4eb0-a6da-507f7da1fc28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:51.730790 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e3686-045b-4eb0-a6da-507f7da1fc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:51.731070 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e3686-045b-4eb0-a6da-507f7da1fc28 admin admin] PATH_INFO: `/v3/users/66009f0d0f8540a593bb4b15d3da1be5` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:51.732627 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e3686-045b-4eb0-a6da-507f7da1fc28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66009f0d0f8540a593bb4b15d3da1be5)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:51.734643 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e3686-045b-4eb0-a6da-507f7da1fc28 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:51.780840 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b22330-45b9-44e5-af4c-ba3800ffbb6e None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:51.781045 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-3c5e3686-045b-4eb0-a6da-507f7da1fc28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66009f0d0f8540a593bb4b15d3da1be5'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:51.781837 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-3c5e3686-045b-4eb0-a6da-507f7da1fc28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66009f0d0f8540a593bb4b15d3da1be5'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:51.785391 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86297ae-bfec-4bc8-a81a-795a1040090b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:51.786082 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86297ae-bfec-4bc8-a81a-795a1040090b service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:51.786535 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86297ae-bfec-4bc8-a81a-795a1040090b service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:51.786724 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86297ae-bfec-4bc8-a81a-795a1040090b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:51.789109 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-b86297ae-bfec-4bc8-a81a-795a1040090b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:51.794359 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-3c5e3686-045b-4eb0-a6da-507f7da1fc28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66009f0d0f8540a593bb4b15d3da1be5'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:51.802546 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-3c5e3686-045b-4eb0-a6da-507f7da1fc28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66009f0d0f8540a593bb4b15d3da1be5'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:51.816854 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-3c5e3686-045b-4eb0-a6da-507f7da1fc28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66009f0d0f8540a593bb4b15d3da1be5'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:51.823295 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 961/1938] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:37:51 2021] DELETE /identity/v3/users/66009f0d0f8540a593bb4b15d3da1be5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:51.859704 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86297ae-bfec-4bc8-a81a-795a1040090b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:51.861177 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86297ae-bfec-4bc8-a81a-795a1040090b service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:51.871547 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 978/1939] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:51 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:37:52.151925 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e3686-045b-4eb0-a6da-507f7da1fc28 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:52.153874 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-3c5e3686-045b-4eb0-a6da-507f7da1fc28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:52.243091 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e3686-045b-4eb0-a6da-507f7da1fc28 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:52.248090 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cbc99-9714-4158-85d9-e59606c1cf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:52.249140 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cbc99-9714-4158-85d9-e59606c1cf26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:52.249499 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cbc99-9714-4158-85d9-e59606c1cf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:52.249779 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cbc99-9714-4158-85d9-e59606c1cf26 admin admin] PATH_INFO: `/v3/projects/78060810f66a4973a3c8d4b4651b3829` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:52.251123 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cbc99-9714-4158-85d9-e59606c1cf26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78060810f66a4973a3c8d4b4651b3829)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:52.253047 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cbc99-9714-4158-85d9-e59606c1cf26 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:52.298151 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-496cbc99-9714-4158-85d9-e59606c1cf26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78060810f66a4973a3c8d4b4651b3829', 'request_id': 'req-496cbc99-9714-4158-85d9-e59606c1cf26'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:52.304959 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-496cbc99-9714-4158-85d9-e59606c1cf26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78060810f66a4973a3c8d4b4651b3829', 'request_id': 'req-496cbc99-9714-4158-85d9-e59606c1cf26'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:52.313890 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-496cbc99-9714-4158-85d9-e59606c1cf26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78060810f66a4973a3c8d4b4651b3829', 'request_id': 'req-496cbc99-9714-4158-85d9-e59606c1cf26'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:52.325038 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-496cbc99-9714-4158-85d9-e59606c1cf26 admin admin] The token cache is being invalidate because project 78060810f66a4973a3c8d4b4651b3829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:37:52.325322 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-496cbc99-9714-4158-85d9-e59606c1cf26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:52.325963 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-496cbc99-9714-4158-85d9-e59606c1cf26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:37:52.327635 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 962/1940] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:37:52 2021] DELETE /identity/v3/projects/78060810f66a4973a3c8d4b4651b3829 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:37:52.333721 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa3f4a-e3d4-4733-866f-5f1dfedd5c8e None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:52.334206 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa3f4a-e3d4-4733-866f-5f1dfedd5c8e None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:52.334442 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa3f4a-e3d4-4733-866f-5f1dfedd5c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:52.352683 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-66aa3f4a-e3d4-4733-866f-5f1dfedd5c8e None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:52.353906 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-66aa3f4a-e3d4-4733-866f-5f1dfedd5c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:52.415000 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 979/1941] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:52.423314 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f5250-59e2-41f9-aaa5-65ba0d69fa3f None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:52.423610 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f5250-59e2-41f9-aaa5-65ba0d69fa3f None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:52.423891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f5250-59e2-41f9-aaa5-65ba0d69fa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:52.445434 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-ca1f5250-59e2-41f9-aaa5-65ba0d69fa3f None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:52.446652 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-ca1f5250-59e2-41f9-aaa5-65ba0d69fa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:52.455348 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 963/1942] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:52.459747 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa3f4a-e3d4-4733-866f-5f1dfedd5c8e None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:52.471083 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa3f4a-e3d4-4733-866f-5f1dfedd5c8e None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:52.476262 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5fd3d-9233-40ca-8f3c-bb721006d596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:52.476940 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5fd3d-9233-40ca-8f3c-bb721006d596 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:52.477216 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5fd3d-9233-40ca-8f3c-bb721006d596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:52.477525 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5fd3d-9233-40ca-8f3c-bb721006d596 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:52.478261 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5fd3d-9233-40ca-8f3c-bb721006d596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:37:52.478565 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5fd3d-9233-40ca-8f3c-bb721006d596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:52.480301 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5fd3d-9233-40ca-8f3c-bb721006d596 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:52.492611 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 980/1943] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:37:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:37:52.497152 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f5250-59e2-41f9-aaa5-65ba0d69fa3f None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:52.506568 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f5250-59e2-41f9-aaa5-65ba0d69fa3f None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:52.511896 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7a68b-6ec9-4020-8cbf-95948246daa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:52.512699 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7a68b-6ec9-4020-8cbf-95948246daa2 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:52.513058 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7a68b-6ec9-4020-8cbf-95948246daa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:52.513397 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7a68b-6ec9-4020-8cbf-95948246daa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:52.514187 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7a68b-6ec9-4020-8cbf-95948246daa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:52.516204 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7a68b-6ec9-4020-8cbf-95948246daa2 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:52.545952 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 964/1944] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:37:52 2021] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:37:52.547481 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5fd3d-9233-40ca-8f3c-bb721006d596 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:52.560761 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5fd3d-9233-40ca-8f3c-bb721006d596 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:52.616305 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd224f-12d5-4ec6-aeac-0f56a98adbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:52.616981 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd224f-12d5-4ec6-aeac-0f56a98adbed admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:52.617256 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd224f-12d5-4ec6-aeac-0f56a98adbed admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:52.617526 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd224f-12d5-4ec6-aeac-0f56a98adbed admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:52.618256 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd224f-12d5-4ec6-aeac-0f56a98adbed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:52.620191 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd224f-12d5-4ec6-aeac-0f56a98adbed admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:52.639424 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 981/1945] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:37:52 2021] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:37:52.643896 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7a68b-6ec9-4020-8cbf-95948246daa2 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:52.655524 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7a68b-6ec9-4020-8cbf-95948246daa2 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:52.660486 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c0d05-7c0c-4d73-8d1c-05933b981c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:52.661156 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c0d05-7c0c-4d73-8d1c-05933b981c7e admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:52.661431 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c0d05-7c0c-4d73-8d1c-05933b981c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:52.661701 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c0d05-7c0c-4d73-8d1c-05933b981c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:52.662444 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c0d05-7c0c-4d73-8d1c-05933b981c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:52.664365 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c0d05-7c0c-4d73-8d1c-05933b981c7e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:52.675555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 965/1946] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:52 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:37:52.679627 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd224f-12d5-4ec6-aeac-0f56a98adbed admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:52.690125 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd224f-12d5-4ec6-aeac-0f56a98adbed admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:52.695149 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b0089-ce4c-4401-85b2-50bd9af322d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:52.695825 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b0089-ce4c-4401-85b2-50bd9af322d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:52.696106 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b0089-ce4c-4401-85b2-50bd9af322d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:52.696378 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b0089-ce4c-4401-85b2-50bd9af322d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:52.697116 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b0089-ce4c-4401-85b2-50bd9af322d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:52.698907 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b0089-ce4c-4401-85b2-50bd9af322d2 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:52.709133 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 982/1947] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:37:52 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:37:52.713530 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c0d05-7c0c-4d73-8d1c-05933b981c7e admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:52.723833 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c0d05-7c0c-4d73-8d1c-05933b981c7e admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:52.728923 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f81af-00b0-429c-9312-ca472c586a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:52.729823 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f81af-00b0-429c-9312-ca472c586a40 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:52.730102 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f81af-00b0-429c-9312-ca472c586a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:52.730503 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f81af-00b0-429c-9312-ca472c586a40 admin admin] PATH_INFO: `/v3/projects/279585a96b7d4a9eac81fc7d5c7a3f9c/users/d6404892865144b8af5838fb200b3def/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:52.749076 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f81af-00b0-429c-9312-ca472c586a40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=279585a96b7d4a9eac81fc7d5c7a3f9c, user_id=d6404892865144b8af5838fb200b3def, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:52.751988 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f81af-00b0-429c-9312-ca472c586a40 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:52.768285 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 966/1948] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:37:52 2021] PUT /identity/v3/projects/279585a96b7d4a9eac81fc7d5c7a3f9c/users/d6404892865144b8af5838fb200b3def/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:37:52.779730 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6825b-a522-4c42-a9a5-1e1a4f0c66f0 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:52.780126 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6825b-a522-4c42-a9a5-1e1a4f0c66f0 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:52.780401 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6825b-a522-4c42-a9a5-1e1a4f0c66f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:52.807588 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-eeb6825b-a522-4c42-a9a5-1e1a4f0c66f0 None None] MFA Rules not processed for user `d6404892865144b8af5838fb200b3def`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:52.808863 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-eeb6825b-a522-4c42-a9a5-1e1a4f0c66f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:52.874136 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 983/1949] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:52 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:52.884135 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f81af-00b0-429c-9312-ca472c586a40 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:52.885995 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-ea4f81af-00b0-429c-9312-ca472c586a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:52.942699 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f81af-00b0-429c-9312-ca472c586a40 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:52.946607 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6c51f-dc12-4bbb-92b3-95385be6473b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:52.947278 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6c51f-dc12-4bbb-92b3-95385be6473b service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:52.947556 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6c51f-dc12-4bbb-92b3-95385be6473b service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:52.947832 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6c51f-dc12-4bbb-92b3-95385be6473b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:52.958842 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6c51f-dc12-4bbb-92b3-95385be6473b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:52.960278 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6c51f-dc12-4bbb-92b3-95385be6473b service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:52.969894 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 967/1950] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:52 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:37:56.666393 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa43e7-eb34-4125-8264-b65dcb393be6 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:56.667399 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa43e7-eb34-4125-8264-b65dcb393be6 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:56.667675 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa43e7-eb34-4125-8264-b65dcb393be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:56.685859 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-17fa43e7-eb34-4125-8264-b65dcb393be6 None None] MFA Rules not processed for user `478109e21b1a4f3cb9690aed2d967faa`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:37:56.687134 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-17fa43e7-eb34-4125-8264-b65dcb393be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:56.740884 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 984/1951] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:37:56 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:37:57.680225 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6c51f-dc12-4bbb-92b3-95385be6473b service cinder] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:37:57.681882 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-7bf6c51f-dc12-4bbb-92b3-95385be6473b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:57.695869 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6c51f-dc12-4bbb-92b3-95385be6473b service cinder] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:37:57.702068 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faea604-0c02-4b76-88e5-24c3304f5e5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:37:57.702910 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faea604-0c02-4b76-88e5-24c3304f5e5e service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:37:57.703127 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faea604-0c02-4b76-88e5-24c3304f5e5e service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:37:57.703408 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faea604-0c02-4b76-88e5-24c3304f5e5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:37:57.705407 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-5faea604-0c02-4b76-88e5-24c3304f5e5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:37:57.775373 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faea604-0c02-4b76-88e5-24c3304f5e5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:37:57.776842 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faea604-0c02-4b76-88e5-24c3304f5e5e service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:37:57.785501 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 968/1952] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:37:57 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:38:00.478053 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa43e7-eb34-4125-8264-b65dcb393be6 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:00.488527 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa43e7-eb34-4125-8264-b65dcb393be6 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:00.493906 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3864e-8103-42d6-a893-c8ad1babfa8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:00.494624 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3864e-8103-42d6-a893-c8ad1babfa8c service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:00.495031 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3864e-8103-42d6-a893-c8ad1babfa8c service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:00.495383 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3864e-8103-42d6-a893-c8ad1babfa8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:00.497481 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a2e3864e-8103-42d6-a893-c8ad1babfa8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:00.566318 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3864e-8103-42d6-a893-c8ad1babfa8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:00.567860 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3864e-8103-42d6-a893-c8ad1babfa8c service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:00.577596 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 985/1953] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:00 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:38:07.697204 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faea604-0c02-4b76-88e5-24c3304f5e5e service cinder] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:07.763547 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faea604-0c02-4b76-88e5-24c3304f5e5e service cinder] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:07.771531 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d84ac-cb47-4239-8a68-a81f884e5094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:07.771531 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d84ac-cb47-4239-8a68-a81f884e5094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:07.771531 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d84ac-cb47-4239-8a68-a81f884e5094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:07.771531 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d84ac-cb47-4239-8a68-a81f884e5094 admin admin] PATH_INFO: `/v3/users/d6404892865144b8af5838fb200b3def` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:07.772498 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d84ac-cb47-4239-8a68-a81f884e5094 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6404892865144b8af5838fb200b3def)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:07.774729 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d84ac-cb47-4239-8a68-a81f884e5094 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:07.840564 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-b36d84ac-cb47-4239-8a68-a81f884e5094 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6404892865144b8af5838fb200b3def'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:07.841445 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-b36d84ac-cb47-4239-8a68-a81f884e5094 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6404892865144b8af5838fb200b3def'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:07.854987 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-b36d84ac-cb47-4239-8a68-a81f884e5094 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6404892865144b8af5838fb200b3def'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:07.865900 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-b36d84ac-cb47-4239-8a68-a81f884e5094 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6404892865144b8af5838fb200b3def'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:07.888253 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-b36d84ac-cb47-4239-8a68-a81f884e5094 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6404892865144b8af5838fb200b3def'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:07.900765 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 969/1954] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:38:07 2021] DELETE /identity/v3/users/d6404892865144b8af5838fb200b3def => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:07.902558 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570518d-b9f4-40b1-bf1b-a91b2d64068a None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:07.903034 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570518d-b9f4-40b1-bf1b-a91b2d64068a None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:07.903111 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570518d-b9f4-40b1-bf1b-a91b2d64068a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:07.921362 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-0570518d-b9f4-40b1-bf1b-a91b2d64068a None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:07.923004 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-0570518d-b9f4-40b1-bf1b-a91b2d64068a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:07.999558 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 986/1955] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:08.010955 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d84ac-cb47-4239-8a68-a81f884e5094 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:08.012516 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-b36d84ac-cb47-4239-8a68-a81f884e5094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:08.103414 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d84ac-cb47-4239-8a68-a81f884e5094 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:08.107281 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92595e8-223e-471c-ac92-8cf2cabe5e1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:08.108092 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92595e8-223e-471c-ac92-8cf2cabe5e1f service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:08.108450 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92595e8-223e-471c-ac92-8cf2cabe5e1f service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:08.109252 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92595e8-223e-471c-ac92-8cf2cabe5e1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:08.121620 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92595e8-223e-471c-ac92-8cf2cabe5e1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:08.123502 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92595e8-223e-471c-ac92-8cf2cabe5e1f service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:08.134024 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 970/1956] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:38:08.432565 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570518d-b9f4-40b1-bf1b-a91b2d64068a None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:08.434957 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-0570518d-b9f4-40b1-bf1b-a91b2d64068a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:08.451200 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570518d-b9f4-40b1-bf1b-a91b2d64068a None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:08.456129 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb54f9-548c-45f6-a78d-3e3ef6aad72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:08.457015 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb54f9-548c-45f6-a78d-3e3ef6aad72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:08.457288 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb54f9-548c-45f6-a78d-3e3ef6aad72f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:08.457552 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb54f9-548c-45f6-a78d-3e3ef6aad72f admin admin] PATH_INFO: `/v3/projects/279585a96b7d4a9eac81fc7d5c7a3f9c` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:08.459340 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb54f9-548c-45f6-a78d-3e3ef6aad72f admin admin] RBAC: Authorizing `identity:delete_project(project_id=279585a96b7d4a9eac81fc7d5c7a3f9c)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:08.461460 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb54f9-548c-45f6-a78d-3e3ef6aad72f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:08.509657 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a4cb54f9-548c-45f6-a78d-3e3ef6aad72f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '279585a96b7d4a9eac81fc7d5c7a3f9c', 'request_id': 'req-a4cb54f9-548c-45f6-a78d-3e3ef6aad72f'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:08.515944 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a4cb54f9-548c-45f6-a78d-3e3ef6aad72f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '279585a96b7d4a9eac81fc7d5c7a3f9c', 'request_id': 'req-a4cb54f9-548c-45f6-a78d-3e3ef6aad72f'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:08.524217 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a4cb54f9-548c-45f6-a78d-3e3ef6aad72f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '279585a96b7d4a9eac81fc7d5c7a3f9c', 'request_id': 'req-a4cb54f9-548c-45f6-a78d-3e3ef6aad72f'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:08.534600 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a4cb54f9-548c-45f6-a78d-3e3ef6aad72f admin admin] The token cache is being invalidate because project 279585a96b7d4a9eac81fc7d5c7a3f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:38:08.534918 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a4cb54f9-548c-45f6-a78d-3e3ef6aad72f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:08.535548 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a4cb54f9-548c-45f6-a78d-3e3ef6aad72f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:08.537194 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 987/1957] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:38:08 2021] DELETE /identity/v3/projects/279585a96b7d4a9eac81fc7d5c7a3f9c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:08.544095 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c946e3-22df-49e0-9f1b-181084693500 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:08.544218 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c946e3-22df-49e0-9f1b-181084693500 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:08.544610 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c946e3-22df-49e0-9f1b-181084693500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:08.563932 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-20c946e3-22df-49e0-9f1b-181084693500 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:08.565215 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-20c946e3-22df-49e0-9f1b-181084693500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:08.624777 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 971/1958] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:38:08.632937 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03de69-be63-434c-9a67-492e8dd2dd7e None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:08.633225 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03de69-be63-434c-9a67-492e8dd2dd7e None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:08.633534 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03de69-be63-434c-9a67-492e8dd2dd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:08.655347 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-0c03de69-be63-434c-9a67-492e8dd2dd7e None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:08.656546 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-0c03de69-be63-434c-9a67-492e8dd2dd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:08.665291 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 988/1959] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:08.670166 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c946e3-22df-49e0-9f1b-181084693500 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:08.680513 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c946e3-22df-49e0-9f1b-181084693500 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:08.685761 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd74a2-1ef8-4277-85ec-d49bd6458bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:08.686432 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd74a2-1ef8-4277-85ec-d49bd6458bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:08.686739 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd74a2-1ef8-4277-85ec-d49bd6458bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:08.687010 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd74a2-1ef8-4277-85ec-d49bd6458bf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:08.687781 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd74a2-1ef8-4277-85ec-d49bd6458bf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:38:08.688200 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd74a2-1ef8-4277-85ec-d49bd6458bf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:08.689864 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd74a2-1ef8-4277-85ec-d49bd6458bf0 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:08.702002 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 972/1960] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:38:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:38:08.706569 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03de69-be63-434c-9a67-492e8dd2dd7e None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:08.715704 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03de69-be63-434c-9a67-492e8dd2dd7e None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:08.720477 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d2063-53bc-4958-ab29-3985cc356a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:08.721128 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d2063-53bc-4958-ab29-3985cc356a58 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:08.721406 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d2063-53bc-4958-ab29-3985cc356a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:08.721677 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d2063-53bc-4958-ab29-3985cc356a58 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:08.722384 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d2063-53bc-4958-ab29-3985cc356a58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:08.724300 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d2063-53bc-4958-ab29-3985cc356a58 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:08.751682 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 989/1961] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:38:08 2021] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:38:08.755762 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd74a2-1ef8-4277-85ec-d49bd6458bf0 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:08.765502 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd74a2-1ef8-4277-85ec-d49bd6458bf0 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:08.823499 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ab127-236e-42d6-bd83-0848c7e643df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:08.824304 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ab127-236e-42d6-bd83-0848c7e643df admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:08.824669 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ab127-236e-42d6-bd83-0848c7e643df admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:08.825021 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ab127-236e-42d6-bd83-0848c7e643df admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:08.826031 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ab127-236e-42d6-bd83-0848c7e643df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:08.828941 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ab127-236e-42d6-bd83-0848c7e643df admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:08.853119 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 973/1962] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:38:08 2021] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:38:08.854356 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d2063-53bc-4958-ab29-3985cc356a58 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:08.864545 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d2063-53bc-4958-ab29-3985cc356a58 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:08.869822 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940421a7-a6ba-4e18-ba8a-5d7275150bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:08.870501 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940421a7-a6ba-4e18-ba8a-5d7275150bbc admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:08.870810 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940421a7-a6ba-4e18-ba8a-5d7275150bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:08.871085 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940421a7-a6ba-4e18-ba8a-5d7275150bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:08.871832 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940421a7-a6ba-4e18-ba8a-5d7275150bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:08.873414 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940421a7-a6ba-4e18-ba8a-5d7275150bbc admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:08.884137 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 990/1963] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:08.888301 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ab127-236e-42d6-bd83-0848c7e643df admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:08.899032 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ab127-236e-42d6-bd83-0848c7e643df admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:08.904181 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212c454-bc04-435f-8507-2b129fa60c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:08.904838 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212c454-bc04-435f-8507-2b129fa60c2a admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:08.905113 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212c454-bc04-435f-8507-2b129fa60c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:08.905384 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212c454-bc04-435f-8507-2b129fa60c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:08.906121 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212c454-bc04-435f-8507-2b129fa60c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:08.907796 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212c454-bc04-435f-8507-2b129fa60c2a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:08.918742 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 974/1964] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:08 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:08.923317 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940421a7-a6ba-4e18-ba8a-5d7275150bbc admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:08.933056 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940421a7-a6ba-4e18-ba8a-5d7275150bbc admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:08.938595 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8345af1-bea3-42e6-bf7b-55a73910cda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:08.939621 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345af1-bea3-42e6-bf7b-55a73910cda9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:08.939926 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345af1-bea3-42e6-bf7b-55a73910cda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:08.940220 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345af1-bea3-42e6-bf7b-55a73910cda9 admin admin] PATH_INFO: `/v3/projects/4f9a60c7cce345a68deab67ce0011a8f/users/8265fba8062d49578f57c61691ccf423/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:08.956190 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8345af1-bea3-42e6-bf7b-55a73910cda9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f9a60c7cce345a68deab67ce0011a8f, user_id=8265fba8062d49578f57c61691ccf423, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:08.958907 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8345af1-bea3-42e6-bf7b-55a73910cda9 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:08.974512 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 991/1965] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:38:08 2021] PUT /identity/v3/projects/4f9a60c7cce345a68deab67ce0011a8f/users/8265fba8062d49578f57c61691ccf423/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:08.986721 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4b6fc-c1b0-41c5-96fc-bf77334555c5 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:08.987023 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4b6fc-c1b0-41c5-96fc-bf77334555c5 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:08.987292 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4b6fc-c1b0-41c5-96fc-bf77334555c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:09.015779 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-27a4b6fc-c1b0-41c5-96fc-bf77334555c5 None None] MFA Rules not processed for user `8265fba8062d49578f57c61691ccf423`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:09.017116 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-27a4b6fc-c1b0-41c5-96fc-bf77334555c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:09.108485 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 975/1966] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:08 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:09.109979 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8345af1-bea3-42e6-bf7b-55a73910cda9 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:09.181399 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8345af1-bea3-42e6-bf7b-55a73910cda9 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:09.186222 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959a915-0ec5-4dd6-a525-dfc236fed7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:09.186935 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959a915-0ec5-4dd6-a525-dfc236fed7d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:09.187216 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959a915-0ec5-4dd6-a525-dfc236fed7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:09.187491 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959a915-0ec5-4dd6-a525-dfc236fed7d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:09.188255 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959a915-0ec5-4dd6-a525-dfc236fed7d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:09.190194 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959a915-0ec5-4dd6-a525-dfc236fed7d4 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:09.222719 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 992/1967] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:38:09 2021] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:38:09.225269 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4b6fc-c1b0-41c5-96fc-bf77334555c5 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:09.237223 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4b6fc-c1b0-41c5-96fc-bf77334555c5 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:09.304715 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bea45-f016-4c78-bfc2-228f24ac541a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:09.305186 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bea45-f016-4c78-bfc2-228f24ac541a admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:09.305556 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bea45-f016-4c78-bfc2-228f24ac541a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:09.305985 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bea45-f016-4c78-bfc2-228f24ac541a admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:09.306670 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38bea45-f016-4c78-bfc2-228f24ac541a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:09.308746 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38bea45-f016-4c78-bfc2-228f24ac541a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:09.336981 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 976/1968] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:38:09 2021] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:38:09.340964 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959a915-0ec5-4dd6-a525-dfc236fed7d4 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:09.352153 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959a915-0ec5-4dd6-a525-dfc236fed7d4 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:09.359623 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf3d70-9f92-4bf7-aa35-3deb21ff75ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:09.361169 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf3d70-9f92-4bf7-aa35-3deb21ff75ab admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:09.361667 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf3d70-9f92-4bf7-aa35-3deb21ff75ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:09.362031 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf3d70-9f92-4bf7-aa35-3deb21ff75ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:09.362980 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf3d70-9f92-4bf7-aa35-3deb21ff75ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:09.364831 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf3d70-9f92-4bf7-aa35-3deb21ff75ab admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:09.380988 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 993/1969] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:09 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:38:09.383562 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bea45-f016-4c78-bfc2-228f24ac541a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:09.396508 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bea45-f016-4c78-bfc2-228f24ac541a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:09.402811 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e719a32-dc56-4577-ba15-0ca431ebe9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:09.403822 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e719a32-dc56-4577-ba15-0ca431ebe9c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:09.404172 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e719a32-dc56-4577-ba15-0ca431ebe9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:09.404504 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e719a32-dc56-4577-ba15-0ca431ebe9c3 admin admin] PATH_INFO: `/v3/projects/6e72ca59b69a4a558737df930e5d12e1/users/230f39dcc7a84d30b698d27b37832bd4/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:09.421511 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e719a32-dc56-4577-ba15-0ca431ebe9c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e72ca59b69a4a558737df930e5d12e1, user_id=230f39dcc7a84d30b698d27b37832bd4, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:09.424811 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e719a32-dc56-4577-ba15-0ca431ebe9c3 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:09.442416 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 977/1970] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:38:09 2021] PUT /identity/v3/projects/6e72ca59b69a4a558737df930e5d12e1/users/230f39dcc7a84d30b698d27b37832bd4/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:38:09.447254 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf3d70-9f92-4bf7-aa35-3deb21ff75ab admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:09.458940 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf3d70-9f92-4bf7-aa35-3deb21ff75ab admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:09.539222 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a52bd1-5239-4835-9656-43dca51c1d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:09.540017 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a52bd1-5239-4835-9656-43dca51c1d92 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:09.540363 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a52bd1-5239-4835-9656-43dca51c1d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:09.540720 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a52bd1-5239-4835-9656-43dca51c1d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:09.541533 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a52bd1-5239-4835-9656-43dca51c1d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:09.543477 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a52bd1-5239-4835-9656-43dca51c1d92 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:09.558271 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 994/1971] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:09 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:09.559607 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e719a32-dc56-4577-ba15-0ca431ebe9c3 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:09.570667 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e719a32-dc56-4577-ba15-0ca431ebe9c3 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:09.576264 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625dd19-a1cf-4234-9180-03af4e98c478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:09.577308 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625dd19-a1cf-4234-9180-03af4e98c478 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:09.577662 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625dd19-a1cf-4234-9180-03af4e98c478 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:09.578002 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625dd19-a1cf-4234-9180-03af4e98c478 admin admin] PATH_INFO: `/v3/projects/6e72ca59b69a4a558737df930e5d12e1/users/230f39dcc7a84d30b698d27b37832bd4/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:09.580297 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625dd19-a1cf-4234-9180-03af4e98c478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e72ca59b69a4a558737df930e5d12e1, user_id=230f39dcc7a84d30b698d27b37832bd4, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:09.583261 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625dd19-a1cf-4234-9180-03af4e98c478 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:09.595983 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 978/1972] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:38:09 2021] PUT /identity/v3/projects/6e72ca59b69a4a558737df930e5d12e1/users/230f39dcc7a84d30b698d27b37832bd4/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:09.606282 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188c40e-f70d-446f-ac7f-effa861a1777 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:09.606583 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188c40e-f70d-446f-ac7f-effa861a1777 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:09.606938 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188c40e-f70d-446f-ac7f-effa861a1777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:09.635212 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-1188c40e-f70d-446f-ac7f-effa861a1777 None None] MFA Rules not processed for user `230f39dcc7a84d30b698d27b37832bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:09.636517 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-1188c40e-f70d-446f-ac7f-effa861a1777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:09.708982 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 995/1973] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:09 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:38:09.711778 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625dd19-a1cf-4234-9180-03af4e98c478 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:09.713634 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-a625dd19-a1cf-4234-9180-03af4e98c478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:09.718510 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188c40e-f70d-446f-ac7f-effa861a1777 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:09.720086 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-1188c40e-f70d-446f-ac7f-effa861a1777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:09.779614 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625dd19-a1cf-4234-9180-03af4e98c478 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:09.780342 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188c40e-f70d-446f-ac7f-effa861a1777 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:09.784615 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b31f38-5381-4c40-b84a-535cf167f6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:09.785324 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ee0f5-220c-472f-9a94-d49b01f934c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:09.785718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b31f38-5381-4c40-b84a-535cf167f6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:09.785992 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b31f38-5381-4c40-b84a-535cf167f6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:09.786379 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b31f38-5381-4c40-b84a-535cf167f6ce admin admin] PATH_INFO: `/v3/users/0391a70326d0417a9a71b498921c63df` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:09.786715 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ee0f5-220c-472f-9a94-d49b01f934c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:09.787142 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ee0f5-220c-472f-9a94-d49b01f934c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:09.787498 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ee0f5-220c-472f-9a94-d49b01f934c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:09.788022 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b31f38-5381-4c40-b84a-535cf167f6ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=0391a70326d0417a9a71b498921c63df)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:09.790257 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b31f38-5381-4c40-b84a-535cf167f6ce admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:09.851636 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-b3b31f38-5381-4c40-b84a-535cf167f6ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0391a70326d0417a9a71b498921c63df'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:09.854867 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ee0f5-220c-472f-9a94-d49b01f934c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:09.855107 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-b3b31f38-5381-4c40-b84a-535cf167f6ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0391a70326d0417a9a71b498921c63df'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:09.855228 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ee0f5-220c-472f-9a94-d49b01f934c7 service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:09.860047 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-b3b31f38-5381-4c40-b84a-535cf167f6ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0391a70326d0417a9a71b498921c63df'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:09.863738 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 996/1974] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:09 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:38:09.867186 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-b3b31f38-5381-4c40-b84a-535cf167f6ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0391a70326d0417a9a71b498921c63df'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:09.881942 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-b3b31f38-5381-4c40-b84a-535cf167f6ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0391a70326d0417a9a71b498921c63df'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:09.887876 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 979/1975] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:38:09 2021] DELETE /identity/v3/users/0391a70326d0417a9a71b498921c63df => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:09.892507 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa2878-4dcb-4c61-a1f6-bd64065123f0 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:09.892800 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa2878-4dcb-4c61-a1f6-bd64065123f0 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:09.893071 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa2878-4dcb-4c61-a1f6-bd64065123f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:09.910862 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-12aa2878-4dcb-4c61-a1f6-bd64065123f0 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:09.912079 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-12aa2878-4dcb-4c61-a1f6-bd64065123f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:09.972177 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 997/1976] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:09.982838 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b31f38-5381-4c40-b84a-535cf167f6ce admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:09.984862 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-b3b31f38-5381-4c40-b84a-535cf167f6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:10.048681 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b31f38-5381-4c40-b84a-535cf167f6ce admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:10.056047 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941dc7a-77e9-4344-bd6c-a5e70e06525c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:10.056771 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941dc7a-77e9-4344-bd6c-a5e70e06525c service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:10.057052 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941dc7a-77e9-4344-bd6c-a5e70e06525c service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:10.057443 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941dc7a-77e9-4344-bd6c-a5e70e06525c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:10.067064 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941dc7a-77e9-4344-bd6c-a5e70e06525c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:10.068644 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941dc7a-77e9-4344-bd6c-a5e70e06525c service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:10.079102 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 980/1977] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:38:10.292257 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa2878-4dcb-4c61-a1f6-bd64065123f0 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:10.293705 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-12aa2878-4dcb-4c61-a1f6-bd64065123f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:10.306940 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa2878-4dcb-4c61-a1f6-bd64065123f0 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:10.311818 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a3528-0de6-4c58-b9c3-a9daa3a2c765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:10.312793 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a3528-0de6-4c58-b9c3-a9daa3a2c765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:10.313131 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a3528-0de6-4c58-b9c3-a9daa3a2c765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:10.313474 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a3528-0de6-4c58-b9c3-a9daa3a2c765 admin admin] PATH_INFO: `/v3/users/25c4865598954a6dbde13e5e447acdae` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:10.314969 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a3528-0de6-4c58-b9c3-a9daa3a2c765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25c4865598954a6dbde13e5e447acdae)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:10.317766 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a3528-0de6-4c58-b9c3-a9daa3a2c765 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:10.356868 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941dc7a-77e9-4344-bd6c-a5e70e06525c service neutron] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:10.358366 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-1941dc7a-77e9-4344-bd6c-a5e70e06525c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:10.369524 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-657a3528-0de6-4c58-b9c3-a9daa3a2c765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25c4865598954a6dbde13e5e447acdae'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:10.371990 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941dc7a-77e9-4344-bd6c-a5e70e06525c service neutron] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:10.377187 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cc9ce-ff87-4a8c-b1bd-6f1ac8ca683c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:10.378066 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cc9ce-ff87-4a8c-b1bd-6f1ac8ca683c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:10.378351 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cc9ce-ff87-4a8c-b1bd-6f1ac8ca683c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:10.378621 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cc9ce-ff87-4a8c-b1bd-6f1ac8ca683c admin admin] PATH_INFO: `/v3/projects/ce48d1c7b4a74bbaadc82d6769764e5b` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:10.379857 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0cc9ce-ff87-4a8c-b1bd-6f1ac8ca683c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce48d1c7b4a74bbaadc82d6769764e5b)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:10.381794 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0cc9ce-ff87-4a8c-b1bd-6f1ac8ca683c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:10.382515 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-657a3528-0de6-4c58-b9c3-a9daa3a2c765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25c4865598954a6dbde13e5e447acdae'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:10.383224 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-657a3528-0de6-4c58-b9c3-a9daa3a2c765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25c4865598954a6dbde13e5e447acdae'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:10.396311 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-657a3528-0de6-4c58-b9c3-a9daa3a2c765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25c4865598954a6dbde13e5e447acdae'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:10.403299 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-657a3528-0de6-4c58-b9c3-a9daa3a2c765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25c4865598954a6dbde13e5e447acdae'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:10.409603 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 998/1978] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:38:10 2021] DELETE /identity/v3/users/25c4865598954a6dbde13e5e447acdae => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:10.414081 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19327c-eb7c-4e7f-b3be-6ea534b0aa7d None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:10.414369 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19327c-eb7c-4e7f-b3be-6ea534b0aa7d None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:10.414669 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19327c-eb7c-4e7f-b3be-6ea534b0aa7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:10.431322 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-5c0cc9ce-ff87-4a8c-b1bd-6f1ac8ca683c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce48d1c7b4a74bbaadc82d6769764e5b', 'request_id': 'req-5c0cc9ce-ff87-4a8c-b1bd-6f1ac8ca683c'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:10.431629 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-ef19327c-eb7c-4e7f-b3be-6ea534b0aa7d None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:10.432878 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-ef19327c-eb7c-4e7f-b3be-6ea534b0aa7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:10.438231 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-5c0cc9ce-ff87-4a8c-b1bd-6f1ac8ca683c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce48d1c7b4a74bbaadc82d6769764e5b', 'request_id': 'req-5c0cc9ce-ff87-4a8c-b1bd-6f1ac8ca683c'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:10.447798 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-5c0cc9ce-ff87-4a8c-b1bd-6f1ac8ca683c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce48d1c7b4a74bbaadc82d6769764e5b', 'request_id': 'req-5c0cc9ce-ff87-4a8c-b1bd-6f1ac8ca683c'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:10.458326 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-5c0cc9ce-ff87-4a8c-b1bd-6f1ac8ca683c admin admin] The token cache is being invalidate because project ce48d1c7b4a74bbaadc82d6769764e5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:38:10.458609 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-5c0cc9ce-ff87-4a8c-b1bd-6f1ac8ca683c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:10.459260 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-5c0cc9ce-ff87-4a8c-b1bd-6f1ac8ca683c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:10.460829 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 981/1979] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:38:10 2021] DELETE /identity/v3/projects/ce48d1c7b4a74bbaadc82d6769764e5b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:10.464725 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cc9ce-ff87-4a8c-b1bd-6f1ac8ca683c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:10.466034 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-5c0cc9ce-ff87-4a8c-b1bd-6f1ac8ca683c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:10.492606 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 999/1980] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:38:10.502525 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19327c-eb7c-4e7f-b3be-6ea534b0aa7d None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:10.504297 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-ef19327c-eb7c-4e7f-b3be-6ea534b0aa7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:10.535230 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cc9ce-ff87-4a8c-b1bd-6f1ac8ca683c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:10.540165 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84e891-76d0-4540-ba20-f4577ab23e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:10.541238 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84e891-76d0-4540-ba20-f4577ab23e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:10.541520 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84e891-76d0-4540-ba20-f4577ab23e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:10.541779 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84e891-76d0-4540-ba20-f4577ab23e15 admin admin] PATH_INFO: `/v3/users/0c6ffd0e078344aebf02c3463d8c4bd4` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:10.545518 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84e891-76d0-4540-ba20-f4577ab23e15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c6ffd0e078344aebf02c3463d8c4bd4)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:10.545727 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84e891-76d0-4540-ba20-f4577ab23e15 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:10.568367 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19327c-eb7c-4e7f-b3be-6ea534b0aa7d None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:10.574936 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f132e6d-7369-4fce-a5e9-45dab0124d9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:10.575734 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f132e6d-7369-4fce-a5e9-45dab0124d9a service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:10.576110 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f132e6d-7369-4fce-a5e9-45dab0124d9a service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:10.576375 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f132e6d-7369-4fce-a5e9-45dab0124d9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:10.589259 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f132e6d-7369-4fce-a5e9-45dab0124d9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:10.590888 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f132e6d-7369-4fce-a5e9-45dab0124d9a service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:10.601262 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-5d84e891-76d0-4540-ba20-f4577ab23e15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c6ffd0e078344aebf02c3463d8c4bd4'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:10.601919 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-5d84e891-76d0-4540-ba20-f4577ab23e15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c6ffd0e078344aebf02c3463d8c4bd4'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:10.602535 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1000/1981] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:38:10.610997 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-5d84e891-76d0-4540-ba20-f4577ab23e15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c6ffd0e078344aebf02c3463d8c4bd4'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:10.618321 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-5d84e891-76d0-4540-ba20-f4577ab23e15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c6ffd0e078344aebf02c3463d8c4bd4'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:10.632420 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-5d84e891-76d0-4540-ba20-f4577ab23e15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c6ffd0e078344aebf02c3463d8c4bd4'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:10.639263 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 982/1982] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:38:10 2021] DELETE /identity/v3/users/0c6ffd0e078344aebf02c3463d8c4bd4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:38:10.985581 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f132e6d-7369-4fce-a5e9-45dab0124d9a service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:10.988244 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-1f132e6d-7369-4fce-a5e9-45dab0124d9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:11.007618 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f132e6d-7369-4fce-a5e9-45dab0124d9a service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:11.016926 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84e891-76d0-4540-ba20-f4577ab23e15 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:11.018576 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-5d84e891-76d0-4540-ba20-f4577ab23e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:11.073653 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7ba85-0ba6-4994-9d8f-e84e7f84ac54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:11.074612 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7ba85-0ba6-4994-9d8f-e84e7f84ac54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:11.074980 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7ba85-0ba6-4994-9d8f-e84e7f84ac54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:11.075254 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7ba85-0ba6-4994-9d8f-e84e7f84ac54 admin admin] PATH_INFO: `/v3/projects/26f4ba54aaf044b3badc3a12220df236` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:11.076448 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7ba85-0ba6-4994-9d8f-e84e7f84ac54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26f4ba54aaf044b3badc3a12220df236)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:11.078413 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7ba85-0ba6-4994-9d8f-e84e7f84ac54 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:11.090645 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84e891-76d0-4540-ba20-f4577ab23e15 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:11.095468 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d659a-68bd-43fa-96f3-0de68762476d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:11.096341 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d659a-68bd-43fa-96f3-0de68762476d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:11.096624 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d659a-68bd-43fa-96f3-0de68762476d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:11.096900 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d659a-68bd-43fa-96f3-0de68762476d admin admin] PATH_INFO: `/v3/projects/0a08b330700544508d32644dcf4a60a4` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:11.098103 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d659a-68bd-43fa-96f3-0de68762476d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a08b330700544508d32644dcf4a60a4)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:11.100052 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d659a-68bd-43fa-96f3-0de68762476d admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:11.129886 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c9d7ba85-0ba6-4994-9d8f-e84e7f84ac54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26f4ba54aaf044b3badc3a12220df236', 'request_id': 'req-c9d7ba85-0ba6-4994-9d8f-e84e7f84ac54'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:11.137398 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c9d7ba85-0ba6-4994-9d8f-e84e7f84ac54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26f4ba54aaf044b3badc3a12220df236', 'request_id': 'req-c9d7ba85-0ba6-4994-9d8f-e84e7f84ac54'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:11.145801 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c9d7ba85-0ba6-4994-9d8f-e84e7f84ac54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26f4ba54aaf044b3badc3a12220df236', 'request_id': 'req-c9d7ba85-0ba6-4994-9d8f-e84e7f84ac54'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:11.151046 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-436d659a-68bd-43fa-96f3-0de68762476d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a08b330700544508d32644dcf4a60a4', 'request_id': 'req-436d659a-68bd-43fa-96f3-0de68762476d'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:11.156429 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c9d7ba85-0ba6-4994-9d8f-e84e7f84ac54 admin admin] The token cache is being invalidate because project 26f4ba54aaf044b3badc3a12220df236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:38:11.156714 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c9d7ba85-0ba6-4994-9d8f-e84e7f84ac54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:11.157394 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-436d659a-68bd-43fa-96f3-0de68762476d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a08b330700544508d32644dcf4a60a4', 'request_id': 'req-436d659a-68bd-43fa-96f3-0de68762476d'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:11.157578 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c9d7ba85-0ba6-4994-9d8f-e84e7f84ac54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:11.159162 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1001/1983] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:38:10 2021] DELETE /identity/v3/projects/26f4ba54aaf044b3badc3a12220df236 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:11.163332 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7ba85-0ba6-4994-9d8f-e84e7f84ac54 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:11.165085 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-c9d7ba85-0ba6-4994-9d8f-e84e7f84ac54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:11.165416 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-436d659a-68bd-43fa-96f3-0de68762476d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a08b330700544508d32644dcf4a60a4', 'request_id': 'req-436d659a-68bd-43fa-96f3-0de68762476d'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:11.176926 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-436d659a-68bd-43fa-96f3-0de68762476d admin admin] The token cache is being invalidate because project 0a08b330700544508d32644dcf4a60a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:38:11.177216 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-436d659a-68bd-43fa-96f3-0de68762476d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:11.178191 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-436d659a-68bd-43fa-96f3-0de68762476d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:11.179872 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 983/1984] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:38:11 2021] DELETE /identity/v3/projects/0a08b330700544508d32644dcf4a60a4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:38:11.183689 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d659a-68bd-43fa-96f3-0de68762476d admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:11.185019 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-436d659a-68bd-43fa-96f3-0de68762476d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:11.232943 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7ba85-0ba6-4994-9d8f-e84e7f84ac54 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:11.249323 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d659a-68bd-43fa-96f3-0de68762476d admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:11.255904 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7348a6-aab3-43aa-832b-6ff0aef40951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:11.256811 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7348a6-aab3-43aa-832b-6ff0aef40951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:11.257092 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7348a6-aab3-43aa-832b-6ff0aef40951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:11.257488 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7348a6-aab3-43aa-832b-6ff0aef40951 admin admin] PATH_INFO: `/v3/users/2447f6ddd6be4a3888042c78e94bd0b4` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:11.259020 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7348a6-aab3-43aa-832b-6ff0aef40951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2447f6ddd6be4a3888042c78e94bd0b4)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:11.261196 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7348a6-aab3-43aa-832b-6ff0aef40951 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:11.302272 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5225c-2adf-425a-8078-5335aa78c4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:11.303244 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5225c-2adf-425a-8078-5335aa78c4f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:11.303643 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5225c-2adf-425a-8078-5335aa78c4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:11.303919 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5225c-2adf-425a-8078-5335aa78c4f0 admin admin] PATH_INFO: `/v3/users/bf8c8ce640194e41a18d38cff487f57f` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:11.305328 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5225c-2adf-425a-8078-5335aa78c4f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf8c8ce640194e41a18d38cff487f57f)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:11.307486 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5225c-2adf-425a-8078-5335aa78c4f0 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:11.310909 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-2f7348a6-aab3-43aa-832b-6ff0aef40951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2447f6ddd6be4a3888042c78e94bd0b4'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:11.311662 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-2f7348a6-aab3-43aa-832b-6ff0aef40951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2447f6ddd6be4a3888042c78e94bd0b4'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:11.321079 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-2f7348a6-aab3-43aa-832b-6ff0aef40951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2447f6ddd6be4a3888042c78e94bd0b4'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:11.329389 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-2f7348a6-aab3-43aa-832b-6ff0aef40951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2447f6ddd6be4a3888042c78e94bd0b4'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:11.343042 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-2f7348a6-aab3-43aa-832b-6ff0aef40951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2447f6ddd6be4a3888042c78e94bd0b4'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:11.350454 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 984/1985] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:38:11 2021] DELETE /identity/v3/users/2447f6ddd6be4a3888042c78e94bd0b4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:11.368825 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-cdf5225c-2adf-425a-8078-5335aa78c4f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf8c8ce640194e41a18d38cff487f57f'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:11.378898 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-cdf5225c-2adf-425a-8078-5335aa78c4f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf8c8ce640194e41a18d38cff487f57f'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:11.379568 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-cdf5225c-2adf-425a-8078-5335aa78c4f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf8c8ce640194e41a18d38cff487f57f'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:11.391889 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-cdf5225c-2adf-425a-8078-5335aa78c4f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf8c8ce640194e41a18d38cff487f57f'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:11.398934 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-cdf5225c-2adf-425a-8078-5335aa78c4f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf8c8ce640194e41a18d38cff487f57f'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:11.405176 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1002/1986] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:38:11 2021] DELETE /identity/v3/users/bf8c8ce640194e41a18d38cff487f57f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:11.692165 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7348a6-aab3-43aa-832b-6ff0aef40951 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:11.694122 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-2f7348a6-aab3-43aa-832b-6ff0aef40951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:11.784056 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7348a6-aab3-43aa-832b-6ff0aef40951 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:11.942668 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5225c-2adf-425a-8078-5335aa78c4f0 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:11.944148 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-cdf5225c-2adf-425a-8078-5335aa78c4f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:12.028137 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5225c-2adf-425a-8078-5335aa78c4f0 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:12.033695 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61adbe57-501f-4eaf-86fe-760776f42429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:12.034837 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adbe57-501f-4eaf-86fe-760776f42429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:12.035268 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adbe57-501f-4eaf-86fe-760776f42429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:12.035687 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adbe57-501f-4eaf-86fe-760776f42429 admin admin] PATH_INFO: `/v3/projects/ab7c344ba86a4f19ba2d8163d50f23f5` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:12.037076 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61adbe57-501f-4eaf-86fe-760776f42429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab7c344ba86a4f19ba2d8163d50f23f5)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:12.039225 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61adbe57-501f-4eaf-86fe-760776f42429 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:12.069031 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d165b-e127-43f5-991f-597076614779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:12.071311 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d165b-e127-43f5-991f-597076614779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:12.071666 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d165b-e127-43f5-991f-597076614779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:12.071968 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d165b-e127-43f5-991f-597076614779 admin admin] PATH_INFO: `/v3/projects/4cb1e74f16a942128b5c53c389dedd38` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:12.074719 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d165b-e127-43f5-991f-597076614779 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cb1e74f16a942128b5c53c389dedd38)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:12.076768 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d165b-e127-43f5-991f-597076614779 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:12.101896 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-61adbe57-501f-4eaf-86fe-760776f42429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab7c344ba86a4f19ba2d8163d50f23f5', 'request_id': 'req-61adbe57-501f-4eaf-86fe-760776f42429'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:12.109259 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-61adbe57-501f-4eaf-86fe-760776f42429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab7c344ba86a4f19ba2d8163d50f23f5', 'request_id': 'req-61adbe57-501f-4eaf-86fe-760776f42429'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:12.118723 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-61adbe57-501f-4eaf-86fe-760776f42429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab7c344ba86a4f19ba2d8163d50f23f5', 'request_id': 'req-61adbe57-501f-4eaf-86fe-760776f42429'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:12.131436 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-61adbe57-501f-4eaf-86fe-760776f42429 admin admin] The token cache is being invalidate because project ab7c344ba86a4f19ba2d8163d50f23f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:38:12.131824 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-61adbe57-501f-4eaf-86fe-760776f42429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:12.132469 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-61adbe57-501f-4eaf-86fe-760776f42429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:12.134192 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1003/1987] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:38:11 2021] DELETE /identity/v3/projects/ab7c344ba86a4f19ba2d8163d50f23f5 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:12.140163 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e1fce-d35b-41dd-b06c-74f7d034324e None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:12.140502 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e1fce-d35b-41dd-b06c-74f7d034324e None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:12.140788 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e1fce-d35b-41dd-b06c-74f7d034324e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:12.165076 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-093e1fce-d35b-41dd-b06c-74f7d034324e None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:12.167303 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-093e1fce-d35b-41dd-b06c-74f7d034324e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:12.186153 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-653d165b-e127-43f5-991f-597076614779 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cb1e74f16a942128b5c53c389dedd38', 'request_id': 'req-653d165b-e127-43f5-991f-597076614779'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:12.193540 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-653d165b-e127-43f5-991f-597076614779 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cb1e74f16a942128b5c53c389dedd38', 'request_id': 'req-653d165b-e127-43f5-991f-597076614779'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:12.204226 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-653d165b-e127-43f5-991f-597076614779 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cb1e74f16a942128b5c53c389dedd38', 'request_id': 'req-653d165b-e127-43f5-991f-597076614779'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:12.216105 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-653d165b-e127-43f5-991f-597076614779 admin admin] The token cache is being invalidate because project 4cb1e74f16a942128b5c53c389dedd38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:38:12.216396 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-653d165b-e127-43f5-991f-597076614779 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:12.217050 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-653d165b-e127-43f5-991f-597076614779 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:12.223188 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 985/1988] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:38:11 2021] DELETE /identity/v3/projects/4cb1e74f16a942128b5c53c389dedd38 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:12.232160 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020f53f-12ad-4282-995b-71b6e45241f7 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:12.246906 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020f53f-12ad-4282-995b-71b6e45241f7 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:12.247262 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020f53f-12ad-4282-995b-71b6e45241f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:12.258898 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1004/1989] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:12.269080 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f967eb-d708-4856-a667-93e4ff41dd18 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:12.269457 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f967eb-d708-4856-a667-93e4ff41dd18 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:12.269815 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f967eb-d708-4856-a667-93e4ff41dd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:12.271719 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-4020f53f-12ad-4282-995b-71b6e45241f7 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:12.273028 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-4020f53f-12ad-4282-995b-71b6e45241f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:12.281068 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 986/1990] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:12.290282 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee004ae8-1fd1-47a5-8c24-bd08989460cf None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:12.290629 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee004ae8-1fd1-47a5-8c24-bd08989460cf None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:12.291002 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee004ae8-1fd1-47a5-8c24-bd08989460cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:12.292368 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-b4f967eb-d708-4856-a667-93e4ff41dd18 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:12.293700 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-b4f967eb-d708-4856-a667-93e4ff41dd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:12.307007 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1005/1991] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:38:12.311494 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f967eb-d708-4856-a667-93e4ff41dd18 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:12.314798 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-ee004ae8-1fd1-47a5-8c24-bd08989460cf None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:12.316293 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-ee004ae8-1fd1-47a5-8c24-bd08989460cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:12.321448 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f967eb-d708-4856-a667-93e4ff41dd18 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:12.326267 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3988704-4cc9-49b9-8a39-17b2677f7bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:12.331778 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 987/1992] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:12.333175 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee004ae8-1fd1-47a5-8c24-bd08989460cf None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:12.333963 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3988704-4cc9-49b9-8a39-17b2677f7bbe admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:12.334415 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3988704-4cc9-49b9-8a39-17b2677f7bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:12.334618 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3988704-4cc9-49b9-8a39-17b2677f7bbe admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:12.335304 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3988704-4cc9-49b9-8a39-17b2677f7bbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:38:12.335610 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3988704-4cc9-49b9-8a39-17b2677f7bbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:12.339288 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3988704-4cc9-49b9-8a39-17b2677f7bbe admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:12.346653 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee004ae8-1fd1-47a5-8c24-bd08989460cf None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:12.352990 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbe09d-a5d6-4103-9284-2810355e06cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:12.353784 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1006/1993] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:38:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:38:12.354952 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbe09d-a5d6-4103-9284-2810355e06cc admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:12.355371 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbe09d-a5d6-4103-9284-2810355e06cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:12.355632 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbe09d-a5d6-4103-9284-2810355e06cc admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:12.356444 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbe09d-a5d6-4103-9284-2810355e06cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:38:12.356899 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbe09d-a5d6-4103-9284-2810355e06cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:12.357839 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3988704-4cc9-49b9-8a39-17b2677f7bbe admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:12.360707 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbe09d-a5d6-4103-9284-2810355e06cc admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:12.369690 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3988704-4cc9-49b9-8a39-17b2677f7bbe admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:12.372845 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 988/1994] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:38:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:38:12.374659 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78125ab-49a8-4278-baf4-5ae8c315dafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:12.375445 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78125ab-49a8-4278-baf4-5ae8c315dafd admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:12.375869 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78125ab-49a8-4278-baf4-5ae8c315dafd admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:12.376204 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78125ab-49a8-4278-baf4-5ae8c315dafd admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:12.376984 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78125ab-49a8-4278-baf4-5ae8c315dafd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:12.377331 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbe09d-a5d6-4103-9284-2810355e06cc admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:12.379068 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78125ab-49a8-4278-baf4-5ae8c315dafd admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:12.389270 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbe09d-a5d6-4103-9284-2810355e06cc admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:12.394428 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65162a39-1d4e-4d4f-971b-e2c4d34693ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:12.395345 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65162a39-1d4e-4d4f-971b-e2c4d34693ac admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:12.395718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65162a39-1d4e-4d4f-971b-e2c4d34693ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:12.396028 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65162a39-1d4e-4d4f-971b-e2c4d34693ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:12.396789 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65162a39-1d4e-4d4f-971b-e2c4d34693ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:12.398838 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65162a39-1d4e-4d4f-971b-e2c4d34693ac admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:12.420187 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1007/1995] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:38:12 2021] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:38:12.420187 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78125ab-49a8-4278-baf4-5ae8c315dafd admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:12.420187 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-d78125ab-49a8-4278-baf4-5ae8c315dafd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:12.434424 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 989/1996] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:38:12 2021] POST /identity/v3/projects => generated 399 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:38:12.434424 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65162a39-1d4e-4d4f-971b-e2c4d34693ac admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:12.480524 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78125ab-49a8-4278-baf4-5ae8c315dafd admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:12.493445 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65162a39-1d4e-4d4f-971b-e2c4d34693ac admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:12.498201 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cb3bf-e6e0-459b-81fb-3d6b25e8014a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:12.499563 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cb3bf-e6e0-459b-81fb-3d6b25e8014a admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:12.499842 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cb3bf-e6e0-459b-81fb-3d6b25e8014a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:12.500114 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cb3bf-e6e0-459b-81fb-3d6b25e8014a admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:12.500879 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357cb3bf-e6e0-459b-81fb-3d6b25e8014a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:12.502831 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357cb3bf-e6e0-459b-81fb-3d6b25e8014a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:12.524842 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 990/1997] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:38:12 2021] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:38:12.525777 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cb3bf-e6e0-459b-81fb-3d6b25e8014a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:12.535510 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cb3bf-e6e0-459b-81fb-3d6b25e8014a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:12.540779 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28903b8a-9c29-4fa4-800e-1e57a0fcd080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:12.540913 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b0912-1f0f-4cdf-a31c-054108909e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:12.541434 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28903b8a-9c29-4fa4-800e-1e57a0fcd080 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:12.541668 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b0912-1f0f-4cdf-a31c-054108909e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:12.541759 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28903b8a-9c29-4fa4-800e-1e57a0fcd080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:12.541947 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b0912-1f0f-4cdf-a31c-054108909e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:12.542040 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28903b8a-9c29-4fa4-800e-1e57a0fcd080 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:12.542219 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b0912-1f0f-4cdf-a31c-054108909e4a admin admin] PATH_INFO: `/v3/users/8265fba8062d49578f57c61691ccf423` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:12.542641 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28903b8a-9c29-4fa4-800e-1e57a0fcd080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:12.543536 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b0912-1f0f-4cdf-a31c-054108909e4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8265fba8062d49578f57c61691ccf423)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:12.544603 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28903b8a-9c29-4fa4-800e-1e57a0fcd080 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:12.545859 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b0912-1f0f-4cdf-a31c-054108909e4a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:12.566649 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 991/1998] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:38:12 2021] POST /identity/v3/users => generated 300 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:38:12.567773 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28903b8a-9c29-4fa4-800e-1e57a0fcd080 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:12.577611 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28903b8a-9c29-4fa4-800e-1e57a0fcd080 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:12.582430 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfc90c-a248-43b6-a7b8-ca3a7a177a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:12.583130 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfc90c-a248-43b6-a7b8-ca3a7a177a7a admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:12.583434 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfc90c-a248-43b6-a7b8-ca3a7a177a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:12.583683 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfc90c-a248-43b6-a7b8-ca3a7a177a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:12.584433 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfc90c-a248-43b6-a7b8-ca3a7a177a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:12.586044 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfc90c-a248-43b6-a7b8-ca3a7a177a7a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:12.596374 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 992/1999] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:12 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:12.597175 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfc90c-a248-43b6-a7b8-ca3a7a177a7a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:12.602449 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-d01b0912-1f0f-4cdf-a31c-054108909e4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8265fba8062d49578f57c61691ccf423'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:12.606331 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfc90c-a248-43b6-a7b8-ca3a7a177a7a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:12.610630 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-d01b0912-1f0f-4cdf-a31c-054108909e4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8265fba8062d49578f57c61691ccf423'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:12.611567 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-d01b0912-1f0f-4cdf-a31c-054108909e4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8265fba8062d49578f57c61691ccf423'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:12.612202 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa02a7a-0144-47a0-86d8-b7d7fb721540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:12.612938 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa02a7a-0144-47a0-86d8-b7d7fb721540 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:12.613229 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa02a7a-0144-47a0-86d8-b7d7fb721540 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:12.613525 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa02a7a-0144-47a0-86d8-b7d7fb721540 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:12.614367 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa02a7a-0144-47a0-86d8-b7d7fb721540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:12.616016 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa02a7a-0144-47a0-86d8-b7d7fb721540 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:12.623585 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-d01b0912-1f0f-4cdf-a31c-054108909e4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8265fba8062d49578f57c61691ccf423'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:12.626589 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 993/2000] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:12 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:12.630639 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa02a7a-0144-47a0-86d8-b7d7fb721540 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:12.630779 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-d01b0912-1f0f-4cdf-a31c-054108909e4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8265fba8062d49578f57c61691ccf423'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:12.632443 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-7fa02a7a-0144-47a0-86d8-b7d7fb721540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:12.636676 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1008/2001] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:38:12 2021] DELETE /identity/v3/users/8265fba8062d49578f57c61691ccf423 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:12.640336 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b0912-1f0f-4cdf-a31c-054108909e4a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:12.641690 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-d01b0912-1f0f-4cdf-a31c-054108909e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:12.644849 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa02a7a-0144-47a0-86d8-b7d7fb721540 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:12.700925 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad5c82-139d-47a1-9d9e-8b0a63cd79d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:12.702053 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad5c82-139d-47a1-9d9e-8b0a63cd79d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:12.702521 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad5c82-139d-47a1-9d9e-8b0a63cd79d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:12.702828 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad5c82-139d-47a1-9d9e-8b0a63cd79d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:12.703581 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad5c82-139d-47a1-9d9e-8b0a63cd79d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:12.705252 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad5c82-139d-47a1-9d9e-8b0a63cd79d2 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:12.706206 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b0912-1f0f-4cdf-a31c-054108909e4a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:12.712974 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e459a9-c7f1-4399-ad5c-e35d47a981b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:12.713949 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e459a9-c7f1-4399-ad5c-e35d47a981b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:12.714319 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e459a9-c7f1-4399-ad5c-e35d47a981b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:12.714700 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e459a9-c7f1-4399-ad5c-e35d47a981b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:12.718920 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 994/2002] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:12 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:12.719065 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e459a9-c7f1-4399-ad5c-e35d47a981b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:12.719173 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477618f-186b-440c-9da5-1565f876f548 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:12.719173 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477618f-186b-440c-9da5-1565f876f548 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:12.719335 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e459a9-c7f1-4399-ad5c-e35d47a981b8 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:12.719461 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477618f-186b-440c-9da5-1565f876f548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:12.734625 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1009/2003] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:12 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:12.734625 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e459a9-c7f1-4399-ad5c-e35d47a981b8 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:12.734946 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-b477618f-186b-440c-9da5-1565f876f548 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:12.736081 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-b477618f-186b-440c-9da5-1565f876f548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:12.748525 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 995/2004] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:12.748525 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477618f-186b-440c-9da5-1565f876f548 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:12.748832 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e459a9-c7f1-4399-ad5c-e35d47a981b8 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:12.754743 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd0575-3172-4791-aac1-3f24e2b68927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:12.756352 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd0575-3172-4791-aac1-3f24e2b68927 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:12.756633 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd0575-3172-4791-aac1-3f24e2b68927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:12.756905 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd0575-3172-4791-aac1-3f24e2b68927 admin admin] PATH_INFO: `/v3/projects/68e2cb33410447879d1f62a96b7330a4/users/471ecbbaaced43cc8f88fb0913d1e991/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:12.759677 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477618f-186b-440c-9da5-1565f876f548 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:12.765473 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11cf5e-e375-410b-8dc9-0dddeeaa8ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:12.766994 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11cf5e-e375-410b-8dc9-0dddeeaa8ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:12.767371 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11cf5e-e375-410b-8dc9-0dddeeaa8ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:12.767652 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11cf5e-e375-410b-8dc9-0dddeeaa8ef0 admin admin] PATH_INFO: `/v3/projects/d1349b27d66e471983bc0ccbc3a2ddd4/users/516232b5eceb4484b9c435f62a1c9771/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:12.777111 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd0575-3172-4791-aac1-3f24e2b68927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68e2cb33410447879d1f62a96b7330a4, user_id=471ecbbaaced43cc8f88fb0913d1e991, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:12.779952 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd0575-3172-4791-aac1-3f24e2b68927 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:12.782646 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11cf5e-e375-410b-8dc9-0dddeeaa8ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1349b27d66e471983bc0ccbc3a2ddd4, user_id=516232b5eceb4484b9c435f62a1c9771, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:12.785670 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11cf5e-e375-410b-8dc9-0dddeeaa8ef0 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:12.795948 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1010/2005] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:38:12 2021] PUT /identity/v3/projects/68e2cb33410447879d1f62a96b7330a4/users/471ecbbaaced43cc8f88fb0913d1e991/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:12.796817 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd0575-3172-4791-aac1-3f24e2b68927 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:12.798402 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-07fd0575-3172-4791-aac1-3f24e2b68927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:12.807994 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 996/2006] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:38:12 2021] PUT /identity/v3/projects/d1349b27d66e471983bc0ccbc3a2ddd4/users/516232b5eceb4484b9c435f62a1c9771/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:12.809321 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1e7c7-376d-4eef-ad93-e5dcd9805a77 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:12.809613 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1e7c7-376d-4eef-ad93-e5dcd9805a77 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:12.809905 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1e7c7-376d-4eef-ad93-e5dcd9805a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:12.838601 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-83a1e7c7-376d-4eef-ad93-e5dcd9805a77 None None] MFA Rules not processed for user `471ecbbaaced43cc8f88fb0913d1e991`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:12.839790 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-83a1e7c7-376d-4eef-ad93-e5dcd9805a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:12.854422 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd0575-3172-4791-aac1-3f24e2b68927 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:12.900596 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25009b7d-22a7-4a34-8dbe-231d58c3ed61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:12.901250 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25009b7d-22a7-4a34-8dbe-231d58c3ed61 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:12.901527 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25009b7d-22a7-4a34-8dbe-231d58c3ed61 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:12.901797 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25009b7d-22a7-4a34-8dbe-231d58c3ed61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:12.906428 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 997/2007] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:12 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:12.908147 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027ba4a-0dc1-4d3f-ac3b-9153e92dede0 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:12.908515 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027ba4a-0dc1-4d3f-ac3b-9153e92dede0 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:12.908906 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027ba4a-0dc1-4d3f-ac3b-9153e92dede0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:12.937310 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-0027ba4a-0dc1-4d3f-ac3b-9153e92dede0 None None] MFA Rules not processed for user `516232b5eceb4484b9c435f62a1c9771`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:12.938722 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-0027ba4a-0dc1-4d3f-ac3b-9153e92dede0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:12.967080 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25009b7d-22a7-4a34-8dbe-231d58c3ed61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:12.968626 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25009b7d-22a7-4a34-8dbe-231d58c3ed61 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:12.979083 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1011/2008] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:38:12.980025 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25009b7d-22a7-4a34-8dbe-231d58c3ed61 service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:12.981450 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-25009b7d-22a7-4a34-8dbe-231d58c3ed61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:13.010070 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 998/2009] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:12 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:13.014735 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027ba4a-0dc1-4d3f-ac3b-9153e92dede0 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:13.033698 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027ba4a-0dc1-4d3f-ac3b-9153e92dede0 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:13.039017 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25009b7d-22a7-4a34-8dbe-231d58c3ed61 service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:13.043555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f1a10-b439-4dad-a7c7-c0650f2ef454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:13.043892 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc94ff-0b95-4d87-80ef-9499e2213977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:13.044579 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f1a10-b439-4dad-a7c7-c0650f2ef454 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:13.044579 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f1a10-b439-4dad-a7c7-c0650f2ef454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:13.045156 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f1a10-b439-4dad-a7c7-c0650f2ef454 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:13.045405 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc94ff-0b95-4d87-80ef-9499e2213977 service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:13.045743 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc94ff-0b95-4d87-80ef-9499e2213977 service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:13.045877 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f1a10-b439-4dad-a7c7-c0650f2ef454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:13.046127 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc94ff-0b95-4d87-80ef-9499e2213977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:13.053208 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f1a10-b439-4dad-a7c7-c0650f2ef454 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:13.057927 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc94ff-0b95-4d87-80ef-9499e2213977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:13.059653 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc94ff-0b95-4d87-80ef-9499e2213977 service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:13.072538 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1012/2010] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:12 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:38:13.089672 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 999/2011] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:38:13 2021] POST /identity/v3/projects => generated 399 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:38:13.095034 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc94ff-0b95-4d87-80ef-9499e2213977 service cinder] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:13.110959 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc94ff-0b95-4d87-80ef-9499e2213977 service cinder] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:13.189885 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58afa76-6e6b-43ce-9e47-bd36ef1d621f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:13.190606 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58afa76-6e6b-43ce-9e47-bd36ef1d621f admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:13.190963 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58afa76-6e6b-43ce-9e47-bd36ef1d621f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:13.191236 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58afa76-6e6b-43ce-9e47-bd36ef1d621f admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:13.191950 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58afa76-6e6b-43ce-9e47-bd36ef1d621f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:13.194030 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58afa76-6e6b-43ce-9e47-bd36ef1d621f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:13.227741 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1013/2012] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:38:13 2021] POST /identity/v3/users => generated 306 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:38:13.232031 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f1a10-b439-4dad-a7c7-c0650f2ef454 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:13.247954 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f1a10-b439-4dad-a7c7-c0650f2ef454 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:13.259808 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a60bec-6b08-4b95-821e-a11bc3c42ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:13.260740 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a60bec-6b08-4b95-821e-a11bc3c42ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:13.260846 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a60bec-6b08-4b95-821e-a11bc3c42ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:13.261035 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a60bec-6b08-4b95-821e-a11bc3c42ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:13.262573 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a60bec-6b08-4b95-821e-a11bc3c42ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:13.264765 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a60bec-6b08-4b95-821e-a11bc3c42ba6 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:13.317038 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58afa76-6e6b-43ce-9e47-bd36ef1d621f admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:13.317716 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1000/2013] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:13 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:13.345683 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58afa76-6e6b-43ce-9e47-bd36ef1d621f admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:13.360482 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadba13-b833-43f9-b72b-6efe1b37ff9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:13.367173 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadba13-b833-43f9-b72b-6efe1b37ff9d admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:13.367685 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadba13-b833-43f9-b72b-6efe1b37ff9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:13.368425 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadba13-b833-43f9-b72b-6efe1b37ff9d admin admin] PATH_INFO: `/v3/projects/1e6f8b6e8a17435ab04087ee6d4f6ca9/users/7db0884d555d4631857d31a284a9f288/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:13.412107 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadba13-b833-43f9-b72b-6efe1b37ff9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e6f8b6e8a17435ab04087ee6d4f6ca9, user_id=7db0884d555d4631857d31a284a9f288, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:13.415326 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadba13-b833-43f9-b72b-6efe1b37ff9d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:13.441582 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1014/2014] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:38:13 2021] PUT /identity/v3/projects/1e6f8b6e8a17435ab04087ee6d4f6ca9/users/7db0884d555d4631857d31a284a9f288/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:38:13.443640 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a60bec-6b08-4b95-821e-a11bc3c42ba6 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:13.469052 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a60bec-6b08-4b95-821e-a11bc3c42ba6 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:13.599087 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadba13-b833-43f9-b72b-6efe1b37ff9d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:13.601796 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-bdadba13-b833-43f9-b72b-6efe1b37ff9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:13.643490 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f88b0-ce0a-4c78-abe0-2b8b2aeb0a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:13.644193 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f88b0-ce0a-4c78-abe0-2b8b2aeb0a0c admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:13.644480 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f88b0-ce0a-4c78-abe0-2b8b2aeb0a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:13.644742 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f88b0-ce0a-4c78-abe0-2b8b2aeb0a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:13.645505 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f88b0-ce0a-4c78-abe0-2b8b2aeb0a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:13.647310 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f88b0-ce0a-4c78-abe0-2b8b2aeb0a0c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:13.676879 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1001/2015] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:13 2021] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:38:13.677748 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f88b0-ce0a-4c78-abe0-2b8b2aeb0a0c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:13.696502 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f88b0-ce0a-4c78-abe0-2b8b2aeb0a0c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:13.701877 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff13e35-10f4-4f2f-b4ca-3357a00b76f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:13.702959 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff13e35-10f4-4f2f-b4ca-3357a00b76f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:13.703395 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff13e35-10f4-4f2f-b4ca-3357a00b76f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:13.703632 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff13e35-10f4-4f2f-b4ca-3357a00b76f4 admin admin] PATH_INFO: `/v3/projects/1e6f8b6e8a17435ab04087ee6d4f6ca9/users/7db0884d555d4631857d31a284a9f288/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:13.706097 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff13e35-10f4-4f2f-b4ca-3357a00b76f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e6f8b6e8a17435ab04087ee6d4f6ca9, user_id=7db0884d555d4631857d31a284a9f288, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:13.709247 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff13e35-10f4-4f2f-b4ca-3357a00b76f4 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:13.722062 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1002/2016] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:38:13 2021] PUT /identity/v3/projects/1e6f8b6e8a17435ab04087ee6d4f6ca9/users/7db0884d555d4631857d31a284a9f288/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:13.737694 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba38c79-bf6d-45ca-93f4-549ee1d278ed None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:13.738087 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba38c79-bf6d-45ca-93f4-549ee1d278ed None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:13.738463 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba38c79-bf6d-45ca-93f4-549ee1d278ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:13.755043 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadba13-b833-43f9-b72b-6efe1b37ff9d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:13.790914 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-0ba38c79-bf6d-45ca-93f4-549ee1d278ed None None] MFA Rules not processed for user `7db0884d555d4631857d31a284a9f288`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:13.792205 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-0ba38c79-bf6d-45ca-93f4-549ee1d278ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:13.843806 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8f594-60c4-428f-934c-3f1c90e51dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:13.844800 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8f594-60c4-428f-934c-3f1c90e51dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:13.845082 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8f594-60c4-428f-934c-3f1c90e51dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:13.845354 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8f594-60c4-428f-934c-3f1c90e51dc5 admin admin] PATH_INFO: `/v3/projects/4f9a60c7cce345a68deab67ce0011a8f` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:13.846669 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8f594-60c4-428f-934c-3f1c90e51dc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f9a60c7cce345a68deab67ce0011a8f)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:13.848523 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8f594-60c4-428f-934c-3f1c90e51dc5 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:13.867526 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1003/2017] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:13 2021] POST /identity/v3/auth/tokens => generated 3486 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:38:13.878381 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba38c79-bf6d-45ca-93f4-549ee1d278ed None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:13.907430 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-dcb8f594-60c4-428f-934c-3f1c90e51dc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f9a60c7cce345a68deab67ce0011a8f', 'request_id': 'req-dcb8f594-60c4-428f-934c-3f1c90e51dc5'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:13.913979 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-dcb8f594-60c4-428f-934c-3f1c90e51dc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f9a60c7cce345a68deab67ce0011a8f', 'request_id': 'req-dcb8f594-60c4-428f-934c-3f1c90e51dc5'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:13.924921 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-dcb8f594-60c4-428f-934c-3f1c90e51dc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f9a60c7cce345a68deab67ce0011a8f', 'request_id': 'req-dcb8f594-60c4-428f-934c-3f1c90e51dc5'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:13.937318 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-dcb8f594-60c4-428f-934c-3f1c90e51dc5 admin admin] The token cache is being invalidate because project 4f9a60c7cce345a68deab67ce0011a8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:38:13.937605 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-dcb8f594-60c4-428f-934c-3f1c90e51dc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:13.938355 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-dcb8f594-60c4-428f-934c-3f1c90e51dc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:13.939084 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba38c79-bf6d-45ca-93f4-549ee1d278ed None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:13.940111 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1015/2018] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:38:13 2021] DELETE /identity/v3/projects/4f9a60c7cce345a68deab67ce0011a8f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:13.944075 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8f594-60c4-428f-934c-3f1c90e51dc5 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:13.945328 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-dcb8f594-60c4-428f-934c-3f1c90e51dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:13.995520 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f787c52-7e57-4b7f-8bab-70f1a9211399 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:13.996213 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f787c52-7e57-4b7f-8bab-70f1a9211399 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:13.996519 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f787c52-7e57-4b7f-8bab-70f1a9211399 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:13.996818 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f787c52-7e57-4b7f-8bab-70f1a9211399 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:13.998707 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-7f787c52-7e57-4b7f-8bab-70f1a9211399 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:14.016709 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8f594-60c4-428f-934c-3f1c90e51dc5 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:14.022255 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb630471-471d-45a1-8486-3cdec114453a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:14.023406 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb630471-471d-45a1-8486-3cdec114453a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:14.023880 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb630471-471d-45a1-8486-3cdec114453a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:14.024417 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb630471-471d-45a1-8486-3cdec114453a admin admin] PATH_INFO: `/v3/users/230f39dcc7a84d30b698d27b37832bd4` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:14.025908 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb630471-471d-45a1-8486-3cdec114453a admin admin] RBAC: Authorizing `identity:delete_user(user_id=230f39dcc7a84d30b698d27b37832bd4)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:14.028181 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb630471-471d-45a1-8486-3cdec114453a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:14.062857 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f787c52-7e57-4b7f-8bab-70f1a9211399 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:14.064603 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f787c52-7e57-4b7f-8bab-70f1a9211399 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:14.075362 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1004/2019] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:13 2021] GET /identity/v3/auth/tokens => generated 3486 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:38:14.078983 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-fb630471-471d-45a1-8486-3cdec114453a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '230f39dcc7a84d30b698d27b37832bd4'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:14.087233 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-fb630471-471d-45a1-8486-3cdec114453a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '230f39dcc7a84d30b698d27b37832bd4'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:14.088197 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-fb630471-471d-45a1-8486-3cdec114453a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '230f39dcc7a84d30b698d27b37832bd4'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:14.100488 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-fb630471-471d-45a1-8486-3cdec114453a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '230f39dcc7a84d30b698d27b37832bd4'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:14.106423 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-fb630471-471d-45a1-8486-3cdec114453a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '230f39dcc7a84d30b698d27b37832bd4'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:14.112562 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1016/2020] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:38:13 2021] DELETE /identity/v3/users/230f39dcc7a84d30b698d27b37832bd4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:38:14.158533 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f787c52-7e57-4b7f-8bab-70f1a9211399 service cinder] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:14.160391 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-7f787c52-7e57-4b7f-8bab-70f1a9211399 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:14.171319 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f787c52-7e57-4b7f-8bab-70f1a9211399 service cinder] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:14.221153 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe924acf-2962-43e3-b48e-368a402f68d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:14.221818 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe924acf-2962-43e3-b48e-368a402f68d5 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:14.222099 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe924acf-2962-43e3-b48e-368a402f68d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:14.222383 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe924acf-2962-43e3-b48e-368a402f68d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:14.224214 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-fe924acf-2962-43e3-b48e-368a402f68d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:14.288204 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe924acf-2962-43e3-b48e-368a402f68d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:14.289643 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe924acf-2962-43e3-b48e-368a402f68d5 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:14.299249 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1005/2021] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:14 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:38:14.399917 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb630471-471d-45a1-8486-3cdec114453a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:14.401643 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-fb630471-471d-45a1-8486-3cdec114453a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:14.502517 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb630471-471d-45a1-8486-3cdec114453a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:14.520148 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b746d4-fe44-4357-a6b3-221aa6b86c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:14.521046 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b746d4-fe44-4357-a6b3-221aa6b86c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:14.521397 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b746d4-fe44-4357-a6b3-221aa6b86c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:14.521669 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b746d4-fe44-4357-a6b3-221aa6b86c9c admin admin] PATH_INFO: `/v3/projects/6e72ca59b69a4a558737df930e5d12e1` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:14.523134 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b746d4-fe44-4357-a6b3-221aa6b86c9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e72ca59b69a4a558737df930e5d12e1)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:14.525082 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b746d4-fe44-4357-a6b3-221aa6b86c9c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:14.588129 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-50b746d4-fe44-4357-a6b3-221aa6b86c9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e72ca59b69a4a558737df930e5d12e1', 'request_id': 'req-50b746d4-fe44-4357-a6b3-221aa6b86c9c'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:14.595061 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-50b746d4-fe44-4357-a6b3-221aa6b86c9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e72ca59b69a4a558737df930e5d12e1', 'request_id': 'req-50b746d4-fe44-4357-a6b3-221aa6b86c9c'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:14.605289 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-50b746d4-fe44-4357-a6b3-221aa6b86c9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e72ca59b69a4a558737df930e5d12e1', 'request_id': 'req-50b746d4-fe44-4357-a6b3-221aa6b86c9c'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:14.640451 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-50b746d4-fe44-4357-a6b3-221aa6b86c9c admin admin] The token cache is being invalidate because project 6e72ca59b69a4a558737df930e5d12e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:38:14.640743 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-50b746d4-fe44-4357-a6b3-221aa6b86c9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:14.642052 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-50b746d4-fe44-4357-a6b3-221aa6b86c9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:14.643910 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1017/2022] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:38:14 2021] DELETE /identity/v3/projects/6e72ca59b69a4a558737df930e5d12e1 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:14.644903 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44600539-6254-44a7-8e0a-3db270fbc485 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:14.645299 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44600539-6254-44a7-8e0a-3db270fbc485 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:14.645690 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44600539-6254-44a7-8e0a-3db270fbc485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:14.675631 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-44600539-6254-44a7-8e0a-3db270fbc485 None None] MFA Rules not processed for user `471ecbbaaced43cc8f88fb0913d1e991`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:14.676993 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-44600539-6254-44a7-8e0a-3db270fbc485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:14.754367 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1006/2023] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:14 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:38:17.074753 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b746d4-fe44-4357-a6b3-221aa6b86c9c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:17.076601 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-50b746d4-fe44-4357-a6b3-221aa6b86c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:17.184797 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b746d4-fe44-4357-a6b3-221aa6b86c9c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:17.191032 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6435f-3d60-473e-8051-1ab1d93b01ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:17.191979 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6435f-3d60-473e-8051-1ab1d93b01ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:17.192399 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6435f-3d60-473e-8051-1ab1d93b01ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:17.192670 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6435f-3d60-473e-8051-1ab1d93b01ea admin admin] PATH_INFO: `/v3/users/1fe4b8bb46f14e1a82728e66f8d27746` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:17.194130 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6435f-3d60-473e-8051-1ab1d93b01ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fe4b8bb46f14e1a82728e66f8d27746)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:17.196266 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6435f-3d60-473e-8051-1ab1d93b01ea admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:17.247568 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-faa6435f-3d60-473e-8051-1ab1d93b01ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fe4b8bb46f14e1a82728e66f8d27746'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:17.257329 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-faa6435f-3d60-473e-8051-1ab1d93b01ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fe4b8bb46f14e1a82728e66f8d27746'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:17.257985 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-faa6435f-3d60-473e-8051-1ab1d93b01ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fe4b8bb46f14e1a82728e66f8d27746'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:17.278406 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-faa6435f-3d60-473e-8051-1ab1d93b01ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fe4b8bb46f14e1a82728e66f8d27746'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:17.298117 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-faa6435f-3d60-473e-8051-1ab1d93b01ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fe4b8bb46f14e1a82728e66f8d27746'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:17.312582 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1018/2024] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:38:17 2021] DELETE /identity/v3/users/1fe4b8bb46f14e1a82728e66f8d27746 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:17.655002 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44600539-6254-44a7-8e0a-3db270fbc485 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:17.666736 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44600539-6254-44a7-8e0a-3db270fbc485 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:17.740991 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d146b5-3427-4900-b62c-43fd2941fd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:17.742249 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d146b5-3427-4900-b62c-43fd2941fd03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:17.742526 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d146b5-3427-4900-b62c-43fd2941fd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:17.742984 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d146b5-3427-4900-b62c-43fd2941fd03 admin admin] PATH_INFO: `/v3/projects/9d82e2b8f43e4ae1ac9d7014a692ee64` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:17.745669 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d146b5-3427-4900-b62c-43fd2941fd03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d82e2b8f43e4ae1ac9d7014a692ee64)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:17.747906 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d146b5-3427-4900-b62c-43fd2941fd03 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:17.807870 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-05d146b5-3427-4900-b62c-43fd2941fd03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d82e2b8f43e4ae1ac9d7014a692ee64', 'request_id': 'req-05d146b5-3427-4900-b62c-43fd2941fd03'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:17.815230 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-05d146b5-3427-4900-b62c-43fd2941fd03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d82e2b8f43e4ae1ac9d7014a692ee64', 'request_id': 'req-05d146b5-3427-4900-b62c-43fd2941fd03'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:17.836855 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-05d146b5-3427-4900-b62c-43fd2941fd03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d82e2b8f43e4ae1ac9d7014a692ee64', 'request_id': 'req-05d146b5-3427-4900-b62c-43fd2941fd03'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:17.856071 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-05d146b5-3427-4900-b62c-43fd2941fd03 admin admin] The token cache is being invalidate because project 9d82e2b8f43e4ae1ac9d7014a692ee64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:38:17.856342 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-05d146b5-3427-4900-b62c-43fd2941fd03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:17.856966 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-05d146b5-3427-4900-b62c-43fd2941fd03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:17.859143 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1007/2025] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:38:17 2021] DELETE /identity/v3/projects/9d82e2b8f43e4ae1ac9d7014a692ee64 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:17.867015 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48341067-ee23-4739-a493-ed7a714752d1 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:17.867015 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48341067-ee23-4739-a493-ed7a714752d1 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:17.868081 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48341067-ee23-4739-a493-ed7a714752d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:17.892002 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-48341067-ee23-4739-a493-ed7a714752d1 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:17.893525 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-48341067-ee23-4739-a493-ed7a714752d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:17.966877 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1019/2026] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:17.968666 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097bd7e-b52d-4c54-a70d-d3143a43d6e1 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:17.968951 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097bd7e-b52d-4c54-a70d-d3143a43d6e1 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:17.969278 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097bd7e-b52d-4c54-a70d-d3143a43d6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:17.988559 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-2097bd7e-b52d-4c54-a70d-d3143a43d6e1 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:17.989855 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-2097bd7e-b52d-4c54-a70d-d3143a43d6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:17.997875 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1008/2027] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:18.002081 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48341067-ee23-4739-a493-ed7a714752d1 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:18.012326 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48341067-ee23-4739-a493-ed7a714752d1 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:18.017832 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fbf78-0cda-423d-a99d-eb5c0120864a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:18.018717 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fbf78-0cda-423d-a99d-eb5c0120864a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:18.019045 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fbf78-0cda-423d-a99d-eb5c0120864a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:18.019379 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fbf78-0cda-423d-a99d-eb5c0120864a admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:18.020241 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fbf78-0cda-423d-a99d-eb5c0120864a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:38:18.020606 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fbf78-0cda-423d-a99d-eb5c0120864a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:18.022301 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fbf78-0cda-423d-a99d-eb5c0120864a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:18.039216 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1020/2028] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:38:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:38:18.041145 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097bd7e-b52d-4c54-a70d-d3143a43d6e1 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:18.052039 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097bd7e-b52d-4c54-a70d-d3143a43d6e1 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:18.056906 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96cd5b-d495-41d1-a43a-a9566c769595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:18.057584 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96cd5b-d495-41d1-a43a-a9566c769595 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:18.058015 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96cd5b-d495-41d1-a43a-a9566c769595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:18.058233 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96cd5b-d495-41d1-a43a-a9566c769595 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:18.059163 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96cd5b-d495-41d1-a43a-a9566c769595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:18.061095 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96cd5b-d495-41d1-a43a-a9566c769595 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:18.093502 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1009/2029] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:38:18 2021] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:38:18.098565 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fbf78-0cda-423d-a99d-eb5c0120864a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:18.110960 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fbf78-0cda-423d-a99d-eb5c0120864a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:18.182112 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e0034-0e9d-4acd-9fe5-00de1c4af1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:18.183187 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e0034-0e9d-4acd-9fe5-00de1c4af1aa admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:18.184405 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e0034-0e9d-4acd-9fe5-00de1c4af1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:18.184922 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e0034-0e9d-4acd-9fe5-00de1c4af1aa admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:18.185845 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e0034-0e9d-4acd-9fe5-00de1c4af1aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:18.188210 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e0034-0e9d-4acd-9fe5-00de1c4af1aa admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:18.254011 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1021/2030] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:38:18 2021] POST /identity/v3/users => generated 284 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:38:18.258568 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96cd5b-d495-41d1-a43a-a9566c769595 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:18.281136 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96cd5b-d495-41d1-a43a-a9566c769595 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:18.286436 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4db971-62c3-45f6-89f0-1f29ebe99d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:18.287384 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4db971-62c3-45f6-89f0-1f29ebe99d67 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:18.287819 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4db971-62c3-45f6-89f0-1f29ebe99d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:18.288239 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4db971-62c3-45f6-89f0-1f29ebe99d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:18.295208 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4db971-62c3-45f6-89f0-1f29ebe99d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:18.300268 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4db971-62c3-45f6-89f0-1f29ebe99d67 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:18.321030 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1010/2031] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:18 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:18.325092 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e0034-0e9d-4acd-9fe5-00de1c4af1aa admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:18.336570 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e0034-0e9d-4acd-9fe5-00de1c4af1aa admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:18.341803 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ed71b-bbf1-4f5e-b0bb-c173ed450ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:18.342762 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ed71b-bbf1-4f5e-b0bb-c173ed450ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:18.343213 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ed71b-bbf1-4f5e-b0bb-c173ed450ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:18.343642 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ed71b-bbf1-4f5e-b0bb-c173ed450ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:18.344924 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ed71b-bbf1-4f5e-b0bb-c173ed450ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:18.347844 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ed71b-bbf1-4f5e-b0bb-c173ed450ce5 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:18.361495 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1022/2032] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:18 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:18.365822 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4db971-62c3-45f6-89f0-1f29ebe99d67 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:18.378949 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4db971-62c3-45f6-89f0-1f29ebe99d67 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:18.384836 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27818652-bec1-4f08-88d2-fbf6f646e053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:18.385742 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27818652-bec1-4f08-88d2-fbf6f646e053 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:18.386455 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27818652-bec1-4f08-88d2-fbf6f646e053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:18.386933 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27818652-bec1-4f08-88d2-fbf6f646e053 admin admin] PATH_INFO: `/v3/projects/924e2436414c43c285113fa2416439f1/users/1ab41fd50c304e16be64ca907231bc44/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:18.402933 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27818652-bec1-4f08-88d2-fbf6f646e053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=924e2436414c43c285113fa2416439f1, user_id=1ab41fd50c304e16be64ca907231bc44, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:18.406263 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27818652-bec1-4f08-88d2-fbf6f646e053 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:18.424999 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1011/2033] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:38:18 2021] PUT /identity/v3/projects/924e2436414c43c285113fa2416439f1/users/1ab41fd50c304e16be64ca907231bc44/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:38:18.475462 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0699b-88d0-491f-99cd-619b9eaef760 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:18.475729 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0699b-88d0-491f-99cd-619b9eaef760 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:18.476787 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0699b-88d0-491f-99cd-619b9eaef760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:18.514938 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-bfc0699b-88d0-491f-99cd-619b9eaef760 None None] MFA Rules not processed for user `1ab41fd50c304e16be64ca907231bc44`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:18.519009 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-bfc0699b-88d0-491f-99cd-619b9eaef760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:18.597925 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1023/2034] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:18 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:18.610607 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27818652-bec1-4f08-88d2-fbf6f646e053 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:18.612584 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-27818652-bec1-4f08-88d2-fbf6f646e053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:18.623724 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0699b-88d0-491f-99cd-619b9eaef760 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:18.625234 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-bfc0699b-88d0-491f-99cd-619b9eaef760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:18.684395 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27818652-bec1-4f08-88d2-fbf6f646e053 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:18.692534 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42eca8-1188-4b8e-891d-871d2cf62101 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:18.693491 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42eca8-1188-4b8e-891d-871d2cf62101 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:18.693963 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42eca8-1188-4b8e-891d-871d2cf62101 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:18.694409 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42eca8-1188-4b8e-891d-871d2cf62101 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:18.704173 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42eca8-1188-4b8e-891d-871d2cf62101 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:18.706140 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42eca8-1188-4b8e-891d-871d2cf62101 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:18.715828 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1012/2035] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:18 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:38:18.735656 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0699b-88d0-491f-99cd-619b9eaef760 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:18.741820 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068335d-4267-47c4-b78d-944737c4270c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:18.742886 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068335d-4267-47c4-b78d-944737c4270c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:18.743316 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068335d-4267-47c4-b78d-944737c4270c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:18.743674 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068335d-4267-47c4-b78d-944737c4270c admin admin] PATH_INFO: `/v3/users/516232b5eceb4484b9c435f62a1c9771` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:18.745125 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068335d-4267-47c4-b78d-944737c4270c admin admin] RBAC: Authorizing `identity:delete_user(user_id=516232b5eceb4484b9c435f62a1c9771)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:18.747462 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068335d-4267-47c4-b78d-944737c4270c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:18.815046 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c068335d-4267-47c4-b78d-944737c4270c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '516232b5eceb4484b9c435f62a1c9771'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:18.826108 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c068335d-4267-47c4-b78d-944737c4270c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '516232b5eceb4484b9c435f62a1c9771'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:18.827088 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c068335d-4267-47c4-b78d-944737c4270c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '516232b5eceb4484b9c435f62a1c9771'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:18.841108 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c068335d-4267-47c4-b78d-944737c4270c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '516232b5eceb4484b9c435f62a1c9771'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:18.848709 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c068335d-4267-47c4-b78d-944737c4270c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '516232b5eceb4484b9c435f62a1c9771'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:18.855103 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1024/2036] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:38:18 2021] DELETE /identity/v3/users/516232b5eceb4484b9c435f62a1c9771 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:38:18.859852 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eabee-6876-4f6b-818a-1200895c1d35 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:18.860394 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eabee-6876-4f6b-818a-1200895c1d35 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:18.860829 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eabee-6876-4f6b-818a-1200895c1d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:18.881397 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-ab2eabee-6876-4f6b-818a-1200895c1d35 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:18.882764 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-ab2eabee-6876-4f6b-818a-1200895c1d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:18.985572 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1013/2037] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:38:18.995867 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068335d-4267-47c4-b78d-944737c4270c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:18.997292 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-c068335d-4267-47c4-b78d-944737c4270c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:19.080243 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068335d-4267-47c4-b78d-944737c4270c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:19.084787 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb273a0-8b43-41af-b4ef-5b6dd046f305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:19.086265 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb273a0-8b43-41af-b4ef-5b6dd046f305 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:19.086521 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb273a0-8b43-41af-b4ef-5b6dd046f305 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:19.086829 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb273a0-8b43-41af-b4ef-5b6dd046f305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:19.097359 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb273a0-8b43-41af-b4ef-5b6dd046f305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:19.099196 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb273a0-8b43-41af-b4ef-5b6dd046f305 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:19.110141 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1025/2038] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:38:19.696039 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2eabee-6876-4f6b-818a-1200895c1d35 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:19.697607 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-ab2eabee-6876-4f6b-818a-1200895c1d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:19.709897 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2eabee-6876-4f6b-818a-1200895c1d35 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:19.714878 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd679db-948e-4e7e-9b64-60a5de12e504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:19.715750 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd679db-948e-4e7e-9b64-60a5de12e504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:19.716079 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd679db-948e-4e7e-9b64-60a5de12e504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:19.716359 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd679db-948e-4e7e-9b64-60a5de12e504 admin admin] PATH_INFO: `/v3/projects/d1349b27d66e471983bc0ccbc3a2ddd4` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:19.717670 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd679db-948e-4e7e-9b64-60a5de12e504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1349b27d66e471983bc0ccbc3a2ddd4)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:19.719754 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd679db-948e-4e7e-9b64-60a5de12e504 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:19.767917 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-3cd679db-948e-4e7e-9b64-60a5de12e504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1349b27d66e471983bc0ccbc3a2ddd4', 'request_id': 'req-3cd679db-948e-4e7e-9b64-60a5de12e504'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:19.774218 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-3cd679db-948e-4e7e-9b64-60a5de12e504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1349b27d66e471983bc0ccbc3a2ddd4', 'request_id': 'req-3cd679db-948e-4e7e-9b64-60a5de12e504'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:19.782785 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-3cd679db-948e-4e7e-9b64-60a5de12e504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1349b27d66e471983bc0ccbc3a2ddd4', 'request_id': 'req-3cd679db-948e-4e7e-9b64-60a5de12e504'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:19.792988 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-3cd679db-948e-4e7e-9b64-60a5de12e504 admin admin] The token cache is being invalidate because project d1349b27d66e471983bc0ccbc3a2ddd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:38:19.793279 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-3cd679db-948e-4e7e-9b64-60a5de12e504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:19.793888 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-3cd679db-948e-4e7e-9b64-60a5de12e504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:19.795832 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1014/2039] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:38:19 2021] DELETE /identity/v3/projects/d1349b27d66e471983bc0ccbc3a2ddd4 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:38:19.800070 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb273a0-8b43-41af-b4ef-5b6dd046f305 service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:19.809607 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb273a0-8b43-41af-b4ef-5b6dd046f305 service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:19.866509 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e23a1-fb51-404d-8765-258e0e13208e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:19.867429 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e23a1-fb51-404d-8765-258e0e13208e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:19.867705 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e23a1-fb51-404d-8765-258e0e13208e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:19.867979 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e23a1-fb51-404d-8765-258e0e13208e admin admin] PATH_INFO: `/v3/users/7db0884d555d4631857d31a284a9f288` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:19.869188 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e23a1-fb51-404d-8765-258e0e13208e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7db0884d555d4631857d31a284a9f288)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:19.871160 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e23a1-fb51-404d-8765-258e0e13208e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:20.061616 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-df9e23a1-fb51-404d-8765-258e0e13208e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7db0884d555d4631857d31a284a9f288'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:20.080702 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-df9e23a1-fb51-404d-8765-258e0e13208e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7db0884d555d4631857d31a284a9f288'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:20.081400 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-df9e23a1-fb51-404d-8765-258e0e13208e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7db0884d555d4631857d31a284a9f288'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:20.099578 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-df9e23a1-fb51-404d-8765-258e0e13208e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7db0884d555d4631857d31a284a9f288'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:20.108915 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-df9e23a1-fb51-404d-8765-258e0e13208e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7db0884d555d4631857d31a284a9f288'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:20.115673 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1026/2040] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:38:19 2021] DELETE /identity/v3/users/7db0884d555d4631857d31a284a9f288 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:20.119456 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b019a00-9ace-4dda-bc82-f445a39644da None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:20.119744 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b019a00-9ace-4dda-bc82-f445a39644da None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:20.120042 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b019a00-9ace-4dda-bc82-f445a39644da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:20.138591 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-9b019a00-9ace-4dda-bc82-f445a39644da None None] MFA Rules not processed for user `478109e21b1a4f3cb9690aed2d967faa`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:20.139916 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-9b019a00-9ace-4dda-bc82-f445a39644da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:20.206055 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1015/2041] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:20 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:38:20.529269 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e23a1-fb51-404d-8765-258e0e13208e admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:20.531372 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-df9e23a1-fb51-404d-8765-258e0e13208e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:20.606195 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e23a1-fb51-404d-8765-258e0e13208e admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:20.611463 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72249534-bc31-4668-8d17-0ead908af074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:20.612330 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72249534-bc31-4668-8d17-0ead908af074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:20.612600 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72249534-bc31-4668-8d17-0ead908af074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:20.612862 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72249534-bc31-4668-8d17-0ead908af074 admin admin] PATH_INFO: `/v3/projects/1e6f8b6e8a17435ab04087ee6d4f6ca9` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:20.614047 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72249534-bc31-4668-8d17-0ead908af074 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e6f8b6e8a17435ab04087ee6d4f6ca9)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:20.615947 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72249534-bc31-4668-8d17-0ead908af074 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:20.661918 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-72249534-bc31-4668-8d17-0ead908af074 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e6f8b6e8a17435ab04087ee6d4f6ca9', 'request_id': 'req-72249534-bc31-4668-8d17-0ead908af074'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:20.668190 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-72249534-bc31-4668-8d17-0ead908af074 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e6f8b6e8a17435ab04087ee6d4f6ca9', 'request_id': 'req-72249534-bc31-4668-8d17-0ead908af074'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:20.678383 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-72249534-bc31-4668-8d17-0ead908af074 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e6f8b6e8a17435ab04087ee6d4f6ca9', 'request_id': 'req-72249534-bc31-4668-8d17-0ead908af074'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:20.691158 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-72249534-bc31-4668-8d17-0ead908af074 admin admin] The token cache is being invalidate because project 1e6f8b6e8a17435ab04087ee6d4f6ca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:38:20.691442 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-72249534-bc31-4668-8d17-0ead908af074 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:20.692086 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-72249534-bc31-4668-8d17-0ead908af074 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:20.693654 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1027/2042] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:38:20 2021] DELETE /identity/v3/projects/1e6f8b6e8a17435ab04087ee6d4f6ca9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:20.699692 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aac841-798d-4be1-a5cd-7d5c7eb62b30 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:20.700271 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aac841-798d-4be1-a5cd-7d5c7eb62b30 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:20.700271 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aac841-798d-4be1-a5cd-7d5c7eb62b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:20.719095 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-d8aac841-798d-4be1-a5cd-7d5c7eb62b30 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:20.720418 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-d8aac841-798d-4be1-a5cd-7d5c7eb62b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:20.784053 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1016/2043] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:20.793881 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60e93b-51db-4446-bf12-a39632c2f946 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:20.794258 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60e93b-51db-4446-bf12-a39632c2f946 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:20.794984 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60e93b-51db-4446-bf12-a39632c2f946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:20.814467 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-7d60e93b-51db-4446-bf12-a39632c2f946 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:20.815818 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-7d60e93b-51db-4446-bf12-a39632c2f946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:20.824209 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1028/2044] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:20.828604 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aac841-798d-4be1-a5cd-7d5c7eb62b30 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:20.839063 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aac841-798d-4be1-a5cd-7d5c7eb62b30 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:20.844735 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4d1f0-d502-4a82-94fb-a92200eeccf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:20.845548 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4d1f0-d502-4a82-94fb-a92200eeccf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:20.845833 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4d1f0-d502-4a82-94fb-a92200eeccf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:20.846101 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4d1f0-d502-4a82-94fb-a92200eeccf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:20.846895 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4d1f0-d502-4a82-94fb-a92200eeccf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:38:20.847201 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4d1f0-d502-4a82-94fb-a92200eeccf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:20.848795 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4d1f0-d502-4a82-94fb-a92200eeccf7 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:20.862798 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1017/2045] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:38:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:38:20.867209 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60e93b-51db-4446-bf12-a39632c2f946 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:20.876690 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60e93b-51db-4446-bf12-a39632c2f946 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:20.882995 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad4147-37d8-4e2d-b5b1-f79e09341a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:20.883899 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad4147-37d8-4e2d-b5b1-f79e09341a0c admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:20.884178 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad4147-37d8-4e2d-b5b1-f79e09341a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:20.884445 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad4147-37d8-4e2d-b5b1-f79e09341a0c admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:20.885159 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad4147-37d8-4e2d-b5b1-f79e09341a0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:20.887157 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad4147-37d8-4e2d-b5b1-f79e09341a0c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:20.918803 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1029/2046] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:38:20 2021] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:38:20.923236 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4d1f0-d502-4a82-94fb-a92200eeccf7 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:20.933257 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4d1f0-d502-4a82-94fb-a92200eeccf7 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:20.993634 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f60fd9-a84e-4a67-bf6f-36695b33c329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:20.994341 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f60fd9-a84e-4a67-bf6f-36695b33c329 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:20.994624 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f60fd9-a84e-4a67-bf6f-36695b33c329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:20.994932 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f60fd9-a84e-4a67-bf6f-36695b33c329 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:20.995652 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f60fd9-a84e-4a67-bf6f-36695b33c329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:20.997612 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f60fd9-a84e-4a67-bf6f-36695b33c329 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:21.022066 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1018/2047] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:38:20 2021] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:38:21.026164 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad4147-37d8-4e2d-b5b1-f79e09341a0c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:21.037181 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad4147-37d8-4e2d-b5b1-f79e09341a0c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:21.041712 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48619f2-41f9-4949-b8af-df5128d9b1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:21.042435 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48619f2-41f9-4949-b8af-df5128d9b1ec admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:21.042738 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48619f2-41f9-4949-b8af-df5128d9b1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:21.043015 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48619f2-41f9-4949-b8af-df5128d9b1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:21.043753 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48619f2-41f9-4949-b8af-df5128d9b1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:21.045694 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48619f2-41f9-4949-b8af-df5128d9b1ec admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:21.055924 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1030/2048] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:21 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:21.059885 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f60fd9-a84e-4a67-bf6f-36695b33c329 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:21.069779 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f60fd9-a84e-4a67-bf6f-36695b33c329 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:21.074266 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3e737-f573-4bfd-bcc9-8ae1a7c8e4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:21.075028 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3e737-f573-4bfd-bcc9-8ae1a7c8e4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:21.075578 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3e737-f573-4bfd-bcc9-8ae1a7c8e4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:21.075852 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3e737-f573-4bfd-bcc9-8ae1a7c8e4c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:21.076603 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3e737-f573-4bfd-bcc9-8ae1a7c8e4c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:21.078231 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3e737-f573-4bfd-bcc9-8ae1a7c8e4c0 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:21.089239 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1019/2049] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:21 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:21.094130 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48619f2-41f9-4949-b8af-df5128d9b1ec admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:21.104104 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48619f2-41f9-4949-b8af-df5128d9b1ec admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:21.108905 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7b4aa-31f0-40fd-94a1-357875e0fd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:21.117873 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7b4aa-31f0-40fd-94a1-357875e0fd60 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:21.118656 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7b4aa-31f0-40fd-94a1-357875e0fd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:21.119178 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7b4aa-31f0-40fd-94a1-357875e0fd60 admin admin] PATH_INFO: `/v3/projects/9247389f25c84a78a005102065e0bd6f/users/bbc8695722b84451a70eaa8343799d40/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:21.139049 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7b4aa-31f0-40fd-94a1-357875e0fd60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9247389f25c84a78a005102065e0bd6f, user_id=bbc8695722b84451a70eaa8343799d40, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:21.144730 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7b4aa-31f0-40fd-94a1-357875e0fd60 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:21.167486 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1031/2050] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:38:21 2021] PUT /identity/v3/projects/9247389f25c84a78a005102065e0bd6f/users/bbc8695722b84451a70eaa8343799d40/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:38:21.178343 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112152a-34e6-4008-ab10-fc96bc1c21a3 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:21.178981 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112152a-34e6-4008-ab10-fc96bc1c21a3 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:21.179404 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112152a-34e6-4008-ab10-fc96bc1c21a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:21.210535 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-2112152a-34e6-4008-ab10-fc96bc1c21a3 None None] MFA Rules not processed for user `bbc8695722b84451a70eaa8343799d40`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:21.212568 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-2112152a-34e6-4008-ab10-fc96bc1c21a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:21.330514 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1020/2051] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:21 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:21.335749 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7b4aa-31f0-40fd-94a1-357875e0fd60 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:21.407997 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7b4aa-31f0-40fd-94a1-357875e0fd60 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:21.413308 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae19b5-2594-4bde-a0b4-bb2d71c114a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:21.413997 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae19b5-2594-4bde-a0b4-bb2d71c114a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:21.414268 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae19b5-2594-4bde-a0b4-bb2d71c114a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:21.414530 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae19b5-2594-4bde-a0b4-bb2d71c114a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:21.415293 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae19b5-2594-4bde-a0b4-bb2d71c114a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:21.417296 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae19b5-2594-4bde-a0b4-bb2d71c114a0 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:21.453067 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1032/2052] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:38:21 2021] POST /identity/v3/projects => generated 389 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:38:21.457982 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112152a-34e6-4008-ab10-fc96bc1c21a3 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:21.472069 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112152a-34e6-4008-ab10-fc96bc1c21a3 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:21.542184 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f628fc-c250-43aa-a223-802c1c14b9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:21.542912 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f628fc-c250-43aa-a223-802c1c14b9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:21.543298 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f628fc-c250-43aa-a223-802c1c14b9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:21.543674 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f628fc-c250-43aa-a223-802c1c14b9c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:21.544325 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f628fc-c250-43aa-a223-802c1c14b9c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:21.546671 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f628fc-c250-43aa-a223-802c1c14b9c9 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:21.571996 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1021/2053] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:38:21 2021] POST /identity/v3/users => generated 301 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:38:21.576630 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae19b5-2594-4bde-a0b4-bb2d71c114a0 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:21.587907 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae19b5-2594-4bde-a0b4-bb2d71c114a0 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:21.593161 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c327c6-7622-4693-97a6-02df83b42fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:21.593846 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c327c6-7622-4693-97a6-02df83b42fee admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:21.594163 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c327c6-7622-4693-97a6-02df83b42fee admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:21.594437 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c327c6-7622-4693-97a6-02df83b42fee admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:21.595328 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c327c6-7622-4693-97a6-02df83b42fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:21.597015 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c327c6-7622-4693-97a6-02df83b42fee admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:21.609263 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1033/2054] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:21 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:21.613886 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f628fc-c250-43aa-a223-802c1c14b9c9 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:21.625797 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f628fc-c250-43aa-a223-802c1c14b9c9 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:21.631246 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b1252-4ced-40f6-a0da-1465769ca9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:21.632869 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b1252-4ced-40f6-a0da-1465769ca9bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:21.633147 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b1252-4ced-40f6-a0da-1465769ca9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:21.633415 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b1252-4ced-40f6-a0da-1465769ca9bc admin admin] PATH_INFO: `/v3/projects/19bca1c8d6814af197afcf0b115b36f9/users/d1f1f707881048bd8b02bd372d96e1b5/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:21.652728 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b1252-4ced-40f6-a0da-1465769ca9bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=19bca1c8d6814af197afcf0b115b36f9, user_id=d1f1f707881048bd8b02bd372d96e1b5, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:21.655511 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b1252-4ced-40f6-a0da-1465769ca9bc admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:21.670521 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1022/2055] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:38:21 2021] PUT /identity/v3/projects/19bca1c8d6814af197afcf0b115b36f9/users/d1f1f707881048bd8b02bd372d96e1b5/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:38:21.674785 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c327c6-7622-4693-97a6-02df83b42fee admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:21.685547 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c327c6-7622-4693-97a6-02df83b42fee admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:21.748071 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90011b99-ed69-4305-a493-0749653a80cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:21.748806 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90011b99-ed69-4305-a493-0749653a80cd admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:21.749126 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90011b99-ed69-4305-a493-0749653a80cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:21.749372 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90011b99-ed69-4305-a493-0749653a80cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:21.750095 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90011b99-ed69-4305-a493-0749653a80cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:21.751777 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90011b99-ed69-4305-a493-0749653a80cd admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:21.763556 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1034/2056] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:21 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:38:21.768612 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b1252-4ced-40f6-a0da-1465769ca9bc admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:21.780899 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b1252-4ced-40f6-a0da-1465769ca9bc admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:21.786144 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a893a87-6713-4cc8-bb3d-c994d3fdf792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:21.787079 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a893a87-6713-4cc8-bb3d-c994d3fdf792 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:21.787365 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a893a87-6713-4cc8-bb3d-c994d3fdf792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:21.787664 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a893a87-6713-4cc8-bb3d-c994d3fdf792 admin admin] PATH_INFO: `/v3/projects/19bca1c8d6814af197afcf0b115b36f9/users/d1f1f707881048bd8b02bd372d96e1b5/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:21.789782 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a893a87-6713-4cc8-bb3d-c994d3fdf792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19bca1c8d6814af197afcf0b115b36f9, user_id=d1f1f707881048bd8b02bd372d96e1b5, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:21.803882 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a893a87-6713-4cc8-bb3d-c994d3fdf792 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:21.815916 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1023/2057] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:38:21 2021] PUT /identity/v3/projects/19bca1c8d6814af197afcf0b115b36f9/users/d1f1f707881048bd8b02bd372d96e1b5/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:21.829043 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c89ae-cc8a-4636-8a02-0bfac0c77d4b None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:21.829396 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c89ae-cc8a-4636-8a02-0bfac0c77d4b None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:21.829732 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c89ae-cc8a-4636-8a02-0bfac0c77d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:21.863199 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-b89c89ae-cc8a-4636-8a02-0bfac0c77d4b None None] MFA Rules not processed for user `d1f1f707881048bd8b02bd372d96e1b5`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:21.864290 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-b89c89ae-cc8a-4636-8a02-0bfac0c77d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:21.936906 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1035/2058] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:21 2021] POST /identity/v3/auth/tokens => generated 3476 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:21.947609 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a893a87-6713-4cc8-bb3d-c994d3fdf792 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:21.949597 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-6a893a87-6713-4cc8-bb3d-c994d3fdf792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:22.009149 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a893a87-6713-4cc8-bb3d-c994d3fdf792 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:22.013487 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075f1cf-481d-4b51-91be-7d46b5106635 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:22.014157 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075f1cf-481d-4b51-91be-7d46b5106635 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:22.014453 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075f1cf-481d-4b51-91be-7d46b5106635 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:22.014699 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075f1cf-481d-4b51-91be-7d46b5106635 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:22.024349 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075f1cf-481d-4b51-91be-7d46b5106635 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:22.025793 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075f1cf-481d-4b51-91be-7d46b5106635 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:22.035581 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1024/2059] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:21 2021] GET /identity/v3/auth/tokens => generated 3476 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:38:22.171860 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c89ae-cc8a-4636-8a02-0bfac0c77d4b None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:22.234768 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c89ae-cc8a-4636-8a02-0bfac0c77d4b None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:22.239564 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aedcf7-bdc2-465c-bff2-151e3fd620a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:22.240443 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aedcf7-bdc2-465c-bff2-151e3fd620a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:22.240718 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aedcf7-bdc2-465c-bff2-151e3fd620a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:22.240989 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aedcf7-bdc2-465c-bff2-151e3fd620a5 admin admin] PATH_INFO: `/v3/users/bbc8695722b84451a70eaa8343799d40` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:22.242220 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aedcf7-bdc2-465c-bff2-151e3fd620a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbc8695722b84451a70eaa8343799d40)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:22.244167 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aedcf7-bdc2-465c-bff2-151e3fd620a5 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:22.291591 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c2aedcf7-bdc2-465c-bff2-151e3fd620a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc8695722b84451a70eaa8343799d40'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:22.299940 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c2aedcf7-bdc2-465c-bff2-151e3fd620a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc8695722b84451a70eaa8343799d40'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:22.300566 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c2aedcf7-bdc2-465c-bff2-151e3fd620a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc8695722b84451a70eaa8343799d40'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:22.312618 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c2aedcf7-bdc2-465c-bff2-151e3fd620a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc8695722b84451a70eaa8343799d40'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:22.319368 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c2aedcf7-bdc2-465c-bff2-151e3fd620a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc8695722b84451a70eaa8343799d40'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:22.325191 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1036/2060] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:38:22 2021] DELETE /identity/v3/users/bbc8695722b84451a70eaa8343799d40 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:22.331363 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a8d70-513a-47dd-8ddd-32f264f717ba None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:22.331651 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a8d70-513a-47dd-8ddd-32f264f717ba None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:22.331926 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a8d70-513a-47dd-8ddd-32f264f717ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:22.351478 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-782a8d70-513a-47dd-8ddd-32f264f717ba None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:22.352686 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-782a8d70-513a-47dd-8ddd-32f264f717ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:22.448992 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1025/2061] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:22.468467 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aedcf7-bdc2-465c-bff2-151e3fd620a5 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:22.470389 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-c2aedcf7-bdc2-465c-bff2-151e3fd620a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:22.535935 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aedcf7-bdc2-465c-bff2-151e3fd620a5 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:22.539643 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e7555-a256-4f41-b262-7abd6b520122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:22.540348 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e7555-a256-4f41-b262-7abd6b520122 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:22.540729 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e7555-a256-4f41-b262-7abd6b520122 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:22.541006 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e7555-a256-4f41-b262-7abd6b520122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:22.550800 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e7555-a256-4f41-b262-7abd6b520122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:22.552226 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e7555-a256-4f41-b262-7abd6b520122 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:22.561840 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1037/2062] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:38:22.835982 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a8d70-513a-47dd-8ddd-32f264f717ba None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:22.837459 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-782a8d70-513a-47dd-8ddd-32f264f717ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:22.849374 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a8d70-513a-47dd-8ddd-32f264f717ba None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:22.864955 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91b7a8-f458-40e1-a441-1841e678ed34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:22.865845 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91b7a8-f458-40e1-a441-1841e678ed34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:22.866125 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91b7a8-f458-40e1-a441-1841e678ed34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:22.866478 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91b7a8-f458-40e1-a441-1841e678ed34 admin admin] PATH_INFO: `/v3/projects/9247389f25c84a78a005102065e0bd6f` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:22.867672 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91b7a8-f458-40e1-a441-1841e678ed34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9247389f25c84a78a005102065e0bd6f)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:22.869694 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91b7a8-f458-40e1-a441-1841e678ed34 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:22.927833 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ed91b7a8-f458-40e1-a441-1841e678ed34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9247389f25c84a78a005102065e0bd6f', 'request_id': 'req-ed91b7a8-f458-40e1-a441-1841e678ed34'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:22.934872 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ed91b7a8-f458-40e1-a441-1841e678ed34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9247389f25c84a78a005102065e0bd6f', 'request_id': 'req-ed91b7a8-f458-40e1-a441-1841e678ed34'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:22.944653 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ed91b7a8-f458-40e1-a441-1841e678ed34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9247389f25c84a78a005102065e0bd6f', 'request_id': 'req-ed91b7a8-f458-40e1-a441-1841e678ed34'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:22.957805 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ed91b7a8-f458-40e1-a441-1841e678ed34 admin admin] The token cache is being invalidate because project 9247389f25c84a78a005102065e0bd6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:38:22.958184 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ed91b7a8-f458-40e1-a441-1841e678ed34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:22.959015 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ed91b7a8-f458-40e1-a441-1841e678ed34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:22.961138 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1026/2063] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:38:22 2021] DELETE /identity/v3/projects/9247389f25c84a78a005102065e0bd6f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:22.965401 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e7555-a256-4f41-b262-7abd6b520122 service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:22.978412 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e7555-a256-4f41-b262-7abd6b520122 service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:23.042022 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132c087-26f1-4076-a4b2-7b9875d88b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:23.043079 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132c087-26f1-4076-a4b2-7b9875d88b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:23.043422 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132c087-26f1-4076-a4b2-7b9875d88b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:23.043757 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132c087-26f1-4076-a4b2-7b9875d88b98 admin admin] PATH_INFO: `/v3/users/d1f1f707881048bd8b02bd372d96e1b5` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:23.045718 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132c087-26f1-4076-a4b2-7b9875d88b98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1f1f707881048bd8b02bd372d96e1b5)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:23.047640 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132c087-26f1-4076-a4b2-7b9875d88b98 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:23.097987 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-5132c087-26f1-4076-a4b2-7b9875d88b98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1f1f707881048bd8b02bd372d96e1b5'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:23.106798 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-5132c087-26f1-4076-a4b2-7b9875d88b98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1f1f707881048bd8b02bd372d96e1b5'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:23.107669 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-5132c087-26f1-4076-a4b2-7b9875d88b98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1f1f707881048bd8b02bd372d96e1b5'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:23.120216 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-5132c087-26f1-4076-a4b2-7b9875d88b98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1f1f707881048bd8b02bd372d96e1b5'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:23.128654 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-5132c087-26f1-4076-a4b2-7b9875d88b98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1f1f707881048bd8b02bd372d96e1b5'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:23.136470 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1038/2064] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:38:22 2021] DELETE /identity/v3/users/d1f1f707881048bd8b02bd372d96e1b5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:23.558848 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91b7a8-f458-40e1-a441-1841e678ed34 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:23.560276 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-ed91b7a8-f458-40e1-a441-1841e678ed34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:23.579352 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91b7a8-f458-40e1-a441-1841e678ed34 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:23.656654 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c51b4c-3b6b-4f10-8c1e-4f07746ed161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:23.657835 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c51b4c-3b6b-4f10-8c1e-4f07746ed161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:23.658123 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c51b4c-3b6b-4f10-8c1e-4f07746ed161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:23.658392 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c51b4c-3b6b-4f10-8c1e-4f07746ed161 admin admin] PATH_INFO: `/v3/projects/19bca1c8d6814af197afcf0b115b36f9` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:23.659801 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c51b4c-3b6b-4f10-8c1e-4f07746ed161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19bca1c8d6814af197afcf0b115b36f9)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:23.661810 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c51b4c-3b6b-4f10-8c1e-4f07746ed161 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:23.719519 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-10c51b4c-3b6b-4f10-8c1e-4f07746ed161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19bca1c8d6814af197afcf0b115b36f9', 'request_id': 'req-10c51b4c-3b6b-4f10-8c1e-4f07746ed161'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:23.726854 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-10c51b4c-3b6b-4f10-8c1e-4f07746ed161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19bca1c8d6814af197afcf0b115b36f9', 'request_id': 'req-10c51b4c-3b6b-4f10-8c1e-4f07746ed161'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:23.736432 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-10c51b4c-3b6b-4f10-8c1e-4f07746ed161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19bca1c8d6814af197afcf0b115b36f9', 'request_id': 'req-10c51b4c-3b6b-4f10-8c1e-4f07746ed161'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:23.756152 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-10c51b4c-3b6b-4f10-8c1e-4f07746ed161 admin admin] The token cache is being invalidate because project 19bca1c8d6814af197afcf0b115b36f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:38:23.756923 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-10c51b4c-3b6b-4f10-8c1e-4f07746ed161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:23.759242 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-10c51b4c-3b6b-4f10-8c1e-4f07746ed161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:23.762091 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1027/2065] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:38:23 2021] DELETE /identity/v3/projects/19bca1c8d6814af197afcf0b115b36f9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:23.768578 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be2b57-0bb2-4e7b-befe-d9b8ee6b5e5b None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:23.769458 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be2b57-0bb2-4e7b-befe-d9b8ee6b5e5b None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:23.769929 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be2b57-0bb2-4e7b-befe-d9b8ee6b5e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:23.797031 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-14be2b57-0bb2-4e7b-befe-d9b8ee6b5e5b None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:23.799009 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-14be2b57-0bb2-4e7b-befe-d9b8ee6b5e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:23.866837 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1039/2066] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:38:23.873437 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8758c8-ed88-4fd2-93ac-fa915eb0a7d1 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:23.873896 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8758c8-ed88-4fd2-93ac-fa915eb0a7d1 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:23.874038 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8758c8-ed88-4fd2-93ac-fa915eb0a7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:23.930722 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-db8758c8-ed88-4fd2-93ac-fa915eb0a7d1 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:23.932583 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-db8758c8-ed88-4fd2-93ac-fa915eb0a7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:23.941962 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1028/2067] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:38:23.946368 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be2b57-0bb2-4e7b-befe-d9b8ee6b5e5b None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:23.957106 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be2b57-0bb2-4e7b-befe-d9b8ee6b5e5b None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:23.965097 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eb1b9-78b7-4b6b-ba7f-e2205508cd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:23.965980 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eb1b9-78b7-4b6b-ba7f-e2205508cd84 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:23.967056 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eb1b9-78b7-4b6b-ba7f-e2205508cd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:23.967351 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eb1b9-78b7-4b6b-ba7f-e2205508cd84 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:23.968137 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4eb1b9-78b7-4b6b-ba7f-e2205508cd84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:38:23.968572 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4eb1b9-78b7-4b6b-ba7f-e2205508cd84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:23.970436 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4eb1b9-78b7-4b6b-ba7f-e2205508cd84 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:23.984341 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1040/2068] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:38:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:38:23.988787 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8758c8-ed88-4fd2-93ac-fa915eb0a7d1 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:23.999001 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8758c8-ed88-4fd2-93ac-fa915eb0a7d1 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:24.008237 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75fbcb-a733-4bf5-96f2-67eed673f9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:24.008968 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75fbcb-a733-4bf5-96f2-67eed673f9aa admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:24.009237 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75fbcb-a733-4bf5-96f2-67eed673f9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:24.009506 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75fbcb-a733-4bf5-96f2-67eed673f9aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:24.010219 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75fbcb-a733-4bf5-96f2-67eed673f9aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:24.012160 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75fbcb-a733-4bf5-96f2-67eed673f9aa admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:24.039856 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1029/2069] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:38:23 2021] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:38:24.044365 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eb1b9-78b7-4b6b-ba7f-e2205508cd84 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:24.054793 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eb1b9-78b7-4b6b-ba7f-e2205508cd84 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:24.115202 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b05594-dfd6-4b58-bddd-06e1d632d094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:24.115720 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b05594-dfd6-4b58-bddd-06e1d632d094 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:24.115838 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b05594-dfd6-4b58-bddd-06e1d632d094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:24.116112 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b05594-dfd6-4b58-bddd-06e1d632d094 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:24.116917 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b05594-dfd6-4b58-bddd-06e1d632d094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:24.118724 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b05594-dfd6-4b58-bddd-06e1d632d094 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:24.140208 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1041/2070] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:38:24 2021] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:38:24.144393 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75fbcb-a733-4bf5-96f2-67eed673f9aa admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:24.155472 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75fbcb-a733-4bf5-96f2-67eed673f9aa admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:24.162278 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a0223-5a89-4549-a3ec-07032564b343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:24.163009 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a0223-5a89-4549-a3ec-07032564b343 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:24.163290 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a0223-5a89-4549-a3ec-07032564b343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:24.163562 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a0223-5a89-4549-a3ec-07032564b343 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:24.164313 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a0223-5a89-4549-a3ec-07032564b343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:24.165941 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a0223-5a89-4549-a3ec-07032564b343 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:24.179452 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1030/2071] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:24 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:24.183918 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b05594-dfd6-4b58-bddd-06e1d632d094 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:24.194871 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b05594-dfd6-4b58-bddd-06e1d632d094 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:24.200256 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e114347-b241-407a-9651-42ba961e4ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:24.201097 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e114347-b241-407a-9651-42ba961e4ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:24.201375 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e114347-b241-407a-9651-42ba961e4ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:24.201645 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e114347-b241-407a-9651-42ba961e4ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:24.202443 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e114347-b241-407a-9651-42ba961e4ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:24.204105 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e114347-b241-407a-9651-42ba961e4ad8 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:24.217875 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1042/2072] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:24 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:24.219147 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a0223-5a89-4549-a3ec-07032564b343 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:24.229457 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a0223-5a89-4549-a3ec-07032564b343 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:24.234352 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc7934-dca4-41e6-b6c4-b0a9777c0b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:24.236087 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc7934-dca4-41e6-b6c4-b0a9777c0b70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:24.236087 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc7934-dca4-41e6-b6c4-b0a9777c0b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:24.236087 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc7934-dca4-41e6-b6c4-b0a9777c0b70 admin admin] PATH_INFO: `/v3/projects/8bbbfe0b79544106b827fc37eaa69bfd/users/d6a917be809946de8a1f58fb9a58762c/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:24.258946 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc7934-dca4-41e6-b6c4-b0a9777c0b70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bbbfe0b79544106b827fc37eaa69bfd, user_id=d6a917be809946de8a1f58fb9a58762c, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:24.262811 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc7934-dca4-41e6-b6c4-b0a9777c0b70 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:24.282908 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1031/2073] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:38:24 2021] PUT /identity/v3/projects/8bbbfe0b79544106b827fc37eaa69bfd/users/d6a917be809946de8a1f58fb9a58762c/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:24.293808 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65cfe1-9015-453c-95a8-2f0d42a36c71 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:24.294139 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65cfe1-9015-453c-95a8-2f0d42a36c71 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:24.294925 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65cfe1-9015-453c-95a8-2f0d42a36c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:24.327936 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-4e65cfe1-9015-453c-95a8-2f0d42a36c71 None None] MFA Rules not processed for user `d6a917be809946de8a1f58fb9a58762c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:24.329170 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-4e65cfe1-9015-453c-95a8-2f0d42a36c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:24.392054 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1043/2074] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:24 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:24.402223 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc7934-dca4-41e6-b6c4-b0a9777c0b70 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:24.404116 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-27fc7934-dca4-41e6-b6c4-b0a9777c0b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:24.460152 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc7934-dca4-41e6-b6c4-b0a9777c0b70 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:24.463994 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fedbc9f-1b1b-4db6-b528-cf744abb3946 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:24.464655 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedbc9f-1b1b-4db6-b528-cf744abb3946 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:24.464932 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedbc9f-1b1b-4db6-b528-cf744abb3946 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:24.465208 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedbc9f-1b1b-4db6-b528-cf744abb3946 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:24.478516 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fedbc9f-1b1b-4db6-b528-cf744abb3946 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:24.479832 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fedbc9f-1b1b-4db6-b528-cf744abb3946 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:24.490374 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1032/2075] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:24 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:38:29.714855 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65cfe1-9015-453c-95a8-2f0d42a36c71 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:29.716363 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-4e65cfe1-9015-453c-95a8-2f0d42a36c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:29.781085 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65cfe1-9015-453c-95a8-2f0d42a36c71 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:29.785824 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b43bf-38df-4a50-971a-6132fef03d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:29.786716 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b43bf-38df-4a50-971a-6132fef03d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:29.787014 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b43bf-38df-4a50-971a-6132fef03d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:29.787285 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b43bf-38df-4a50-971a-6132fef03d33 admin admin] PATH_INFO: `/v3/users/1ab41fd50c304e16be64ca907231bc44` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:29.788481 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b43bf-38df-4a50-971a-6132fef03d33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ab41fd50c304e16be64ca907231bc44)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:29.790453 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b43bf-38df-4a50-971a-6132fef03d33 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:29.840431 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-d47b43bf-38df-4a50-971a-6132fef03d33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ab41fd50c304e16be64ca907231bc44'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:29.848982 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-d47b43bf-38df-4a50-971a-6132fef03d33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ab41fd50c304e16be64ca907231bc44'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:29.849619 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-d47b43bf-38df-4a50-971a-6132fef03d33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ab41fd50c304e16be64ca907231bc44'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:29.861569 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-d47b43bf-38df-4a50-971a-6132fef03d33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ab41fd50c304e16be64ca907231bc44'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:29.868193 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-d47b43bf-38df-4a50-971a-6132fef03d33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ab41fd50c304e16be64ca907231bc44'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:29.874302 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1044/2076] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:38:29 2021] DELETE /identity/v3/users/1ab41fd50c304e16be64ca907231bc44 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:29.878994 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c99e9d-fcd1-447f-9363-b59481999654 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:29.879494 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c99e9d-fcd1-447f-9363-b59481999654 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:29.879586 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c99e9d-fcd1-447f-9363-b59481999654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:29.898256 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-95c99e9d-fcd1-447f-9363-b59481999654 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:29.899513 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-95c99e9d-fcd1-447f-9363-b59481999654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:29.968627 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1033/2077] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:29.978916 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b43bf-38df-4a50-971a-6132fef03d33 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:29.980472 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-d47b43bf-38df-4a50-971a-6132fef03d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:30.036580 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b43bf-38df-4a50-971a-6132fef03d33 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:30.040302 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7df6c8-1d53-4ab8-9069-1777f9157877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:30.041005 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7df6c8-1d53-4ab8-9069-1777f9157877 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:30.041223 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7df6c8-1d53-4ab8-9069-1777f9157877 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:30.041492 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7df6c8-1d53-4ab8-9069-1777f9157877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:30.051173 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7df6c8-1d53-4ab8-9069-1777f9157877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:30.052713 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7df6c8-1d53-4ab8-9069-1777f9157877 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:30.062274 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1045/2078] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:38:30.342852 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c99e9d-fcd1-447f-9363-b59481999654 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:30.344362 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-95c99e9d-fcd1-447f-9363-b59481999654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:30.360164 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c99e9d-fcd1-447f-9363-b59481999654 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:30.365111 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e55c74-ac08-4eb1-a224-4d37b82384d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:30.366007 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e55c74-ac08-4eb1-a224-4d37b82384d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:30.366290 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e55c74-ac08-4eb1-a224-4d37b82384d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:30.366558 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e55c74-ac08-4eb1-a224-4d37b82384d2 admin admin] PATH_INFO: `/v3/projects/924e2436414c43c285113fa2416439f1` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:30.367793 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e55c74-ac08-4eb1-a224-4d37b82384d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=924e2436414c43c285113fa2416439f1)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:30.370939 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e55c74-ac08-4eb1-a224-4d37b82384d2 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:30.436800 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-77e55c74-ac08-4eb1-a224-4d37b82384d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '924e2436414c43c285113fa2416439f1', 'request_id': 'req-77e55c74-ac08-4eb1-a224-4d37b82384d2'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:30.443115 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-77e55c74-ac08-4eb1-a224-4d37b82384d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '924e2436414c43c285113fa2416439f1', 'request_id': 'req-77e55c74-ac08-4eb1-a224-4d37b82384d2'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:30.451056 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-77e55c74-ac08-4eb1-a224-4d37b82384d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '924e2436414c43c285113fa2416439f1', 'request_id': 'req-77e55c74-ac08-4eb1-a224-4d37b82384d2'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:30.461580 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-77e55c74-ac08-4eb1-a224-4d37b82384d2 admin admin] The token cache is being invalidate because project 924e2436414c43c285113fa2416439f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:38:30.461867 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-77e55c74-ac08-4eb1-a224-4d37b82384d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:30.462553 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-77e55c74-ac08-4eb1-a224-4d37b82384d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:30.464579 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1034/2079] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:38:30 2021] DELETE /identity/v3/projects/924e2436414c43c285113fa2416439f1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:30.472151 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75975fd1-8dd0-46a7-be43-6cdd117b3988 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:30.472585 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75975fd1-8dd0-46a7-be43-6cdd117b3988 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:30.472957 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75975fd1-8dd0-46a7-be43-6cdd117b3988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:30.490501 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-75975fd1-8dd0-46a7-be43-6cdd117b3988 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:30.491713 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-75975fd1-8dd0-46a7-be43-6cdd117b3988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:30.557635 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1046/2080] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:30.566053 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6c199-a3a3-4705-a4c3-279339a92783 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:30.566342 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6c199-a3a3-4705-a4c3-279339a92783 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:30.566620 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6c199-a3a3-4705-a4c3-279339a92783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:30.585566 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-8ce6c199-a3a3-4705-a4c3-279339a92783 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:30.586867 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-8ce6c199-a3a3-4705-a4c3-279339a92783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:30.595595 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1035/2081] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:30.599868 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75975fd1-8dd0-46a7-be43-6cdd117b3988 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:30.610545 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75975fd1-8dd0-46a7-be43-6cdd117b3988 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:30.614544 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dc39a-6a6a-45e8-a2d2-0ffb05743ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:30.615248 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dc39a-6a6a-45e8-a2d2-0ffb05743ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:30.615573 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dc39a-6a6a-45e8-a2d2-0ffb05743ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:30.615847 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dc39a-6a6a-45e8-a2d2-0ffb05743ea5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:30.616716 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1dc39a-6a6a-45e8-a2d2-0ffb05743ea5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:38:30.617023 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1dc39a-6a6a-45e8-a2d2-0ffb05743ea5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:30.618664 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1dc39a-6a6a-45e8-a2d2-0ffb05743ea5 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:30.635165 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1047/2082] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:38:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:38:30.636355 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6c199-a3a3-4705-a4c3-279339a92783 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:30.645829 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6c199-a3a3-4705-a4c3-279339a92783 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:30.650484 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f8ca2-8bbb-44a2-b80b-2350654b38bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:30.651200 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f8ca2-8bbb-44a2-b80b-2350654b38bb admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:30.651484 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f8ca2-8bbb-44a2-b80b-2350654b38bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:30.651757 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f8ca2-8bbb-44a2-b80b-2350654b38bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:30.652485 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f8ca2-8bbb-44a2-b80b-2350654b38bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:30.654425 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f8ca2-8bbb-44a2-b80b-2350654b38bb admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:30.680511 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1036/2083] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:38:30 2021] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:38:30.684754 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dc39a-6a6a-45e8-a2d2-0ffb05743ea5 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:30.695329 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dc39a-6a6a-45e8-a2d2-0ffb05743ea5 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:30.754913 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86c589-8cc1-4430-8d06-77726b8020c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:30.756926 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86c589-8cc1-4430-8d06-77726b8020c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:30.756926 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86c589-8cc1-4430-8d06-77726b8020c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:30.756926 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86c589-8cc1-4430-8d06-77726b8020c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:30.756926 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86c589-8cc1-4430-8d06-77726b8020c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:30.759296 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86c589-8cc1-4430-8d06-77726b8020c9 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:30.782599 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1048/2084] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:38:30 2021] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:38:30.786966 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f8ca2-8bbb-44a2-b80b-2350654b38bb admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:30.800498 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f8ca2-8bbb-44a2-b80b-2350654b38bb admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:30.806117 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533986c-5ad7-4ca9-b86b-2785ac2e923c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:30.806839 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533986c-5ad7-4ca9-b86b-2785ac2e923c admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:30.807123 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533986c-5ad7-4ca9-b86b-2785ac2e923c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:30.807398 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533986c-5ad7-4ca9-b86b-2785ac2e923c admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:30.808161 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533986c-5ad7-4ca9-b86b-2785ac2e923c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:30.809780 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533986c-5ad7-4ca9-b86b-2785ac2e923c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:30.821188 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1037/2085] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:30 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:30.825422 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86c589-8cc1-4430-8d06-77726b8020c9 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:30.835470 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86c589-8cc1-4430-8d06-77726b8020c9 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:30.840108 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ece943-17c1-41ce-bac2-9ac7b3760802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:30.840901 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ece943-17c1-41ce-bac2-9ac7b3760802 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:30.841251 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ece943-17c1-41ce-bac2-9ac7b3760802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:30.841589 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ece943-17c1-41ce-bac2-9ac7b3760802 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:30.842394 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ece943-17c1-41ce-bac2-9ac7b3760802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:30.844059 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ece943-17c1-41ce-bac2-9ac7b3760802 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:30.854231 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1049/2086] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:30 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:30.858645 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533986c-5ad7-4ca9-b86b-2785ac2e923c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:30.868819 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533986c-5ad7-4ca9-b86b-2785ac2e923c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:30.873462 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d082da7-f4f4-4872-ac69-009209a7fb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:30.874346 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d082da7-f4f4-4872-ac69-009209a7fb9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:30.874626 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d082da7-f4f4-4872-ac69-009209a7fb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:30.874991 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d082da7-f4f4-4872-ac69-009209a7fb9c admin admin] PATH_INFO: `/v3/projects/d01a3a6c2c414e748310e71eff4f49ee/users/07ef79146e214281b64e8eafeb30754a/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:30.892168 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d082da7-f4f4-4872-ac69-009209a7fb9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d01a3a6c2c414e748310e71eff4f49ee, user_id=07ef79146e214281b64e8eafeb30754a, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:30.894883 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d082da7-f4f4-4872-ac69-009209a7fb9c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:30.910198 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1038/2087] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:38:30 2021] PUT /identity/v3/projects/d01a3a6c2c414e748310e71eff4f49ee/users/07ef79146e214281b64e8eafeb30754a/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:30.922215 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2cfbe-e670-49d0-af22-cab46e2c3a12 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:30.922628 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2cfbe-e670-49d0-af22-cab46e2c3a12 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:30.922946 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2cfbe-e670-49d0-af22-cab46e2c3a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:30.952181 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-89f2cfbe-e670-49d0-af22-cab46e2c3a12 None None] MFA Rules not processed for user `07ef79146e214281b64e8eafeb30754a`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:30.953418 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-89f2cfbe-e670-49d0-af22-cab46e2c3a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:31.019561 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1050/2088] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:30 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:31.024354 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d082da7-f4f4-4872-ac69-009209a7fb9c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:31.089288 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d082da7-f4f4-4872-ac69-009209a7fb9c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:31.094367 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d3be9-860d-4f24-a1e9-b86536402d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:31.095071 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d3be9-860d-4f24-a1e9-b86536402d1f admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:31.095468 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d3be9-860d-4f24-a1e9-b86536402d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:31.095741 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d3be9-860d-4f24-a1e9-b86536402d1f admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:31.096457 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d3be9-860d-4f24-a1e9-b86536402d1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:31.098349 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d3be9-860d-4f24-a1e9-b86536402d1f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:31.128049 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1039/2089] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:38:31 2021] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:38:31.129252 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2cfbe-e670-49d0-af22-cab46e2c3a12 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:31.139835 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2cfbe-e670-49d0-af22-cab46e2c3a12 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:31.199999 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420478fd-3949-43ef-b2e2-af2b65dcf5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:31.200742 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420478fd-3949-43ef-b2e2-af2b65dcf5bf admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:31.201023 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420478fd-3949-43ef-b2e2-af2b65dcf5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:31.201282 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420478fd-3949-43ef-b2e2-af2b65dcf5bf admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:31.202071 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420478fd-3949-43ef-b2e2-af2b65dcf5bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:31.204066 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420478fd-3949-43ef-b2e2-af2b65dcf5bf admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:31.229840 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1051/2090] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:38:31 2021] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:38:31.235724 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d3be9-860d-4f24-a1e9-b86536402d1f admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:31.248590 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d3be9-860d-4f24-a1e9-b86536402d1f admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:31.254096 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5db53-d6e2-4656-b41b-f56c493a19a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:31.254786 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5db53-d6e2-4656-b41b-f56c493a19a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:31.255065 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5db53-d6e2-4656-b41b-f56c493a19a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:31.255337 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5db53-d6e2-4656-b41b-f56c493a19a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:31.256081 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5db53-d6e2-4656-b41b-f56c493a19a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:31.257674 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5db53-d6e2-4656-b41b-f56c493a19a4 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:31.270397 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1040/2091] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:31 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:31.276510 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420478fd-3949-43ef-b2e2-af2b65dcf5bf admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:31.289295 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420478fd-3949-43ef-b2e2-af2b65dcf5bf admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:31.296017 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b860a-aeb3-4260-a84b-f397760fb438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:31.296678 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b860a-aeb3-4260-a84b-f397760fb438 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:31.297016 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b860a-aeb3-4260-a84b-f397760fb438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:31.297330 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b860a-aeb3-4260-a84b-f397760fb438 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:31.298357 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b860a-aeb3-4260-a84b-f397760fb438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:31.300067 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b860a-aeb3-4260-a84b-f397760fb438 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:31.311588 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1052/2092] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:31 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:31.315817 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5db53-d6e2-4656-b41b-f56c493a19a4 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:31.325753 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5db53-d6e2-4656-b41b-f56c493a19a4 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:31.331329 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867919b-7c1b-43df-97a6-d1b617ef23a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:31.332274 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867919b-7c1b-43df-97a6-d1b617ef23a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:31.332697 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867919b-7c1b-43df-97a6-d1b617ef23a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:31.333028 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867919b-7c1b-43df-97a6-d1b617ef23a7 admin admin] PATH_INFO: `/v3/projects/7f45a84c6d654ed48c25f210bd28ad31/users/e258a6d0a66542e0925053e926a221fc/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:31.348539 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867919b-7c1b-43df-97a6-d1b617ef23a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f45a84c6d654ed48c25f210bd28ad31, user_id=e258a6d0a66542e0925053e926a221fc, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:31.351203 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867919b-7c1b-43df-97a6-d1b617ef23a7 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:31.365842 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1041/2093] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:38:31 2021] PUT /identity/v3/projects/7f45a84c6d654ed48c25f210bd28ad31/users/e258a6d0a66542e0925053e926a221fc/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:31.376153 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16751e1-9f69-4dba-b753-8be32cf6388f None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:31.376443 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16751e1-9f69-4dba-b753-8be32cf6388f None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:31.376685 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16751e1-9f69-4dba-b753-8be32cf6388f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:31.404041 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-c16751e1-9f69-4dba-b753-8be32cf6388f None None] MFA Rules not processed for user `e258a6d0a66542e0925053e926a221fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:31.405235 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-c16751e1-9f69-4dba-b753-8be32cf6388f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:31.469876 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1053/2094] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:31 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:31.474827 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867919b-7c1b-43df-97a6-d1b617ef23a7 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:31.538222 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867919b-7c1b-43df-97a6-d1b617ef23a7 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:31.543586 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be1a66-88b5-4f7f-9dab-7e0cf3c39a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:31.544261 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be1a66-88b5-4f7f-9dab-7e0cf3c39a93 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:31.544865 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be1a66-88b5-4f7f-9dab-7e0cf3c39a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:31.545162 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be1a66-88b5-4f7f-9dab-7e0cf3c39a93 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:31.545866 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be1a66-88b5-4f7f-9dab-7e0cf3c39a93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:31.547901 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be1a66-88b5-4f7f-9dab-7e0cf3c39a93 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:31.574713 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1042/2095] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:38:31 2021] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:38:31.579083 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16751e1-9f69-4dba-b753-8be32cf6388f None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:31.590368 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16751e1-9f69-4dba-b753-8be32cf6388f None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:31.646205 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa607ef-67d2-45e3-8002-1c221b7f027c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:31.646903 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa607ef-67d2-45e3-8002-1c221b7f027c admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:31.647176 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa607ef-67d2-45e3-8002-1c221b7f027c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:31.647441 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa607ef-67d2-45e3-8002-1c221b7f027c admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:31.648134 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa607ef-67d2-45e3-8002-1c221b7f027c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:31.650024 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa607ef-67d2-45e3-8002-1c221b7f027c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:31.673311 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1054/2096] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:38:31 2021] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:38:31.678055 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be1a66-88b5-4f7f-9dab-7e0cf3c39a93 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:31.692039 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be1a66-88b5-4f7f-9dab-7e0cf3c39a93 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:31.697561 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce43165-0306-4515-9886-e72ee71ab9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:31.698254 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce43165-0306-4515-9886-e72ee71ab9ed admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:31.698529 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce43165-0306-4515-9886-e72ee71ab9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:31.698827 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce43165-0306-4515-9886-e72ee71ab9ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:31.699954 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce43165-0306-4515-9886-e72ee71ab9ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:31.701569 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce43165-0306-4515-9886-e72ee71ab9ed admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:31.713525 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1043/2097] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:31 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:38:31.717826 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa607ef-67d2-45e3-8002-1c221b7f027c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:31.728535 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa607ef-67d2-45e3-8002-1c221b7f027c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:31.733505 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd6841-8698-4737-b6d1-42a1bb8a4291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:31.734400 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd6841-8698-4737-b6d1-42a1bb8a4291 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:31.734671 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd6841-8698-4737-b6d1-42a1bb8a4291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:31.734974 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd6841-8698-4737-b6d1-42a1bb8a4291 admin admin] PATH_INFO: `/v3/projects/2d9c39ed7aed44b58f1707a92d66e3ea/users/996311433c8e441eb1dbfd60d84bb523/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:31.751425 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd6841-8698-4737-b6d1-42a1bb8a4291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d9c39ed7aed44b58f1707a92d66e3ea, user_id=996311433c8e441eb1dbfd60d84bb523, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:31.754110 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd6841-8698-4737-b6d1-42a1bb8a4291 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:31.768381 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1055/2098] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:38:31 2021] PUT /identity/v3/projects/2d9c39ed7aed44b58f1707a92d66e3ea/users/996311433c8e441eb1dbfd60d84bb523/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:31.773650 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce43165-0306-4515-9886-e72ee71ab9ed admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:31.783519 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce43165-0306-4515-9886-e72ee71ab9ed admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:31.838821 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432ed29-15f9-4553-9862-09359ba21fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:31.839387 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432ed29-15f9-4553-9862-09359ba21fbf admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:31.839663 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432ed29-15f9-4553-9862-09359ba21fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:31.839925 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432ed29-15f9-4553-9862-09359ba21fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:31.840664 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432ed29-15f9-4553-9862-09359ba21fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:31.842243 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432ed29-15f9-4553-9862-09359ba21fbf admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:31.852100 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1044/2099] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:31 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:31.858532 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd6841-8698-4737-b6d1-42a1bb8a4291 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:31.875966 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd6841-8698-4737-b6d1-42a1bb8a4291 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:31.882618 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c466669-8da0-43ad-bee4-e78d7bf315d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:31.883961 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c466669-8da0-43ad-bee4-e78d7bf315d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:31.884299 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c466669-8da0-43ad-bee4-e78d7bf315d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:31.884675 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c466669-8da0-43ad-bee4-e78d7bf315d1 admin admin] PATH_INFO: `/v3/projects/2d9c39ed7aed44b58f1707a92d66e3ea/users/996311433c8e441eb1dbfd60d84bb523/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:31.887997 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c466669-8da0-43ad-bee4-e78d7bf315d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d9c39ed7aed44b58f1707a92d66e3ea, user_id=996311433c8e441eb1dbfd60d84bb523, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:31.892447 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c466669-8da0-43ad-bee4-e78d7bf315d1 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:31.906988 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1056/2100] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:38:31 2021] PUT /identity/v3/projects/2d9c39ed7aed44b58f1707a92d66e3ea/users/996311433c8e441eb1dbfd60d84bb523/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:31.917184 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbd0ef-39b0-4224-b276-da63080a82fb None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:31.917579 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbd0ef-39b0-4224-b276-da63080a82fb None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:31.917731 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbd0ef-39b0-4224-b276-da63080a82fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:31.944677 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-d0dbd0ef-39b0-4224-b276-da63080a82fb None None] MFA Rules not processed for user `996311433c8e441eb1dbfd60d84bb523`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:31.945877 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-d0dbd0ef-39b0-4224-b276-da63080a82fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:32.017103 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1045/2101] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:31 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:32.031923 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c466669-8da0-43ad-bee4-e78d7bf315d1 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:32.033936 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-3c466669-8da0-43ad-bee4-e78d7bf315d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:32.091624 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c466669-8da0-43ad-bee4-e78d7bf315d1 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:32.095405 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b28b5e-8ac5-460b-9898-d9ef43551e1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:32.096046 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b28b5e-8ac5-460b-9898-d9ef43551e1c service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:32.096325 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b28b5e-8ac5-460b-9898-d9ef43551e1c service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:32.096596 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b28b5e-8ac5-460b-9898-d9ef43551e1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:32.105600 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b28b5e-8ac5-460b-9898-d9ef43551e1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:32.107079 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b28b5e-8ac5-460b-9898-d9ef43551e1c service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:32.116354 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1057/2102] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:32 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:38:32.589253 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbd0ef-39b0-4224-b276-da63080a82fb None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:32.591631 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-d0dbd0ef-39b0-4224-b276-da63080a82fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:32.605915 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbd0ef-39b0-4224-b276-da63080a82fb None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:32.609805 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e0d8b-20ee-47f9-b6fc-847e2d6df35e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:32.610463 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e0d8b-20ee-47f9-b6fc-847e2d6df35e service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:32.610770 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e0d8b-20ee-47f9-b6fc-847e2d6df35e service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:32.611026 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e0d8b-20ee-47f9-b6fc-847e2d6df35e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:32.674994 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e0d8b-20ee-47f9-b6fc-847e2d6df35e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:32.676448 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e0d8b-20ee-47f9-b6fc-847e2d6df35e service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:32.685841 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1046/2103] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:32 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:38:40.886270 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b28b5e-8ac5-460b-9898-d9ef43551e1c service cinder] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:40.895249 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b28b5e-8ac5-460b-9898-d9ef43551e1c service cinder] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:40.898866 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e5022-dd3e-46f3-8c55-ac22b4f846f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:40.899510 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e5022-dd3e-46f3-8c55-ac22b4f846f8 service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:40.899787 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e5022-dd3e-46f3-8c55-ac22b4f846f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:40.900248 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e5022-dd3e-46f3-8c55-ac22b4f846f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:40.963901 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e5022-dd3e-46f3-8c55-ac22b4f846f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:40.965436 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e5022-dd3e-46f3-8c55-ac22b4f846f8 service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:40.977066 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1058/2104] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:40 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:38:41.893008 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbf9f5-a9eb-4723-9178-fc2f45a2d71b None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:41.893488 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbf9f5-a9eb-4723-9178-fc2f45a2d71b None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:41.893696 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbf9f5-a9eb-4723-9178-fc2f45a2d71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:41.926610 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-13cbf9f5-a9eb-4723-9178-fc2f45a2d71b None None] MFA Rules not processed for user `62cc0165aee14b449c8a49233001f631`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:41.927829 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-13cbf9f5-a9eb-4723-9178-fc2f45a2d71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:41.985277 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1047/2105] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Oct 28 14:38:41 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:42.040639 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e5022-dd3e-46f3-8c55-ac22b4f846f8 service cinder] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:42.042059 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a73e5022-dd3e-46f3-8c55-ac22b4f846f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:42.113813 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e5022-dd3e-46f3-8c55-ac22b4f846f8 service cinder] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:42.119786 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407791ce-18c2-4dec-83b9-ff6e3d3ecb86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889e7be1dcaf47f599af9c9b7ad33042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:42.127261 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407791ce-18c2-4dec-83b9-ff6e3d3ecb86 service swift] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:42.127766 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407791ce-18c2-4dec-83b9-ff6e3d3ecb86 service swift] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:42.128182 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407791ce-18c2-4dec-83b9-ff6e3d3ecb86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:42.139775 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407791ce-18c2-4dec-83b9-ff6e3d3ecb86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:42.141799 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407791ce-18c2-4dec-83b9-ff6e3d3ecb86 service swift] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:42.152503 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1059/2106] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Oct 28 14:38:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 14:38:42.851397 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb324f-74e1-4506-99f1-cbd979085c4e None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:42.851718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb324f-74e1-4506-99f1-cbd979085c4e None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:42.852157 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb324f-74e1-4506-99f1-cbd979085c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:42.873754 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-43fb324f-74e1-4506-99f1-cbd979085c4e None None] MFA Rules not processed for user `62cc0165aee14b449c8a49233001f631`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:42.875417 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-43fb324f-74e1-4506-99f1-cbd979085c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:42.884474 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1048/2107] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Oct 28 14:38:42 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:42.906580 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407791ce-18c2-4dec-83b9-ff6e3d3ecb86 service swift] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:42.925060 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407791ce-18c2-4dec-83b9-ff6e3d3ecb86 service swift] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:42.930459 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81330f4-fef8-4fdb-831c-afee84fe58b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889e7be1dcaf47f599af9c9b7ad33042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:42.931220 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81330f4-fef8-4fdb-831c-afee84fe58b9 service swift] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:42.931671 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81330f4-fef8-4fdb-831c-afee84fe58b9 service swift] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:42.931945 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81330f4-fef8-4fdb-831c-afee84fe58b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:42.946167 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81330f4-fef8-4fdb-831c-afee84fe58b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:42.948406 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81330f4-fef8-4fdb-831c-afee84fe58b9 service swift] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:42.964733 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1060/2108] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Oct 28 14:38:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 14:38:43.168961 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb324f-74e1-4506-99f1-cbd979085c4e None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:43.237124 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb324f-74e1-4506-99f1-cbd979085c4e None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:43.242931 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243adcd-b8c6-49b6-8bed-f0cd348598de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:43.243816 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243adcd-b8c6-49b6-8bed-f0cd348598de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:43.244093 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243adcd-b8c6-49b6-8bed-f0cd348598de admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:43.244362 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243adcd-b8c6-49b6-8bed-f0cd348598de admin admin] PATH_INFO: `/v3/users/07ef79146e214281b64e8eafeb30754a` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:43.245557 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243adcd-b8c6-49b6-8bed-f0cd348598de admin admin] RBAC: Authorizing `identity:delete_user(user_id=07ef79146e214281b64e8eafeb30754a)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:43.247552 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243adcd-b8c6-49b6-8bed-f0cd348598de admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:43.305096 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-6243adcd-b8c6-49b6-8bed-f0cd348598de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07ef79146e214281b64e8eafeb30754a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:43.305964 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-6243adcd-b8c6-49b6-8bed-f0cd348598de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07ef79146e214281b64e8eafeb30754a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:43.314356 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-6243adcd-b8c6-49b6-8bed-f0cd348598de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07ef79146e214281b64e8eafeb30754a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:43.321682 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-6243adcd-b8c6-49b6-8bed-f0cd348598de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07ef79146e214281b64e8eafeb30754a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:43.335119 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-6243adcd-b8c6-49b6-8bed-f0cd348598de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07ef79146e214281b64e8eafeb30754a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:43.345858 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1049/2109] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:38:43 2021] DELETE /identity/v3/users/07ef79146e214281b64e8eafeb30754a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:43.347638 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d3004-021a-49a7-82ea-861e831485b4 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:43.348131 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d3004-021a-49a7-82ea-861e831485b4 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:43.348421 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d3004-021a-49a7-82ea-861e831485b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:43.363976 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c51f6-8f75-4902-85ab-bd5054af4636 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:43.364331 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c51f6-8f75-4902-85ab-bd5054af4636 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:43.364606 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c51f6-8f75-4902-85ab-bd5054af4636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:43.372708 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-c15d3004-021a-49a7-82ea-861e831485b4 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:43.373991 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-c15d3004-021a-49a7-82ea-861e831485b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:43.386605 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-7d9c51f6-8f75-4902-85ab-bd5054af4636 None None] MFA Rules not processed for user `62cc0165aee14b449c8a49233001f631`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:43.387834 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-7d9c51f6-8f75-4902-85ab-bd5054af4636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:43.449379 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1050/2110] 10.222.0.79 () {58 vars in 967 bytes} [Thu Oct 28 14:38:43 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:43.454179 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1061/2111] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:43.465025 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c51f6-8f75-4902-85ab-bd5054af4636 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:43.466490 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d3004-021a-49a7-82ea-861e831485b4 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:43.467342 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-7d9c51f6-8f75-4902-85ab-bd5054af4636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:43.472195 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-c15d3004-021a-49a7-82ea-861e831485b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:43.565956 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d3004-021a-49a7-82ea-861e831485b4 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:43.567501 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c51f6-8f75-4902-85ab-bd5054af4636 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:43.570023 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977ab1a-fef3-48ff-9e14-f8cfb8f6066e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:43.571108 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977ab1a-fef3-48ff-9e14-f8cfb8f6066e service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:43.571372 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977ab1a-fef3-48ff-9e14-f8cfb8f6066e service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:43.571644 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977ab1a-fef3-48ff-9e14-f8cfb8f6066e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:43.572972 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e53d9-6882-4594-b662-0da6c668b9ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889e7be1dcaf47f599af9c9b7ad33042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:43.573797 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e53d9-6882-4594-b662-0da6c668b9ec service swift] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:43.574102 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e53d9-6882-4594-b662-0da6c668b9ec service swift] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:43.574366 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e53d9-6882-4594-b662-0da6c668b9ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:43.581211 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977ab1a-fef3-48ff-9e14-f8cfb8f6066e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:43.582735 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977ab1a-fef3-48ff-9e14-f8cfb8f6066e service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:43.583358 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e53d9-6882-4594-b662-0da6c668b9ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:43.585045 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e53d9-6882-4594-b662-0da6c668b9ec service swift] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:43.594432 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1051/2112] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Oct 28 14:38:43 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 14:38:43.603982 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1062/2113] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:38:43.866709 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e53d9-6882-4594-b662-0da6c668b9ec service swift] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:43.866709 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-bc5e53d9-6882-4594-b662-0da6c668b9ec service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:43.881121 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e53d9-6882-4594-b662-0da6c668b9ec service swift] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:43.888441 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bad5d-ba4f-4a96-8b4f-e9728e9d32f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:43.889362 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bad5d-ba4f-4a96-8b4f-e9728e9d32f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:43.889643 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bad5d-ba4f-4a96-8b4f-e9728e9d32f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:43.889918 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bad5d-ba4f-4a96-8b4f-e9728e9d32f2 admin admin] PATH_INFO: `/v3/users/d6a917be809946de8a1f58fb9a58762c` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:43.891466 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84bad5d-ba4f-4a96-8b4f-e9728e9d32f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6a917be809946de8a1f58fb9a58762c)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:43.894137 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84bad5d-ba4f-4a96-8b4f-e9728e9d32f2 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:43.911216 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977ab1a-fef3-48ff-9e14-f8cfb8f6066e service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:43.913035 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-3977ab1a-fef3-48ff-9e14-f8cfb8f6066e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:43.948402 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977ab1a-fef3-48ff-9e14-f8cfb8f6066e service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:43.956635 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e699b-ba0c-4824-b8e6-aa38b3a5a378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:43.957728 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e699b-ba0c-4824-b8e6-aa38b3a5a378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:43.958159 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e699b-ba0c-4824-b8e6-aa38b3a5a378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:43.958630 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e699b-ba0c-4824-b8e6-aa38b3a5a378 admin admin] PATH_INFO: `/v3/projects/d01a3a6c2c414e748310e71eff4f49ee` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:43.959882 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e699b-ba0c-4824-b8e6-aa38b3a5a378 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d01a3a6c2c414e748310e71eff4f49ee)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:43.961925 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e699b-ba0c-4824-b8e6-aa38b3a5a378 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:43.971937 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d84bad5d-ba4f-4a96-8b4f-e9728e9d32f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6a917be809946de8a1f58fb9a58762c'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:43.972763 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d84bad5d-ba4f-4a96-8b4f-e9728e9d32f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6a917be809946de8a1f58fb9a58762c'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:43.981433 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d84bad5d-ba4f-4a96-8b4f-e9728e9d32f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6a917be809946de8a1f58fb9a58762c'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:43.989917 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d84bad5d-ba4f-4a96-8b4f-e9728e9d32f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6a917be809946de8a1f58fb9a58762c'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:44.004231 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d84bad5d-ba4f-4a96-8b4f-e9728e9d32f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6a917be809946de8a1f58fb9a58762c'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:44.011021 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1052/2114] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:38:43 2021] DELETE /identity/v3/users/d6a917be809946de8a1f58fb9a58762c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:44.015427 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9abc-b3b8-45de-af40-bb450633eb7d None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:44.015783 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9abc-b3b8-45de-af40-bb450633eb7d None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:44.016128 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9abc-b3b8-45de-af40-bb450633eb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:44.027374 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-b41e699b-ba0c-4824-b8e6-aa38b3a5a378 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd01a3a6c2c414e748310e71eff4f49ee', 'request_id': 'req-b41e699b-ba0c-4824-b8e6-aa38b3a5a378'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:44.035018 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-8dfc9abc-b3b8-45de-af40-bb450633eb7d None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:44.035450 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-b41e699b-ba0c-4824-b8e6-aa38b3a5a378 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd01a3a6c2c414e748310e71eff4f49ee', 'request_id': 'req-b41e699b-ba0c-4824-b8e6-aa38b3a5a378'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:44.036226 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-8dfc9abc-b3b8-45de-af40-bb450633eb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:44.045773 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-b41e699b-ba0c-4824-b8e6-aa38b3a5a378 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd01a3a6c2c414e748310e71eff4f49ee', 'request_id': 'req-b41e699b-ba0c-4824-b8e6-aa38b3a5a378'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:44.057786 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-b41e699b-ba0c-4824-b8e6-aa38b3a5a378 admin admin] The token cache is being invalidate because project d01a3a6c2c414e748310e71eff4f49ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:38:44.058202 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-b41e699b-ba0c-4824-b8e6-aa38b3a5a378 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:44.059051 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-b41e699b-ba0c-4824-b8e6-aa38b3a5a378 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:44.060742 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1063/2115] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:38:43 2021] DELETE /identity/v3/projects/d01a3a6c2c414e748310e71eff4f49ee => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:38:44.064655 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e699b-ba0c-4824-b8e6-aa38b3a5a378 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:44.066065 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-b41e699b-ba0c-4824-b8e6-aa38b3a5a378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:44.098933 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1053/2116] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:44.110007 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc9abc-b3b8-45de-af40-bb450633eb7d None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:44.114948 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-8dfc9abc-b3b8-45de-af40-bb450633eb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:44.132615 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e699b-ba0c-4824-b8e6-aa38b3a5a378 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:44.137322 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5176240-140b-45c8-8be1-8515c233aee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:44.138204 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5176240-140b-45c8-8be1-8515c233aee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:44.138483 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5176240-140b-45c8-8be1-8515c233aee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:44.138795 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5176240-140b-45c8-8be1-8515c233aee6 admin admin] PATH_INFO: `/v3/users/e258a6d0a66542e0925053e926a221fc` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:44.140011 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5176240-140b-45c8-8be1-8515c233aee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e258a6d0a66542e0925053e926a221fc)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:44.142658 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5176240-140b-45c8-8be1-8515c233aee6 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:44.176541 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc9abc-b3b8-45de-af40-bb450633eb7d None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:44.180410 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca5213-7c44-4554-bd25-3f23d95c3330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:44.181364 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca5213-7c44-4554-bd25-3f23d95c3330 service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:44.181797 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca5213-7c44-4554-bd25-3f23d95c3330 service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:44.182221 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca5213-7c44-4554-bd25-3f23d95c3330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:44.192479 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca5213-7c44-4554-bd25-3f23d95c3330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:44.193975 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca5213-7c44-4554-bd25-3f23d95c3330 service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:44.195266 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a5176240-140b-45c8-8be1-8515c233aee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e258a6d0a66542e0925053e926a221fc'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:44.204263 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1054/2117] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:38:44.207806 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a5176240-140b-45c8-8be1-8515c233aee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e258a6d0a66542e0925053e926a221fc'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:44.208802 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a5176240-140b-45c8-8be1-8515c233aee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e258a6d0a66542e0925053e926a221fc'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:44.224746 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a5176240-140b-45c8-8be1-8515c233aee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e258a6d0a66542e0925053e926a221fc'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:44.232206 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a5176240-140b-45c8-8be1-8515c233aee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e258a6d0a66542e0925053e926a221fc'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:44.238623 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1064/2118] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:38:44 2021] DELETE /identity/v3/users/e258a6d0a66542e0925053e926a221fc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:44.553746 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca5213-7c44-4554-bd25-3f23d95c3330 service neutron] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:44.554735 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-08ca5213-7c44-4554-bd25-3f23d95c3330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:44.576340 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca5213-7c44-4554-bd25-3f23d95c3330 service neutron] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:44.597487 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5176240-140b-45c8-8be1-8515c233aee6 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:44.598931 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a5176240-140b-45c8-8be1-8515c233aee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:44.678933 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b52d00-7e35-4dc9-9b2b-ecb2b6c9d26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:44.680192 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b52d00-7e35-4dc9-9b2b-ecb2b6c9d26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:44.680671 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b52d00-7e35-4dc9-9b2b-ecb2b6c9d26d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:44.681093 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b52d00-7e35-4dc9-9b2b-ecb2b6c9d26d admin admin] PATH_INFO: `/v3/projects/8bbbfe0b79544106b827fc37eaa69bfd` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:44.682518 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b52d00-7e35-4dc9-9b2b-ecb2b6c9d26d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bbbfe0b79544106b827fc37eaa69bfd)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:44.684623 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b52d00-7e35-4dc9-9b2b-ecb2b6c9d26d admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:44.704737 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5176240-140b-45c8-8be1-8515c233aee6 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:44.709732 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f4020-1692-4f4a-9933-7cbeb7324967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:44.711110 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f4020-1692-4f4a-9933-7cbeb7324967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:44.711608 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f4020-1692-4f4a-9933-7cbeb7324967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:44.712132 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f4020-1692-4f4a-9933-7cbeb7324967 admin admin] PATH_INFO: `/v3/projects/7f45a84c6d654ed48c25f210bd28ad31` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:44.713270 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f4020-1692-4f4a-9933-7cbeb7324967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f45a84c6d654ed48c25f210bd28ad31)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:44.715343 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f4020-1692-4f4a-9933-7cbeb7324967 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:44.753193 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-c7b52d00-7e35-4dc9-9b2b-ecb2b6c9d26d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bbbfe0b79544106b827fc37eaa69bfd', 'request_id': 'req-c7b52d00-7e35-4dc9-9b2b-ecb2b6c9d26d'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:44.762338 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-c7b52d00-7e35-4dc9-9b2b-ecb2b6c9d26d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bbbfe0b79544106b827fc37eaa69bfd', 'request_id': 'req-c7b52d00-7e35-4dc9-9b2b-ecb2b6c9d26d'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:44.775655 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-c7b52d00-7e35-4dc9-9b2b-ecb2b6c9d26d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bbbfe0b79544106b827fc37eaa69bfd', 'request_id': 'req-c7b52d00-7e35-4dc9-9b2b-ecb2b6c9d26d'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:44.788810 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-c7b52d00-7e35-4dc9-9b2b-ecb2b6c9d26d admin admin] The token cache is being invalidate because project 8bbbfe0b79544106b827fc37eaa69bfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:38:44.789308 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-c7b52d00-7e35-4dc9-9b2b-ecb2b6c9d26d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:44.790406 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-c7b52d00-7e35-4dc9-9b2b-ecb2b6c9d26d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:44.792356 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1055/2119] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:38:44 2021] DELETE /identity/v3/projects/8bbbfe0b79544106b827fc37eaa69bfd => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:44.795730 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-2f5f4020-1692-4f4a-9933-7cbeb7324967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f45a84c6d654ed48c25f210bd28ad31', 'request_id': 'req-2f5f4020-1692-4f4a-9933-7cbeb7324967'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:44.802879 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5e367-4b1d-40c6-9bb7-09382287bae3 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:44.803205 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5e367-4b1d-40c6-9bb7-09382287bae3 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:44.803481 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5e367-4b1d-40c6-9bb7-09382287bae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:44.805085 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-2f5f4020-1692-4f4a-9933-7cbeb7324967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f45a84c6d654ed48c25f210bd28ad31', 'request_id': 'req-2f5f4020-1692-4f4a-9933-7cbeb7324967'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:44.816741 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-2f5f4020-1692-4f4a-9933-7cbeb7324967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f45a84c6d654ed48c25f210bd28ad31', 'request_id': 'req-2f5f4020-1692-4f4a-9933-7cbeb7324967'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:44.829934 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-2f5f4020-1692-4f4a-9933-7cbeb7324967 admin admin] The token cache is being invalidate because project 7f45a84c6d654ed48c25f210bd28ad31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:38:44.830982 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-2f5f4020-1692-4f4a-9933-7cbeb7324967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:44.832058 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-2f5f4020-1692-4f4a-9933-7cbeb7324967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:44.838983 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1065/2120] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:38:44 2021] DELETE /identity/v3/projects/7f45a84c6d654ed48c25f210bd28ad31 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:38:44.839695 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f4020-1692-4f4a-9933-7cbeb7324967 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:44.841187 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-c5b5e367-4b1d-40c6-9bb7-09382287bae3 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:44.841615 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-2f5f4020-1692-4f4a-9933-7cbeb7324967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:44.842378 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-c5b5e367-4b1d-40c6-9bb7-09382287bae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:44.937790 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1056/2121] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:44.944675 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f4020-1692-4f4a-9933-7cbeb7324967 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:44.954731 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8743d-6dbf-4b79-ba4f-40e80db7e58d None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:44.954731 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8743d-6dbf-4b79-ba4f-40e80db7e58d None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:44.954731 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8743d-6dbf-4b79-ba4f-40e80db7e58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:44.955044 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68655e5b-7205-4965-a820-38165d40aa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:44.955044 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68655e5b-7205-4965-a820-38165d40aa50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:44.955044 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68655e5b-7205-4965-a820-38165d40aa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:44.955044 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68655e5b-7205-4965-a820-38165d40aa50 admin admin] PATH_INFO: `/v3/users/996311433c8e441eb1dbfd60d84bb523` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:44.955380 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68655e5b-7205-4965-a820-38165d40aa50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=996311433c8e441eb1dbfd60d84bb523)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:44.956723 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68655e5b-7205-4965-a820-38165d40aa50 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:44.970888 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-ecd8743d-6dbf-4b79-ba4f-40e80db7e58d None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:44.972657 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-ecd8743d-6dbf-4b79-ba4f-40e80db7e58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:44.981497 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1057/2122] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:44.986078 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8743d-6dbf-4b79-ba4f-40e80db7e58d None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:44.996382 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8743d-6dbf-4b79-ba4f-40e80db7e58d None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:45.001486 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32612842-d30e-4c47-895e-4722ab867647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:45.001852 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32612842-d30e-4c47-895e-4722ab867647 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:45.002182 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32612842-d30e-4c47-895e-4722ab867647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:45.002706 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32612842-d30e-4c47-895e-4722ab867647 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:45.003459 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32612842-d30e-4c47-895e-4722ab867647 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:38:45.003760 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32612842-d30e-4c47-895e-4722ab867647 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:45.005397 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32612842-d30e-4c47-895e-4722ab867647 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:45.008737 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-68655e5b-7205-4965-a820-38165d40aa50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '996311433c8e441eb1dbfd60d84bb523'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:45.018084 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-68655e5b-7205-4965-a820-38165d40aa50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '996311433c8e441eb1dbfd60d84bb523'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:45.018854 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-68655e5b-7205-4965-a820-38165d40aa50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '996311433c8e441eb1dbfd60d84bb523'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:45.019481 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1058/2123] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:38:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:38:45.023688 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32612842-d30e-4c47-895e-4722ab867647 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:45.026465 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-32612842-d30e-4c47-895e-4722ab867647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:45.032684 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-68655e5b-7205-4965-a820-38165d40aa50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '996311433c8e441eb1dbfd60d84bb523'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:45.039921 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-68655e5b-7205-4965-a820-38165d40aa50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '996311433c8e441eb1dbfd60d84bb523'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:45.041526 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32612842-d30e-4c47-895e-4722ab867647 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:45.047464 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1066/2124] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:38:44 2021] DELETE /identity/v3/users/996311433c8e441eb1dbfd60d84bb523 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:45.048234 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f5c4d-e50d-430a-9573-738ee27bc67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:45.049539 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f5c4d-e50d-430a-9573-738ee27bc67b admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:45.049817 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f5c4d-e50d-430a-9573-738ee27bc67b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:45.050151 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f5c4d-e50d-430a-9573-738ee27bc67b admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:45.051439 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f5c4d-e50d-430a-9573-738ee27bc67b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:45.053495 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f5c4d-e50d-430a-9573-738ee27bc67b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:45.080738 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1059/2125] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:38:45 2021] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:38:45.084938 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68655e5b-7205-4965-a820-38165d40aa50 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:45.145261 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68655e5b-7205-4965-a820-38165d40aa50 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:45.204413 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69db1eb-a6cd-4ca9-86f7-9f817eee0267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:45.205104 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69db1eb-a6cd-4ca9-86f7-9f817eee0267 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:45.205374 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69db1eb-a6cd-4ca9-86f7-9f817eee0267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:45.205637 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69db1eb-a6cd-4ca9-86f7-9f817eee0267 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:45.210242 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69db1eb-a6cd-4ca9-86f7-9f817eee0267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:45.210242 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69db1eb-a6cd-4ca9-86f7-9f817eee0267 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:45.234771 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1067/2126] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:38:45 2021] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:38:45.237025 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f5c4d-e50d-430a-9573-738ee27bc67b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:45.247923 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f5c4d-e50d-430a-9573-738ee27bc67b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:45.252683 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12f62f-6bad-4632-95eb-ca2b0b0ae5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:45.253353 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12f62f-6bad-4632-95eb-ca2b0b0ae5ca admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:45.253632 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12f62f-6bad-4632-95eb-ca2b0b0ae5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:45.253905 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12f62f-6bad-4632-95eb-ca2b0b0ae5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:45.254652 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12f62f-6bad-4632-95eb-ca2b0b0ae5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:45.256297 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12f62f-6bad-4632-95eb-ca2b0b0ae5ca admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:45.266484 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1060/2127] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:45 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:45.270608 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69db1eb-a6cd-4ca9-86f7-9f817eee0267 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:45.280733 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69db1eb-a6cd-4ca9-86f7-9f817eee0267 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:45.286176 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaaf903-d88e-4e99-8f14-aaca62d1ed67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:45.286900 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaf903-d88e-4e99-8f14-aaca62d1ed67 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:45.287223 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaf903-d88e-4e99-8f14-aaca62d1ed67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:45.287490 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaf903-d88e-4e99-8f14-aaca62d1ed67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:45.288316 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaaf903-d88e-4e99-8f14-aaca62d1ed67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:45.289918 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaaf903-d88e-4e99-8f14-aaca62d1ed67 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:45.302662 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1068/2128] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:45 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:45.306736 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12f62f-6bad-4632-95eb-ca2b0b0ae5ca admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:45.318630 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12f62f-6bad-4632-95eb-ca2b0b0ae5ca admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:45.324481 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cdc2b-19e4-434d-9e03-c8bfc977f65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:45.325529 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cdc2b-19e4-434d-9e03-c8bfc977f65d admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:45.325975 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cdc2b-19e4-434d-9e03-c8bfc977f65d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:45.326249 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cdc2b-19e4-434d-9e03-c8bfc977f65d admin admin] PATH_INFO: `/v3/projects/fac19c389c954392bd090a3a76ba291b/users/50c574405738412ab7acbbf1ac687864/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:45.347911 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cdc2b-19e4-434d-9e03-c8bfc977f65d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fac19c389c954392bd090a3a76ba291b, user_id=50c574405738412ab7acbbf1ac687864, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:45.350561 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cdc2b-19e4-434d-9e03-c8bfc977f65d admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:45.370234 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1061/2129] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:38:45 2021] PUT /identity/v3/projects/fac19c389c954392bd090a3a76ba291b/users/50c574405738412ab7acbbf1ac687864/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:45.373260 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5230ae-c7bc-4a3c-a065-776743e09275 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:45.373557 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5230ae-c7bc-4a3c-a065-776743e09275 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:45.373873 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5230ae-c7bc-4a3c-a065-776743e09275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:45.391536 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-0e5230ae-c7bc-4a3c-a065-776743e09275 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:45.392752 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-0e5230ae-c7bc-4a3c-a065-776743e09275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:45.440426 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cdc2b-19e4-434d-9e03-c8bfc977f65d admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:45.442280 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-a16cdc2b-19e4-434d-9e03-c8bfc977f65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:45.464642 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1069/2130] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:45.474739 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5230ae-c7bc-4a3c-a065-776743e09275 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:45.477502 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-0e5230ae-c7bc-4a3c-a065-776743e09275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:45.532700 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cdc2b-19e4-434d-9e03-c8bfc977f65d admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:45.537503 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa34fd9-c540-47dc-be02-146e7653f514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:45.538378 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa34fd9-c540-47dc-be02-146e7653f514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:45.538701 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa34fd9-c540-47dc-be02-146e7653f514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:45.538977 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa34fd9-c540-47dc-be02-146e7653f514 admin admin] PATH_INFO: `/v3/projects/2d9c39ed7aed44b58f1707a92d66e3ea` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:45.540182 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa34fd9-c540-47dc-be02-146e7653f514 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d9c39ed7aed44b58f1707a92d66e3ea)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:45.542098 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa34fd9-c540-47dc-be02-146e7653f514 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:45.553742 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5230ae-c7bc-4a3c-a065-776743e09275 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:45.560243 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316a668-cc94-468c-a2cc-63bce268be61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:45.560899 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316a668-cc94-468c-a2cc-63bce268be61 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:45.561175 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316a668-cc94-468c-a2cc-63bce268be61 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:45.561443 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316a668-cc94-468c-a2cc-63bce268be61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:45.572457 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316a668-cc94-468c-a2cc-63bce268be61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:45.573967 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316a668-cc94-468c-a2cc-63bce268be61 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:45.584157 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1070/2131] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:38:45.593115 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1aa34fd9-c540-47dc-be02-146e7653f514 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d9c39ed7aed44b58f1707a92d66e3ea', 'request_id': 'req-1aa34fd9-c540-47dc-be02-146e7653f514'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:45.600307 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1aa34fd9-c540-47dc-be02-146e7653f514 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d9c39ed7aed44b58f1707a92d66e3ea', 'request_id': 'req-1aa34fd9-c540-47dc-be02-146e7653f514'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:45.608708 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1aa34fd9-c540-47dc-be02-146e7653f514 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d9c39ed7aed44b58f1707a92d66e3ea', 'request_id': 'req-1aa34fd9-c540-47dc-be02-146e7653f514'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:45.619995 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1aa34fd9-c540-47dc-be02-146e7653f514 admin admin] The token cache is being invalidate because project 2d9c39ed7aed44b58f1707a92d66e3ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:38:45.620286 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1aa34fd9-c540-47dc-be02-146e7653f514 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:45.621146 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1aa34fd9-c540-47dc-be02-146e7653f514 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:45.623274 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1062/2132] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:38:45 2021] DELETE /identity/v3/projects/2d9c39ed7aed44b58f1707a92d66e3ea => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:38:45.630251 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c60d01-a11e-4490-9c9d-a63ff3596a6f None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:45.630803 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c60d01-a11e-4490-9c9d-a63ff3596a6f None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:45.631090 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c60d01-a11e-4490-9c9d-a63ff3596a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:45.650273 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-36c60d01-a11e-4490-9c9d-a63ff3596a6f None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:45.651531 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-36c60d01-a11e-4490-9c9d-a63ff3596a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:45.712007 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1071/2133] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:38:45.720718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5182474-d65e-41ae-8dcc-4ce07177a7cb None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:45.721031 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5182474-d65e-41ae-8dcc-4ce07177a7cb None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:45.721269 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5182474-d65e-41ae-8dcc-4ce07177a7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:45.755490 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-a5182474-d65e-41ae-8dcc-4ce07177a7cb None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:45.757610 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-a5182474-d65e-41ae-8dcc-4ce07177a7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:45.767565 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c60d01-a11e-4490-9c9d-a63ff3596a6f None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:45.769049 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-36c60d01-a11e-4490-9c9d-a63ff3596a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:45.772578 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1063/2134] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:45.776664 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5182474-d65e-41ae-8dcc-4ce07177a7cb None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:45.784276 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c60d01-a11e-4490-9c9d-a63ff3596a6f None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:45.785804 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5182474-d65e-41ae-8dcc-4ce07177a7cb None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:45.790523 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea4f93-d4dd-410d-9960-280a6507eba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:45.791436 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e45f2-e401-4da5-ad0b-f672d8e6bf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:45.791718 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea4f93-d4dd-410d-9960-280a6507eba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:45.792108 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea4f93-d4dd-410d-9960-280a6507eba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:45.792202 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e45f2-e401-4da5-ad0b-f672d8e6bf96 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:45.793141 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e45f2-e401-4da5-ad0b-f672d8e6bf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:45.793358 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea4f93-d4dd-410d-9960-280a6507eba0 admin admin] PATH_INFO: `/v3/users/471ecbbaaced43cc8f88fb0913d1e991` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:45.793450 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e45f2-e401-4da5-ad0b-f672d8e6bf96 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:45.793719 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e45f2-e401-4da5-ad0b-f672d8e6bf96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:38:45.794022 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e45f2-e401-4da5-ad0b-f672d8e6bf96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:45.794772 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea4f93-d4dd-410d-9960-280a6507eba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=471ecbbaaced43cc8f88fb0913d1e991)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:45.796073 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e45f2-e401-4da5-ad0b-f672d8e6bf96 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:45.797404 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea4f93-d4dd-410d-9960-280a6507eba0 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:45.815976 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1064/2135] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:38:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:38:45.820139 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e45f2-e401-4da5-ad0b-f672d8e6bf96 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:45.831215 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e45f2-e401-4da5-ad0b-f672d8e6bf96 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:45.838554 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0652b19-4042-405b-bec9-da92a755eab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:45.839346 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0652b19-4042-405b-bec9-da92a755eab3 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:45.839571 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0652b19-4042-405b-bec9-da92a755eab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:45.839841 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0652b19-4042-405b-bec9-da92a755eab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:45.840861 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0652b19-4042-405b-bec9-da92a755eab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:45.842855 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0652b19-4042-405b-bec9-da92a755eab3 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:45.854649 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-d3ea4f93-d4dd-410d-9960-280a6507eba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '471ecbbaaced43cc8f88fb0913d1e991'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:45.864141 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-d3ea4f93-d4dd-410d-9960-280a6507eba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '471ecbbaaced43cc8f88fb0913d1e991'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:45.864855 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-d3ea4f93-d4dd-410d-9960-280a6507eba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '471ecbbaaced43cc8f88fb0913d1e991'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:45.872323 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1065/2136] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:38:45 2021] POST /identity/v3/projects => generated 407 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:38:45.879986 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0652b19-4042-405b-bec9-da92a755eab3 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:45.880849 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-d3ea4f93-d4dd-410d-9960-280a6507eba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '471ecbbaaced43cc8f88fb0913d1e991'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:45.881696 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e0652b19-4042-405b-bec9-da92a755eab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:45.888165 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-d3ea4f93-d4dd-410d-9960-280a6507eba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '471ecbbaaced43cc8f88fb0913d1e991'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:45.896599 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1072/2137] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:38:45 2021] DELETE /identity/v3/users/471ecbbaaced43cc8f88fb0913d1e991 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:38:45.906337 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca617b75-fad5-403e-bd9f-a77cc80e7912 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:45.906546 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca617b75-fad5-403e-bd9f-a77cc80e7912 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:45.906832 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca617b75-fad5-403e-bd9f-a77cc80e7912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:45.928724 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-ca617b75-fad5-403e-bd9f-a77cc80e7912 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:45.929980 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-ca617b75-fad5-403e-bd9f-a77cc80e7912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:45.970259 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0652b19-4042-405b-bec9-da92a755eab3 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:46.049777 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1073/2138] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:46.060437 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca617b75-fad5-403e-bd9f-a77cc80e7912 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:46.061842 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-ca617b75-fad5-403e-bd9f-a77cc80e7912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:46.076572 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42a995-db43-4280-88c1-fd00d184d6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:46.077990 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42a995-db43-4280-88c1-fd00d184d6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:46.078755 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42a995-db43-4280-88c1-fd00d184d6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:46.079439 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42a995-db43-4280-88c1-fd00d184d6b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:46.084164 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42a995-db43-4280-88c1-fd00d184d6b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:46.087806 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42a995-db43-4280-88c1-fd00d184d6b6 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:46.128622 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1066/2139] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:38:45 2021] POST /identity/v3/users => generated 304 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:38:46.133799 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42a995-db43-4280-88c1-fd00d184d6b6 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:46.150279 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42a995-db43-4280-88c1-fd00d184d6b6 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:46.155983 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a82205-7fbb-459c-b697-24b13ef4cac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:46.156376 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a82205-7fbb-459c-b697-24b13ef4cac0 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:46.156762 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a82205-7fbb-459c-b697-24b13ef4cac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:46.157280 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a82205-7fbb-459c-b697-24b13ef4cac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:46.158201 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a82205-7fbb-459c-b697-24b13ef4cac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:46.159992 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a82205-7fbb-459c-b697-24b13ef4cac0 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:46.176696 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1067/2140] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:46 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:46.180489 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a82205-7fbb-459c-b697-24b13ef4cac0 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:46.191176 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca617b75-fad5-403e-bd9f-a77cc80e7912 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:46.198011 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a82205-7fbb-459c-b697-24b13ef4cac0 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:46.198421 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357d775-c042-45a3-a381-98dc8b3b542b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:46.199401 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357d775-c042-45a3-a381-98dc8b3b542b service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:46.200235 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357d775-c042-45a3-a381-98dc8b3b542b service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:46.200235 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357d775-c042-45a3-a381-98dc8b3b542b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:46.203632 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd1da5-c9ee-4fb0-b0fd-22270f77367c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:46.204517 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd1da5-c9ee-4fb0-b0fd-22270f77367c admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:46.204800 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd1da5-c9ee-4fb0-b0fd-22270f77367c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:46.205569 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd1da5-c9ee-4fb0-b0fd-22270f77367c admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:46.205830 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd1da5-c9ee-4fb0-b0fd-22270f77367c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:46.207520 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd1da5-c9ee-4fb0-b0fd-22270f77367c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:46.210875 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357d775-c042-45a3-a381-98dc8b3b542b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:46.212623 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357d775-c042-45a3-a381-98dc8b3b542b service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:46.217960 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1068/2141] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:46 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:46.222375 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd1da5-c9ee-4fb0-b0fd-22270f77367c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:46.224033 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1074/2142] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:38:46.236545 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd1da5-c9ee-4fb0-b0fd-22270f77367c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:46.241346 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49116bb5-457c-425a-9f09-1b821a2f558b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:46.242311 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49116bb5-457c-425a-9f09-1b821a2f558b admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:46.242655 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49116bb5-457c-425a-9f09-1b821a2f558b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:46.243024 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49116bb5-457c-425a-9f09-1b821a2f558b admin admin] PATH_INFO: `/v3/projects/f59fada0ad854ec89a907a151febaee6/users/e0176fb8304e4f1889735be2d8d2ab9e/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:46.259104 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49116bb5-457c-425a-9f09-1b821a2f558b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59fada0ad854ec89a907a151febaee6, user_id=e0176fb8304e4f1889735be2d8d2ab9e, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:46.261955 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49116bb5-457c-425a-9f09-1b821a2f558b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:46.290185 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1069/2143] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:38:46 2021] PUT /identity/v3/projects/f59fada0ad854ec89a907a151febaee6/users/e0176fb8304e4f1889735be2d8d2ab9e/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:46.293026 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fa6c4-97bd-4d4a-8211-16517817905a None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:46.293422 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fa6c4-97bd-4d4a-8211-16517817905a None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:46.293764 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fa6c4-97bd-4d4a-8211-16517817905a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:46.325665 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-d54fa6c4-97bd-4d4a-8211-16517817905a None None] MFA Rules not processed for user `e0176fb8304e4f1889735be2d8d2ab9e`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:46.327125 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-d54fa6c4-97bd-4d4a-8211-16517817905a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:46.405865 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49116bb5-457c-425a-9f09-1b821a2f558b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:46.408806 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-49116bb5-457c-425a-9f09-1b821a2f558b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:46.429530 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1075/2144] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:46 2021] POST /identity/v3/auth/tokens => generated 3427 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:46.434857 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54fa6c4-97bd-4d4a-8211-16517817905a None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:46.497082 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49116bb5-457c-425a-9f09-1b821a2f558b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:46.503170 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36eaf30-2c17-4645-8a6b-5c55039cc10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:46.504248 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eaf30-2c17-4645-8a6b-5c55039cc10b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:46.504674 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eaf30-2c17-4645-8a6b-5c55039cc10b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:46.505267 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eaf30-2c17-4645-8a6b-5c55039cc10b admin admin] PATH_INFO: `/v3/projects/68e2cb33410447879d1f62a96b7330a4` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:46.507855 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36eaf30-2c17-4645-8a6b-5c55039cc10b admin admin] RBAC: Authorizing `identity:delete_project(project_id=68e2cb33410447879d1f62a96b7330a4)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:46.511306 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36eaf30-2c17-4645-8a6b-5c55039cc10b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:46.512141 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54fa6c4-97bd-4d4a-8211-16517817905a None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:46.518735 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75f062-755f-445f-8e1e-e6e59075c301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:46.519627 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75f062-755f-445f-8e1e-e6e59075c301 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:46.520577 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75f062-755f-445f-8e1e-e6e59075c301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:46.520900 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75f062-755f-445f-8e1e-e6e59075c301 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:46.522073 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75f062-755f-445f-8e1e-e6e59075c301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:46.525622 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75f062-755f-445f-8e1e-e6e59075c301 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:46.575769 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1076/2145] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:38:46 2021] POST /identity/v3/projects => generated 407 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:38:46.580610 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-b36eaf30-2c17-4645-8a6b-5c55039cc10b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68e2cb33410447879d1f62a96b7330a4', 'request_id': 'req-b36eaf30-2c17-4645-8a6b-5c55039cc10b'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:46.587747 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75f062-755f-445f-8e1e-e6e59075c301 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:46.590791 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-b36eaf30-2c17-4645-8a6b-5c55039cc10b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68e2cb33410447879d1f62a96b7330a4', 'request_id': 'req-b36eaf30-2c17-4645-8a6b-5c55039cc10b'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:46.606612 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-b36eaf30-2c17-4645-8a6b-5c55039cc10b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68e2cb33410447879d1f62a96b7330a4', 'request_id': 'req-b36eaf30-2c17-4645-8a6b-5c55039cc10b'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:46.627852 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-b36eaf30-2c17-4645-8a6b-5c55039cc10b admin admin] The token cache is being invalidate because project 68e2cb33410447879d1f62a96b7330a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:38:46.628346 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-b36eaf30-2c17-4645-8a6b-5c55039cc10b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:46.629082 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-b36eaf30-2c17-4645-8a6b-5c55039cc10b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:46.631929 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1070/2146] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:38:46 2021] DELETE /identity/v3/projects/68e2cb33410447879d1f62a96b7330a4 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:38:46.639130 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a7314-a185-4dee-af81-b42115c15b20 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:46.639519 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a7314-a185-4dee-af81-b42115c15b20 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:46.639858 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a7314-a185-4dee-af81-b42115c15b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:46.660831 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-e93a7314-a185-4dee-af81-b42115c15b20 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:46.662713 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e93a7314-a185-4dee-af81-b42115c15b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:46.671395 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75f062-755f-445f-8e1e-e6e59075c301 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:46.676672 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63f1a9-9dbe-42f2-8c98-b303ea0400fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:46.677398 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63f1a9-9dbe-42f2-8c98-b303ea0400fd admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:46.677674 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63f1a9-9dbe-42f2-8c98-b303ea0400fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:46.678098 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63f1a9-9dbe-42f2-8c98-b303ea0400fd admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:46.678983 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63f1a9-9dbe-42f2-8c98-b303ea0400fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:46.681604 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1071/2147] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:38:46.681848 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63f1a9-9dbe-42f2-8c98-b303ea0400fd admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:46.689323 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0182248-3df3-4e19-8bd8-9da9061c2f4e None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:46.689708 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0182248-3df3-4e19-8bd8-9da9061c2f4e None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:46.690278 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0182248-3df3-4e19-8bd8-9da9061c2f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:46.706274 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1077/2148] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:38:46 2021] POST /identity/v3/users => generated 310 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:38:46.710591 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63f1a9-9dbe-42f2-8c98-b303ea0400fd admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:46.711718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-c0182248-3df3-4e19-8bd8-9da9061c2f4e None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:46.713113 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-2d63f1a9-9dbe-42f2-8c98-b303ea0400fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:46.713237 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-c0182248-3df3-4e19-8bd8-9da9061c2f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:46.725637 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1072/2149] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:46.726555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0182248-3df3-4e19-8bd8-9da9061c2f4e None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:46.728359 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63f1a9-9dbe-42f2-8c98-b303ea0400fd admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:46.738017 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0182248-3df3-4e19-8bd8-9da9061c2f4e None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:46.745350 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74941d9-3f68-4975-b39d-41fae206d9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:46.746576 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74941d9-3f68-4975-b39d-41fae206d9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:46.747127 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74941d9-3f68-4975-b39d-41fae206d9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:46.747430 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d29ba-9615-4611-a52c-d0b8bccba1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:46.747792 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74941d9-3f68-4975-b39d-41fae206d9c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:46.747932 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d29ba-9615-4611-a52c-d0b8bccba1ec admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:46.748199 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d29ba-9615-4611-a52c-d0b8bccba1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:46.748476 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d29ba-9615-4611-a52c-d0b8bccba1ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:46.749253 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d29ba-9615-4611-a52c-d0b8bccba1ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:38:46.749539 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d29ba-9615-4611-a52c-d0b8bccba1ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:46.749866 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74941d9-3f68-4975-b39d-41fae206d9c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:46.751595 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d29ba-9615-4611-a52c-d0b8bccba1ec admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:46.753248 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74941d9-3f68-4975-b39d-41fae206d9c7 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:46.764529 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1073/2150] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:38:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:38:46.768834 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1078/2151] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:46 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:38:46.769283 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d29ba-9615-4611-a52c-d0b8bccba1ec admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:46.772885 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74941d9-3f68-4975-b39d-41fae206d9c7 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:46.779662 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d29ba-9615-4611-a52c-d0b8bccba1ec admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:46.783443 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74941d9-3f68-4975-b39d-41fae206d9c7 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:46.788107 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09784b-c6ad-475f-882b-cfbe95ef3a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:46.788842 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6998bb4-c366-4478-8015-c319920148b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:46.789202 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09784b-c6ad-475f-882b-cfbe95ef3a9c admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:46.789600 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09784b-c6ad-475f-882b-cfbe95ef3a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:46.789946 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09784b-c6ad-475f-882b-cfbe95ef3a9c admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:46.790386 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6998bb4-c366-4478-8015-c319920148b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:46.790848 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6998bb4-c366-4478-8015-c319920148b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:46.790972 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09784b-c6ad-475f-882b-cfbe95ef3a9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:46.791373 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6998bb4-c366-4478-8015-c319920148b2 admin admin] PATH_INFO: `/v3/projects/d18e8a485fc4465ca3b01c3e70a9eb30/users/57bad7b078a6477ca8b58b29c72355fd/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:46.793012 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09784b-c6ad-475f-882b-cfbe95ef3a9c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:46.810392 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6998bb4-c366-4478-8015-c319920148b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18e8a485fc4465ca3b01c3e70a9eb30, user_id=57bad7b078a6477ca8b58b29c72355fd, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:46.814120 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6998bb4-c366-4478-8015-c319920148b2 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:46.830491 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1074/2152] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:38:46 2021] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:38:46.832699 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1079/2153] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:38:46 2021] PUT /identity/v3/projects/d18e8a485fc4465ca3b01c3e70a9eb30/users/57bad7b078a6477ca8b58b29c72355fd/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:38:46.834436 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09784b-c6ad-475f-882b-cfbe95ef3a9c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:46.837069 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6998bb4-c366-4478-8015-c319920148b2 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:46.942781 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6998bb4-c366-4478-8015-c319920148b2 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:46.962176 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09784b-c6ad-475f-882b-cfbe95ef3a9c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:46.973559 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37813e63-322a-48e7-8368-d5711302a5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:46.974516 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37813e63-322a-48e7-8368-d5711302a5d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:46.974831 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37813e63-322a-48e7-8368-d5711302a5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:46.975193 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37813e63-322a-48e7-8368-d5711302a5d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:46.976657 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37813e63-322a-48e7-8368-d5711302a5d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:46.978242 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37813e63-322a-48e7-8368-d5711302a5d4 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:47.002020 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1075/2154] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:38:46 2021] POST /identity/v3/users => generated 291 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:38:47.005922 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37813e63-322a-48e7-8368-d5711302a5d4 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:47.024494 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37813e63-322a-48e7-8368-d5711302a5d4 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:47.048482 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4314b6-0162-4079-97ea-837e8934b761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:47.049221 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4314b6-0162-4079-97ea-837e8934b761 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:47.049502 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4314b6-0162-4079-97ea-837e8934b761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:47.049793 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4314b6-0162-4079-97ea-837e8934b761 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:47.050514 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4314b6-0162-4079-97ea-837e8934b761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:47.051494 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19bdfb-9e28-4c35-bdae-2d9a7a2a18ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:47.052163 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4314b6-0162-4079-97ea-837e8934b761 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:47.054242 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19bdfb-9e28-4c35-bdae-2d9a7a2a18ef admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:47.056254 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19bdfb-9e28-4c35-bdae-2d9a7a2a18ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:47.056617 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19bdfb-9e28-4c35-bdae-2d9a7a2a18ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:47.059404 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19bdfb-9e28-4c35-bdae-2d9a7a2a18ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:47.061384 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19bdfb-9e28-4c35-bdae-2d9a7a2a18ef admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:47.067522 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1080/2155] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:46 2021] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:47.072298 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4314b6-0162-4079-97ea-837e8934b761 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:47.079580 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1076/2156] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:47 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:38:47.080639 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19bdfb-9e28-4c35-bdae-2d9a7a2a18ef admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:47.085065 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4314b6-0162-4079-97ea-837e8934b761 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:47.091800 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b411c05-9635-44d6-9319-0086cfe1e954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:47.092797 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b411c05-9635-44d6-9319-0086cfe1e954 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:47.093137 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b411c05-9635-44d6-9319-0086cfe1e954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:47.093478 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b411c05-9635-44d6-9319-0086cfe1e954 admin admin] PATH_INFO: `/v3/projects/d18e8a485fc4465ca3b01c3e70a9eb30/users/57bad7b078a6477ca8b58b29c72355fd/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:47.093944 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19bdfb-9e28-4c35-bdae-2d9a7a2a18ef admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:47.096308 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b411c05-9635-44d6-9319-0086cfe1e954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18e8a485fc4465ca3b01c3e70a9eb30, user_id=57bad7b078a6477ca8b58b29c72355fd, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:47.100221 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592b90e-7a55-46e8-b4ad-3258a0521898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:47.101404 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592b90e-7a55-46e8-b4ad-3258a0521898 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:47.101634 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592b90e-7a55-46e8-b4ad-3258a0521898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:47.101786 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b411c05-9635-44d6-9319-0086cfe1e954 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:47.102032 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592b90e-7a55-46e8-b4ad-3258a0521898 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:47.103001 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592b90e-7a55-46e8-b4ad-3258a0521898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:47.105812 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592b90e-7a55-46e8-b4ad-3258a0521898 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:47.120427 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1081/2157] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:38:47 2021] PUT /identity/v3/projects/d18e8a485fc4465ca3b01c3e70a9eb30/users/57bad7b078a6477ca8b58b29c72355fd/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:47.131259 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1077/2158] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:47 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:47.132299 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c06c4-a8a0-435b-bd1a-3cea7c2a2ca7 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:47.132589 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c06c4-a8a0-435b-bd1a-3cea7c2a2ca7 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:47.132868 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c06c4-a8a0-435b-bd1a-3cea7c2a2ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:47.136103 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592b90e-7a55-46e8-b4ad-3258a0521898 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:47.150240 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592b90e-7a55-46e8-b4ad-3258a0521898 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:47.162996 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-f16c06c4-a8a0-435b-bd1a-3cea7c2a2ca7 None None] MFA Rules not processed for user `57bad7b078a6477ca8b58b29c72355fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:47.164522 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-f16c06c4-a8a0-435b-bd1a-3cea7c2a2ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:47.223783 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1502c0-d736-4497-bcd9-811f0ea88f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:47.224790 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1502c0-d736-4497-bcd9-811f0ea88f81 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:47.225516 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1502c0-d736-4497-bcd9-811f0ea88f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:47.225925 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1502c0-d736-4497-bcd9-811f0ea88f81 admin admin] PATH_INFO: `/v3/projects/c550273fcf3242e683f9f92f9456dbee/users/6c878a666cea4ff2be87715c4dcfcbd5/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:47.249413 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1502c0-d736-4497-bcd9-811f0ea88f81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c550273fcf3242e683f9f92f9456dbee, user_id=6c878a666cea4ff2be87715c4dcfcbd5, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:47.251417 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1082/2159] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:47 2021] POST /identity/v3/auth/tokens => generated 3494 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:38:47.256581 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1502c0-d736-4497-bcd9-811f0ea88f81 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:47.264215 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c06c4-a8a0-435b-bd1a-3cea7c2a2ca7 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:47.266451 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-f16c06c4-a8a0-435b-bd1a-3cea7c2a2ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:47.283647 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1078/2160] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:38:47 2021] PUT /identity/v3/projects/c550273fcf3242e683f9f92f9456dbee/users/6c878a666cea4ff2be87715c4dcfcbd5/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:47.285288 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc68c36-6783-4212-8d54-ef7f65464732 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:47.285575 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc68c36-6783-4212-8d54-ef7f65464732 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:47.290001 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc68c36-6783-4212-8d54-ef7f65464732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:47.321110 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-bdc68c36-6783-4212-8d54-ef7f65464732 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:47.325103 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-bdc68c36-6783-4212-8d54-ef7f65464732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:47.381470 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c06c4-a8a0-435b-bd1a-3cea7c2a2ca7 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:47.437233 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1079/2161] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:47.453103 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc68c36-6783-4212-8d54-ef7f65464732 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:47.455017 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-bdc68c36-6783-4212-8d54-ef7f65464732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:47.464105 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c163b-4da8-40cb-83d3-cb214f92cd2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:47.465032 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c163b-4da8-40cb-83d3-cb214f92cd2f service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:47.465460 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c163b-4da8-40cb-83d3-cb214f92cd2f service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:47.465891 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c163b-4da8-40cb-83d3-cb214f92cd2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:47.527815 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc68c36-6783-4212-8d54-ef7f65464732 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:47.532241 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df901169-1fb9-4dd9-9b75-24922460f4fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:47.533312 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df901169-1fb9-4dd9-9b75-24922460f4fd service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:47.533703 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df901169-1fb9-4dd9-9b75-24922460f4fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:47.534096 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df901169-1fb9-4dd9-9b75-24922460f4fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:47.538920 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c163b-4da8-40cb-83d3-cb214f92cd2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:47.540709 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c163b-4da8-40cb-83d3-cb214f92cd2f service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:47.546396 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df901169-1fb9-4dd9-9b75-24922460f4fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:47.549056 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df901169-1fb9-4dd9-9b75-24922460f4fd service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:47.561944 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1080/2162] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:38:47.566146 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1083/2163] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:47 2021] GET /identity/v3/auth/tokens => generated 3494 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:38:47.773724 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df901169-1fb9-4dd9-9b75-24922460f4fd service neutron] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:47.775248 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-df901169-1fb9-4dd9-9b75-24922460f4fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:47.790368 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df901169-1fb9-4dd9-9b75-24922460f4fd service neutron] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:47.795620 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee25aff-9015-467b-a73b-d529f52103cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:47.796252 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee25aff-9015-467b-a73b-d529f52103cd service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:47.796535 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee25aff-9015-467b-a73b-d529f52103cd service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:47.796816 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee25aff-9015-467b-a73b-d529f52103cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:47.798929 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-eee25aff-9015-467b-a73b-d529f52103cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:47.884863 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee25aff-9015-467b-a73b-d529f52103cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:47.886550 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee25aff-9015-467b-a73b-d529f52103cd service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:47.896830 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1081/2164] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:47 2021] GET /identity/v3/auth/tokens => generated 3427 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:38:48.836717 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3c78a-3da1-480a-8d08-211035f95888 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:48.837311 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3c78a-3da1-480a-8d08-211035f95888 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:48.837311 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3c78a-3da1-480a-8d08-211035f95888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:48.881303 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-76f3c78a-3da1-480a-8d08-211035f95888 None None] MFA Rules not processed for user `6c878a666cea4ff2be87715c4dcfcbd5`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:48.882644 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-76f3c78a-3da1-480a-8d08-211035f95888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:48.970667 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1084/2165] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:48 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:48.982903 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee25aff-9015-467b-a73b-d529f52103cd service cinder] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:48.992539 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee25aff-9015-467b-a73b-d529f52103cd service cinder] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:48.997216 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739ea62-972c-45ce-b623-67826db0f364 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:48.998327 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739ea62-972c-45ce-b623-67826db0f364 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:48.998693 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739ea62-972c-45ce-b623-67826db0f364 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:48.999090 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739ea62-972c-45ce-b623-67826db0f364 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:49.012206 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739ea62-972c-45ce-b623-67826db0f364 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:49.013747 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739ea62-972c-45ce-b623-67826db0f364 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:49.024373 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1082/2166] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:48 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:38:50.849247 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec95487-d12f-46ef-b7cd-381f5579ee5e None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:50.849748 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec95487-d12f-46ef-b7cd-381f5579ee5e None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:50.849854 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec95487-d12f-46ef-b7cd-381f5579ee5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:50.884459 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-5ec95487-d12f-46ef-b7cd-381f5579ee5e None None] MFA Rules not processed for user `50c574405738412ab7acbbf1ac687864`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:50.885832 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-5ec95487-d12f-46ef-b7cd-381f5579ee5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:50.962143 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1085/2167] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:50 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:50.966519 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739ea62-972c-45ce-b623-67826db0f364 service cinder] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:50.968031 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-f739ea62-972c-45ce-b623-67826db0f364 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:50.982064 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739ea62-972c-45ce-b623-67826db0f364 service cinder] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:50.986630 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3323597-7469-4b68-845d-38a677008f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:50.987377 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3323597-7469-4b68-845d-38a677008f46 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:50.987655 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3323597-7469-4b68-845d-38a677008f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:50.987928 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3323597-7469-4b68-845d-38a677008f46 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:50.988655 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3323597-7469-4b68-845d-38a677008f46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:50.990563 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3323597-7469-4b68-845d-38a677008f46 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:51.018181 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1083/2168] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:38:50 2021] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:38:51.022236 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec95487-d12f-46ef-b7cd-381f5579ee5e None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:51.034275 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec95487-d12f-46ef-b7cd-381f5579ee5e None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:51.090224 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dfbee-6bbe-4f2c-af45-a760cb7bc88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:51.090855 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dfbee-6bbe-4f2c-af45-a760cb7bc88e admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:51.091137 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dfbee-6bbe-4f2c-af45-a760cb7bc88e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:51.091410 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dfbee-6bbe-4f2c-af45-a760cb7bc88e admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:51.092142 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066dfbee-6bbe-4f2c-af45-a760cb7bc88e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:51.094062 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066dfbee-6bbe-4f2c-af45-a760cb7bc88e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:51.116344 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1086/2169] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:38:51 2021] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:38:51.120696 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3323597-7469-4b68-845d-38a677008f46 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:51.131392 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3323597-7469-4b68-845d-38a677008f46 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:51.136249 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde95b9-22c8-40fa-9f07-0f14c44e9a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:51.136938 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde95b9-22c8-40fa-9f07-0f14c44e9a66 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:51.137213 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde95b9-22c8-40fa-9f07-0f14c44e9a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:51.137481 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde95b9-22c8-40fa-9f07-0f14c44e9a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:51.138253 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde95b9-22c8-40fa-9f07-0f14c44e9a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:51.140053 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde95b9-22c8-40fa-9f07-0f14c44e9a66 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:51.154543 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1084/2170] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:51 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:51.158748 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dfbee-6bbe-4f2c-af45-a760cb7bc88e admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:51.169669 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dfbee-6bbe-4f2c-af45-a760cb7bc88e admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:51.174501 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da80f2-781d-4fad-9610-544e34892ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:51.175467 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da80f2-781d-4fad-9610-544e34892ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:51.175745 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da80f2-781d-4fad-9610-544e34892ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:51.176015 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da80f2-781d-4fad-9610-544e34892ca5 admin admin] PATH_INFO: `/v3/projects/e3042a7154394fd1ab02dda0f29aa720/users/0c875bb93eb14a60a97dd4a36044611e/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:51.195042 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da80f2-781d-4fad-9610-544e34892ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3042a7154394fd1ab02dda0f29aa720, user_id=0c875bb93eb14a60a97dd4a36044611e, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:51.198171 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da80f2-781d-4fad-9610-544e34892ca5 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:51.217069 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1087/2171] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:38:51 2021] PUT /identity/v3/projects/e3042a7154394fd1ab02dda0f29aa720/users/0c875bb93eb14a60a97dd4a36044611e/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:51.218649 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde95b9-22c8-40fa-9f07-0f14c44e9a66 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:51.229864 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde95b9-22c8-40fa-9f07-0f14c44e9a66 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:51.292408 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67aeddf-dc59-409c-928b-81459b6e6c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:51.293291 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67aeddf-dc59-409c-928b-81459b6e6c6e admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:51.293575 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67aeddf-dc59-409c-928b-81459b6e6c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:51.293850 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67aeddf-dc59-409c-928b-81459b6e6c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:51.295010 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67aeddf-dc59-409c-928b-81459b6e6c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:51.296685 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67aeddf-dc59-409c-928b-81459b6e6c6e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:51.307203 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1085/2172] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:38:51 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:38:51.311504 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da80f2-781d-4fad-9610-544e34892ca5 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:51.322176 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da80f2-781d-4fad-9610-544e34892ca5 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:51.326845 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da57e70-32e0-4583-8fc3-599709500ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:51.327762 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da57e70-32e0-4583-8fc3-599709500ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:51.328066 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da57e70-32e0-4583-8fc3-599709500ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:51.328479 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da57e70-32e0-4583-8fc3-599709500ee1 admin admin] PATH_INFO: `/v3/projects/e3042a7154394fd1ab02dda0f29aa720/users/0c875bb93eb14a60a97dd4a36044611e/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:51.330572 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da57e70-32e0-4583-8fc3-599709500ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3042a7154394fd1ab02dda0f29aa720, user_id=0c875bb93eb14a60a97dd4a36044611e, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:51.333264 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da57e70-32e0-4583-8fc3-599709500ee1 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:51.343975 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1088/2173] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:38:51 2021] PUT /identity/v3/projects/e3042a7154394fd1ab02dda0f29aa720/users/0c875bb93eb14a60a97dd4a36044611e/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:53.956034 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a7cdf-86ec-486d-add2-dfba07b32560 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:53.957724 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a7cdf-86ec-486d-add2-dfba07b32560 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:53.957724 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a7cdf-86ec-486d-add2-dfba07b32560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:54.014520 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-c81a7cdf-86ec-486d-add2-dfba07b32560 None None] MFA Rules not processed for user `6c878a666cea4ff2be87715c4dcfcbd5`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:54.019822 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-c81a7cdf-86ec-486d-add2-dfba07b32560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:54.238816 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1086/2174] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:53 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:55.688868 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2aa23-db21-45b8-8b29-8f27132952fb None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:55.689452 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2aa23-db21-45b8-8b29-8f27132952fb None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:55.689452 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2aa23-db21-45b8-8b29-8f27132952fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:55.712653 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-2ac2aa23-db21-45b8-8b29-8f27132952fb None None] MFA Rules not processed for user `478109e21b1a4f3cb9690aed2d967faa`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:55.713999 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-2ac2aa23-db21-45b8-8b29-8f27132952fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:55.827396 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1089/2175] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:55 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:56.759416 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328c0f4-a4a2-4e81-a407-a1f29cb188f8 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:56.759933 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328c0f4-a4a2-4e81-a407-a1f29cb188f8 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:56.760104 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328c0f4-a4a2-4e81-a407-a1f29cb188f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:56.836103 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-f328c0f4-a4a2-4e81-a407-a1f29cb188f8 None None] MFA Rules not processed for user `0c875bb93eb14a60a97dd4a36044611e`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:56.837505 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-f328c0f4-a4a2-4e81-a407-a1f29cb188f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:57.039913 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1087/2176] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:56 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:57.239076 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2aa23-db21-45b8-8b29-8f27132952fb None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:57.241996 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-2ac2aa23-db21-45b8-8b29-8f27132952fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:57.459698 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2aa23-db21-45b8-8b29-8f27132952fb None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:57.472481 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d285d2f-a586-485f-ba65-e794f0f8fc51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:57.473149 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d285d2f-a586-485f-ba65-e794f0f8fc51 service nova] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:57.473701 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d285d2f-a586-485f-ba65-e794f0f8fc51 service nova] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:57.474130 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d285d2f-a586-485f-ba65-e794f0f8fc51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:57.572587 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d285d2f-a586-485f-ba65-e794f0f8fc51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:57.574262 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d285d2f-a586-485f-ba65-e794f0f8fc51 service nova] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:57.597077 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1090/2177] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:57 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:38:57.623270 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328c0f4-a4a2-4e81-a407-a1f29cb188f8 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:57.748329 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328c0f4-a4a2-4e81-a407-a1f29cb188f8 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:57.758967 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755afb7-2db8-4c6d-9577-37980ba49d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:57.760114 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755afb7-2db8-4c6d-9577-37980ba49d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:57.761144 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755afb7-2db8-4c6d-9577-37980ba49d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:57.761636 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755afb7-2db8-4c6d-9577-37980ba49d8e admin admin] PATH_INFO: `/v3/users/e0176fb8304e4f1889735be2d8d2ab9e` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:57.764702 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755afb7-2db8-4c6d-9577-37980ba49d8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0176fb8304e4f1889735be2d8d2ab9e)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:57.767589 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755afb7-2db8-4c6d-9577-37980ba49d8e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:57.877254 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a755afb7-2db8-4c6d-9577-37980ba49d8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0176fb8304e4f1889735be2d8d2ab9e'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:57.883175 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a755afb7-2db8-4c6d-9577-37980ba49d8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0176fb8304e4f1889735be2d8d2ab9e'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:57.895191 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a755afb7-2db8-4c6d-9577-37980ba49d8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0176fb8304e4f1889735be2d8d2ab9e'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:57.917256 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a755afb7-2db8-4c6d-9577-37980ba49d8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0176fb8304e4f1889735be2d8d2ab9e'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:57.958746 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a755afb7-2db8-4c6d-9577-37980ba49d8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0176fb8304e4f1889735be2d8d2ab9e'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:57.986199 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2030c-1194-40f7-b4da-9b2146ea92f2 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:57.986458 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1088/2178] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:38:57 2021] DELETE /identity/v3/users/e0176fb8304e4f1889735be2d8d2ab9e => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:38:57.986826 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2030c-1194-40f7-b4da-9b2146ea92f2 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:57.987200 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2030c-1194-40f7-b4da-9b2146ea92f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:58.024234 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-fff2030c-1194-40f7-b4da-9b2146ea92f2 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:38:58.025990 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-fff2030c-1194-40f7-b4da-9b2146ea92f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:58.140412 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1091/2179] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:38:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:38:58.150973 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755afb7-2db8-4c6d-9577-37980ba49d8e admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:58.153558 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-a755afb7-2db8-4c6d-9577-37980ba49d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:58.247583 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755afb7-2db8-4c6d-9577-37980ba49d8e admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:58.264669 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbb4dd-1564-464f-80dd-f6d00e5bb25c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:58.267813 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbb4dd-1564-464f-80dd-f6d00e5bb25c service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:58.268410 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbb4dd-1564-464f-80dd-f6d00e5bb25c service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:58.268930 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbb4dd-1564-464f-80dd-f6d00e5bb25c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:58.295814 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbbb4dd-1564-464f-80dd-f6d00e5bb25c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:58.299641 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbbb4dd-1564-464f-80dd-f6d00e5bb25c service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:58.322243 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1089/2180] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:38:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:38:58.761331 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2030c-1194-40f7-b4da-9b2146ea92f2 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:58.762973 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-fff2030c-1194-40f7-b4da-9b2146ea92f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:58.780144 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2030c-1194-40f7-b4da-9b2146ea92f2 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:58.794720 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9750d13-040f-451b-b400-494d54a8ac15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:58.796199 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9750d13-040f-451b-b400-494d54a8ac15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:58.796763 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9750d13-040f-451b-b400-494d54a8ac15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:58.797043 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9750d13-040f-451b-b400-494d54a8ac15 admin admin] PATH_INFO: `/v3/projects/f59fada0ad854ec89a907a151febaee6` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:58.798318 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9750d13-040f-451b-b400-494d54a8ac15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f59fada0ad854ec89a907a151febaee6)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:58.800336 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9750d13-040f-451b-b400-494d54a8ac15 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:58.852989 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c9750d13-040f-451b-b400-494d54a8ac15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f59fada0ad854ec89a907a151febaee6', 'request_id': 'req-c9750d13-040f-451b-b400-494d54a8ac15'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:58.861047 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c9750d13-040f-451b-b400-494d54a8ac15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f59fada0ad854ec89a907a151febaee6', 'request_id': 'req-c9750d13-040f-451b-b400-494d54a8ac15'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:58.875278 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c9750d13-040f-451b-b400-494d54a8ac15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f59fada0ad854ec89a907a151febaee6', 'request_id': 'req-c9750d13-040f-451b-b400-494d54a8ac15'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:58.891076 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c9750d13-040f-451b-b400-494d54a8ac15 admin admin] The token cache is being invalidate because project f59fada0ad854ec89a907a151febaee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:38:58.891383 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c9750d13-040f-451b-b400-494d54a8ac15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:58.892274 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c9750d13-040f-451b-b400-494d54a8ac15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:58.893951 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1092/2181] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:38:58 2021] DELETE /identity/v3/projects/f59fada0ad854ec89a907a151febaee6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:38:58.898143 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbb4dd-1564-464f-80dd-f6d00e5bb25c service neutron] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:58.909170 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbb4dd-1564-464f-80dd-f6d00e5bb25c service neutron] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:38:58.994908 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f037f5-fa80-40f5-90b3-bb9682a47256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:38:58.996180 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f037f5-fa80-40f5-90b3-bb9682a47256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:38:58.996726 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f037f5-fa80-40f5-90b3-bb9682a47256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:38:58.998072 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f037f5-fa80-40f5-90b3-bb9682a47256 admin admin] PATH_INFO: `/v3/users/57bad7b078a6477ca8b58b29c72355fd` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:38:58.999917 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f037f5-fa80-40f5-90b3-bb9682a47256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57bad7b078a6477ca8b58b29c72355fd)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:38:59.002747 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f037f5-fa80-40f5-90b3-bb9682a47256 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:38:59.094540 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-14f037f5-fa80-40f5-90b3-bb9682a47256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57bad7b078a6477ca8b58b29c72355fd'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:59.097540 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-14f037f5-fa80-40f5-90b3-bb9682a47256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57bad7b078a6477ca8b58b29c72355fd'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:59.116395 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-14f037f5-fa80-40f5-90b3-bb9682a47256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57bad7b078a6477ca8b58b29c72355fd'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:59.132073 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-14f037f5-fa80-40f5-90b3-bb9682a47256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57bad7b078a6477ca8b58b29c72355fd'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:59.168722 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-14f037f5-fa80-40f5-90b3-bb9682a47256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57bad7b078a6477ca8b58b29c72355fd'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:38:59.191767 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1090/2182] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:38:58 2021] DELETE /identity/v3/users/57bad7b078a6477ca8b58b29c72355fd => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:38:59.967039 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9750d13-040f-451b-b400-494d54a8ac15 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:38:59.969056 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-c9750d13-040f-451b-b400-494d54a8ac15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:38:59.985794 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9750d13-040f-451b-b400-494d54a8ac15 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:00.122214 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d8ddb-eb70-4fe6-9df3-d3afa8776b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:00.123425 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d8ddb-eb70-4fe6-9df3-d3afa8776b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:00.123804 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d8ddb-eb70-4fe6-9df3-d3afa8776b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:00.124198 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d8ddb-eb70-4fe6-9df3-d3afa8776b73 admin admin] PATH_INFO: `/v3/projects/d18e8a485fc4465ca3b01c3e70a9eb30` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:00.125981 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d8ddb-eb70-4fe6-9df3-d3afa8776b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d18e8a485fc4465ca3b01c3e70a9eb30)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:00.128050 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d8ddb-eb70-4fe6-9df3-d3afa8776b73 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:00.222499 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4b8d8ddb-eb70-4fe6-9df3-d3afa8776b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd18e8a485fc4465ca3b01c3e70a9eb30', 'request_id': 'req-4b8d8ddb-eb70-4fe6-9df3-d3afa8776b73'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:00.237209 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4b8d8ddb-eb70-4fe6-9df3-d3afa8776b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd18e8a485fc4465ca3b01c3e70a9eb30', 'request_id': 'req-4b8d8ddb-eb70-4fe6-9df3-d3afa8776b73'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:00.253652 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4b8d8ddb-eb70-4fe6-9df3-d3afa8776b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd18e8a485fc4465ca3b01c3e70a9eb30', 'request_id': 'req-4b8d8ddb-eb70-4fe6-9df3-d3afa8776b73'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:00.267967 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4b8d8ddb-eb70-4fe6-9df3-d3afa8776b73 admin admin] The token cache is being invalidate because project d18e8a485fc4465ca3b01c3e70a9eb30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:39:00.268431 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4b8d8ddb-eb70-4fe6-9df3-d3afa8776b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:00.271124 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4b8d8ddb-eb70-4fe6-9df3-d3afa8776b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:00.278778 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1093/2183] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:38:59 2021] DELETE /identity/v3/projects/d18e8a485fc4465ca3b01c3e70a9eb30 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:39:00.281416 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b084e-6a53-4a25-ba71-9efde979e5e3 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:00.282013 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b084e-6a53-4a25-ba71-9efde979e5e3 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:00.282598 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b084e-6a53-4a25-ba71-9efde979e5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:00.304512 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-4f7b084e-6a53-4a25-ba71-9efde979e5e3 None None] MFA Rules not processed for user `50c574405738412ab7acbbf1ac687864`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:39:00.305036 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe97ae-ae51-47e0-a0a4-b235bc42b137 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:00.306190 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-4f7b084e-6a53-4a25-ba71-9efde979e5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:00.306720 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe97ae-ae51-47e0-a0a4-b235bc42b137 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:00.306978 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe97ae-ae51-47e0-a0a4-b235bc42b137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:00.344223 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-5dfe97ae-ae51-47e0-a0a4-b235bc42b137 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:39:00.347133 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-5dfe97ae-ae51-47e0-a0a4-b235bc42b137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:00.429077 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1091/2184] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:39:00 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:39:00.441648 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1094/2185] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:39:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:39:00.452482 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa3104-3a0b-4af2-a0d6-c48e64f749b0 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:00.452971 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa3104-3a0b-4af2-a0d6-c48e64f749b0 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:00.453470 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa3104-3a0b-4af2-a0d6-c48e64f749b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:00.516806 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-6afa3104-3a0b-4af2-a0d6-c48e64f749b0 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:39:00.524139 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-6afa3104-3a0b-4af2-a0d6-c48e64f749b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:00.553405 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1092/2186] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:39:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:39:00.557736 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe97ae-ae51-47e0-a0a4-b235bc42b137 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:00.591654 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe97ae-ae51-47e0-a0a4-b235bc42b137 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:00.616844 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd576dab-78e5-4e10-a251-75975a75f6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:00.621563 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd576dab-78e5-4e10-a251-75975a75f6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:00.622208 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd576dab-78e5-4e10-a251-75975a75f6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:00.622704 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd576dab-78e5-4e10-a251-75975a75f6a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:00.623674 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd576dab-78e5-4e10-a251-75975a75f6a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:39:00.624184 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd576dab-78e5-4e10-a251-75975a75f6a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:00.626706 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd576dab-78e5-4e10-a251-75975a75f6a6 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:00.684535 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1095/2187] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:39:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:39:00.688810 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa3104-3a0b-4af2-a0d6-c48e64f749b0 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:00.702072 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa3104-3a0b-4af2-a0d6-c48e64f749b0 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:00.716807 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c0114-7ef0-4d0b-bd6e-c63495ad4c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:00.720973 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c0114-7ef0-4d0b-bd6e-c63495ad4c43 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:00.722025 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c0114-7ef0-4d0b-bd6e-c63495ad4c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:00.722458 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c0114-7ef0-4d0b-bd6e-c63495ad4c43 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:00.725155 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c0114-7ef0-4d0b-bd6e-c63495ad4c43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:00.731526 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c0114-7ef0-4d0b-bd6e-c63495ad4c43 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:00.819602 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1093/2188] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:39:00 2021] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:39:00.821395 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd576dab-78e5-4e10-a251-75975a75f6a6 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:00.843460 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd576dab-78e5-4e10-a251-75975a75f6a6 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:00.965488 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c53d21-78de-44f6-9c25-bf5a133d3a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:00.966197 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c53d21-78de-44f6-9c25-bf5a133d3a36 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:00.966545 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c53d21-78de-44f6-9c25-bf5a133d3a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:00.966928 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c53d21-78de-44f6-9c25-bf5a133d3a36 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:00.968111 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c53d21-78de-44f6-9c25-bf5a133d3a36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:00.974922 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c53d21-78de-44f6-9c25-bf5a133d3a36 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:01.051078 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1096/2189] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:39:00 2021] POST /identity/v3/users => generated 288 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:39:01.055159 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c0114-7ef0-4d0b-bd6e-c63495ad4c43 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:01.069482 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c0114-7ef0-4d0b-bd6e-c63495ad4c43 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:01.077107 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3172420-f42e-4943-9565-671fa24e966c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:01.077949 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3172420-f42e-4943-9565-671fa24e966c admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:01.078475 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3172420-f42e-4943-9565-671fa24e966c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:01.078804 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3172420-f42e-4943-9565-671fa24e966c admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:01.081952 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3172420-f42e-4943-9565-671fa24e966c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:01.084909 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3172420-f42e-4943-9565-671fa24e966c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:01.100750 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1094/2190] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:39:01 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:39:01.102204 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c53d21-78de-44f6-9c25-bf5a133d3a36 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:01.114266 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c53d21-78de-44f6-9c25-bf5a133d3a36 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:01.127503 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87238e-d465-428a-9fe2-2a4dd6c98f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:01.130108 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87238e-d465-428a-9fe2-2a4dd6c98f98 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:01.131304 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87238e-d465-428a-9fe2-2a4dd6c98f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:01.132505 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87238e-d465-428a-9fe2-2a4dd6c98f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:01.133637 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87238e-d465-428a-9fe2-2a4dd6c98f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:01.137553 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87238e-d465-428a-9fe2-2a4dd6c98f98 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:01.153347 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1097/2191] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:39:01 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:39:01.157549 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3172420-f42e-4943-9565-671fa24e966c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:01.193215 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3172420-f42e-4943-9565-671fa24e966c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:01.204340 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7302ff1-100b-4004-9290-2b5ce1a54b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:01.205511 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7302ff1-100b-4004-9290-2b5ce1a54b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:01.205878 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7302ff1-100b-4004-9290-2b5ce1a54b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:01.206388 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7302ff1-100b-4004-9290-2b5ce1a54b37 admin admin] PATH_INFO: `/v3/projects/93beb4f813aa461d82a986b9ad136e7a/users/8caf57619fa34a23872f4a615b3d28be/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:01.230402 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7302ff1-100b-4004-9290-2b5ce1a54b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93beb4f813aa461d82a986b9ad136e7a, user_id=8caf57619fa34a23872f4a615b3d28be, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:01.235526 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7302ff1-100b-4004-9290-2b5ce1a54b37 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:01.299244 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87738b82-ced4-4d87-804b-9cd2b31e9752 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:01.299512 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87738b82-ced4-4d87-804b-9cd2b31e9752 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:01.299798 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87738b82-ced4-4d87-804b-9cd2b31e9752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:01.299995 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1095/2192] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:39:01 2021] PUT /identity/v3/projects/93beb4f813aa461d82a986b9ad136e7a/users/8caf57619fa34a23872f4a615b3d28be/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:39:01.407894 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-87738b82-ced4-4d87-804b-9cd2b31e9752 None None] MFA Rules not processed for user `8caf57619fa34a23872f4a615b3d28be`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:39:01.412423 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-87738b82-ced4-4d87-804b-9cd2b31e9752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:01.494474 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1098/2193] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:39:01 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:39:01.505467 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7302ff1-100b-4004-9290-2b5ce1a54b37 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:01.508586 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-d7302ff1-100b-4004-9290-2b5ce1a54b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:01.582078 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7302ff1-100b-4004-9290-2b5ce1a54b37 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:01.586822 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812d9b8-a4fa-49cd-a806-a62e5ef63c01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:01.587609 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812d9b8-a4fa-49cd-a806-a62e5ef63c01 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:01.587981 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812d9b8-a4fa-49cd-a806-a62e5ef63c01 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:01.588380 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812d9b8-a4fa-49cd-a806-a62e5ef63c01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:01.598939 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812d9b8-a4fa-49cd-a806-a62e5ef63c01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:01.600812 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812d9b8-a4fa-49cd-a806-a62e5ef63c01 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:01.622782 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1096/2194] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:39:01 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:39:05.001751 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87738b82-ced4-4d87-804b-9cd2b31e9752 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:05.076073 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87738b82-ced4-4d87-804b-9cd2b31e9752 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:05.082809 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd4198-1d80-4adb-9d07-6e21355a15b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:05.083701 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd4198-1d80-4adb-9d07-6e21355a15b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:05.083977 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd4198-1d80-4adb-9d07-6e21355a15b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:05.084248 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd4198-1d80-4adb-9d07-6e21355a15b2 admin admin] PATH_INFO: `/v3/users/8caf57619fa34a23872f4a615b3d28be` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:05.085669 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd4198-1d80-4adb-9d07-6e21355a15b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8caf57619fa34a23872f4a615b3d28be)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:05.087647 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd4198-1d80-4adb-9d07-6e21355a15b2 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:05.146996 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a3bd4198-1d80-4adb-9d07-6e21355a15b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8caf57619fa34a23872f4a615b3d28be'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:05.156357 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a3bd4198-1d80-4adb-9d07-6e21355a15b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8caf57619fa34a23872f4a615b3d28be'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:05.157150 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a3bd4198-1d80-4adb-9d07-6e21355a15b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8caf57619fa34a23872f4a615b3d28be'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:05.168856 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a3bd4198-1d80-4adb-9d07-6e21355a15b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8caf57619fa34a23872f4a615b3d28be'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:05.176390 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a3bd4198-1d80-4adb-9d07-6e21355a15b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8caf57619fa34a23872f4a615b3d28be'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:05.183934 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1099/2195] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:39:05 2021] DELETE /identity/v3/users/8caf57619fa34a23872f4a615b3d28be => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:39:05.190431 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0960e9-614b-4baa-9d8a-0f055c204ece None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:05.191114 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0960e9-614b-4baa-9d8a-0f055c204ece None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:05.191114 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0960e9-614b-4baa-9d8a-0f055c204ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:05.209312 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-ef0960e9-614b-4baa-9d8a-0f055c204ece None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:39:05.210532 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-ef0960e9-614b-4baa-9d8a-0f055c204ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:05.280245 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1097/2196] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:39:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:39:05.291452 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd4198-1d80-4adb-9d07-6e21355a15b2 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:05.293115 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a3bd4198-1d80-4adb-9d07-6e21355a15b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:05.354341 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd4198-1d80-4adb-9d07-6e21355a15b2 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:05.358851 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0fd06-14f3-43f1-8bba-ea98f790a3eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:05.359501 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0fd06-14f3-43f1-8bba-ea98f790a3eb service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:05.359780 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0fd06-14f3-43f1-8bba-ea98f790a3eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:05.360094 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0fd06-14f3-43f1-8bba-ea98f790a3eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:05.369638 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0fd06-14f3-43f1-8bba-ea98f790a3eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:05.371097 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0fd06-14f3-43f1-8bba-ea98f790a3eb service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:05.380434 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1100/2197] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:39:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:39:05.652636 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0960e9-614b-4baa-9d8a-0f055c204ece None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:05.654463 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-ef0960e9-614b-4baa-9d8a-0f055c204ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:05.677950 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0960e9-614b-4baa-9d8a-0f055c204ece None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:05.684014 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1673d83-0e79-491a-b92b-7d10a8332e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:05.684909 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1673d83-0e79-491a-b92b-7d10a8332e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:05.685184 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1673d83-0e79-491a-b92b-7d10a8332e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:05.685648 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1673d83-0e79-491a-b92b-7d10a8332e01 admin admin] PATH_INFO: `/v3/projects/93beb4f813aa461d82a986b9ad136e7a` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:05.687198 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1673d83-0e79-491a-b92b-7d10a8332e01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93beb4f813aa461d82a986b9ad136e7a)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:05.689687 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1673d83-0e79-491a-b92b-7d10a8332e01 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:05.745742 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a1673d83-0e79-491a-b92b-7d10a8332e01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93beb4f813aa461d82a986b9ad136e7a', 'request_id': 'req-a1673d83-0e79-491a-b92b-7d10a8332e01'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:05.752147 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a1673d83-0e79-491a-b92b-7d10a8332e01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93beb4f813aa461d82a986b9ad136e7a', 'request_id': 'req-a1673d83-0e79-491a-b92b-7d10a8332e01'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:05.760409 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a1673d83-0e79-491a-b92b-7d10a8332e01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93beb4f813aa461d82a986b9ad136e7a', 'request_id': 'req-a1673d83-0e79-491a-b92b-7d10a8332e01'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:05.771064 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a1673d83-0e79-491a-b92b-7d10a8332e01 admin admin] The token cache is being invalidate because project 93beb4f813aa461d82a986b9ad136e7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:39:05.771351 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a1673d83-0e79-491a-b92b-7d10a8332e01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:05.771992 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a1673d83-0e79-491a-b92b-7d10a8332e01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:05.773750 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1098/2198] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:39:05 2021] DELETE /identity/v3/projects/93beb4f813aa461d82a986b9ad136e7a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:39:05.779721 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84eadc-fecd-40f6-a452-6114c6ad8c02 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:05.780004 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84eadc-fecd-40f6-a452-6114c6ad8c02 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:05.780273 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84eadc-fecd-40f6-a452-6114c6ad8c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:05.807068 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-6e84eadc-fecd-40f6-a452-6114c6ad8c02 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:39:05.808275 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-6e84eadc-fecd-40f6-a452-6114c6ad8c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:05.867560 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1101/2199] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:39:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:39:05.875432 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f101641-687b-4541-82d3-9aa96fa5959c None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:05.876037 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f101641-687b-4541-82d3-9aa96fa5959c None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:05.876346 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f101641-687b-4541-82d3-9aa96fa5959c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:05.896024 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-9f101641-687b-4541-82d3-9aa96fa5959c None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:39:05.897341 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-9f101641-687b-4541-82d3-9aa96fa5959c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:05.910836 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1099/2200] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:39:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:39:05.915211 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84eadc-fecd-40f6-a452-6114c6ad8c02 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:05.925802 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84eadc-fecd-40f6-a452-6114c6ad8c02 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:05.935993 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba6f77-7d7f-4539-bd65-c005279a508c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:05.936751 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba6f77-7d7f-4539-bd65-c005279a508c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:05.937028 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba6f77-7d7f-4539-bd65-c005279a508c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:05.937321 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba6f77-7d7f-4539-bd65-c005279a508c admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:05.938095 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba6f77-7d7f-4539-bd65-c005279a508c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:39:05.938396 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba6f77-7d7f-4539-bd65-c005279a508c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:05.940031 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba6f77-7d7f-4539-bd65-c005279a508c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:05.952324 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1102/2201] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:39:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:39:05.956806 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f101641-687b-4541-82d3-9aa96fa5959c None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:05.966136 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f101641-687b-4541-82d3-9aa96fa5959c None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:05.970994 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a7628-8ade-4bc6-93b5-c608e7c50633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:05.971574 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a7628-8ade-4bc6-93b5-c608e7c50633 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:05.971848 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a7628-8ade-4bc6-93b5-c608e7c50633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:05.972115 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a7628-8ade-4bc6-93b5-c608e7c50633 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:05.972821 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a7628-8ade-4bc6-93b5-c608e7c50633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:05.974725 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a7628-8ade-4bc6-93b5-c608e7c50633 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:06.000685 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1100/2202] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:39:05 2021] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:39:06.006065 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba6f77-7d7f-4539-bd65-c005279a508c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:06.019429 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba6f77-7d7f-4539-bd65-c005279a508c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:06.078159 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617bae7a-9ecb-483e-8a9e-7df27b18c680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:06.078927 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bae7a-9ecb-483e-8a9e-7df27b18c680 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:06.079215 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bae7a-9ecb-483e-8a9e-7df27b18c680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:06.079483 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bae7a-9ecb-483e-8a9e-7df27b18c680 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:06.080209 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617bae7a-9ecb-483e-8a9e-7df27b18c680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:06.082121 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617bae7a-9ecb-483e-8a9e-7df27b18c680 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:06.102275 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1103/2203] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:39:06 2021] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:39:06.106434 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a7628-8ade-4bc6-93b5-c608e7c50633 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:06.120091 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a7628-8ade-4bc6-93b5-c608e7c50633 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:06.125912 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79207da2-4abd-46a8-83cc-c7653de61ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:06.126611 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79207da2-4abd-46a8-83cc-c7653de61ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:06.126913 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79207da2-4abd-46a8-83cc-c7653de61ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:06.127210 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79207da2-4abd-46a8-83cc-c7653de61ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:06.127953 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79207da2-4abd-46a8-83cc-c7653de61ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:06.129608 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79207da2-4abd-46a8-83cc-c7653de61ad2 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:06.141548 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1101/2204] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:39:06 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:39:06.145844 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617bae7a-9ecb-483e-8a9e-7df27b18c680 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:06.155832 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617bae7a-9ecb-483e-8a9e-7df27b18c680 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:06.161145 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31207c2d-b3b4-4bba-847f-e63e5a0dd6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:06.161896 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31207c2d-b3b4-4bba-847f-e63e5a0dd6ff admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:06.162247 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31207c2d-b3b4-4bba-847f-e63e5a0dd6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:06.162607 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31207c2d-b3b4-4bba-847f-e63e5a0dd6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:06.163494 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31207c2d-b3b4-4bba-847f-e63e5a0dd6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:06.165166 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31207c2d-b3b4-4bba-847f-e63e5a0dd6ff admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:06.175708 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1104/2205] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:39:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:39:06.179802 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79207da2-4abd-46a8-83cc-c7653de61ad2 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:06.190083 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79207da2-4abd-46a8-83cc-c7653de61ad2 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:06.195041 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be669725-f9c7-458c-85d9-484c115f6139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:06.195996 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be669725-f9c7-458c-85d9-484c115f6139 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:06.196280 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be669725-f9c7-458c-85d9-484c115f6139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:06.196554 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be669725-f9c7-458c-85d9-484c115f6139 admin admin] PATH_INFO: `/v3/projects/918203710ede47dcb2a5b68353dc0a03/users/a4641a3d72fb4e00bf55f58cf0296cb8/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:06.213166 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be669725-f9c7-458c-85d9-484c115f6139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=918203710ede47dcb2a5b68353dc0a03, user_id=a4641a3d72fb4e00bf55f58cf0296cb8, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:06.216060 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be669725-f9c7-458c-85d9-484c115f6139 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:06.230974 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1102/2206] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:39:06 2021] PUT /identity/v3/projects/918203710ede47dcb2a5b68353dc0a03/users/a4641a3d72fb4e00bf55f58cf0296cb8/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:39:06.241200 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9770167-201e-427a-b32c-d5eed4521f46 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:06.241487 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9770167-201e-427a-b32c-d5eed4521f46 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:06.241760 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9770167-201e-427a-b32c-d5eed4521f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:06.274602 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-a9770167-201e-427a-b32c-d5eed4521f46 None None] MFA Rules not processed for user `a4641a3d72fb4e00bf55f58cf0296cb8`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:39:06.275914 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a9770167-201e-427a-b32c-d5eed4521f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:06.353678 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1105/2207] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:39:06 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:39:06.358480 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be669725-f9c7-458c-85d9-484c115f6139 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:06.422777 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be669725-f9c7-458c-85d9-484c115f6139 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:06.429111 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d408c0-2260-4f3f-800a-27b3ced9957c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:06.429780 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d408c0-2260-4f3f-800a-27b3ced9957c admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:06.430047 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d408c0-2260-4f3f-800a-27b3ced9957c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:06.430336 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d408c0-2260-4f3f-800a-27b3ced9957c admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:06.431096 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d408c0-2260-4f3f-800a-27b3ced9957c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:06.433007 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d408c0-2260-4f3f-800a-27b3ced9957c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:06.461519 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1103/2208] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:39:06 2021] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:39:06.466231 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9770167-201e-427a-b32c-d5eed4521f46 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:06.478714 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9770167-201e-427a-b32c-d5eed4521f46 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:06.538628 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce5470-79c6-4e12-95cd-7d082fc495eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:06.539340 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce5470-79c6-4e12-95cd-7d082fc495eb admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:06.539620 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce5470-79c6-4e12-95cd-7d082fc495eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:06.539889 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce5470-79c6-4e12-95cd-7d082fc495eb admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:06.540617 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce5470-79c6-4e12-95cd-7d082fc495eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:06.542559 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce5470-79c6-4e12-95cd-7d082fc495eb admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:06.563349 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1106/2209] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:39:06 2021] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:39:06.569092 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d408c0-2260-4f3f-800a-27b3ced9957c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:06.579815 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d408c0-2260-4f3f-800a-27b3ced9957c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:06.585145 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b59a6-d3f2-46c0-9bc5-1a1fafbd0faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:06.585825 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b59a6-d3f2-46c0-9bc5-1a1fafbd0faa admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:06.586111 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b59a6-d3f2-46c0-9bc5-1a1fafbd0faa admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:06.586389 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b59a6-d3f2-46c0-9bc5-1a1fafbd0faa admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:06.587205 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b59a6-d3f2-46c0-9bc5-1a1fafbd0faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:06.588942 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b59a6-d3f2-46c0-9bc5-1a1fafbd0faa admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:06.600704 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1104/2210] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:39:06 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:39:06.604914 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce5470-79c6-4e12-95cd-7d082fc495eb admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:06.615043 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce5470-79c6-4e12-95cd-7d082fc495eb admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:06.620066 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c11f2-aec1-4b75-a998-00b8adf4cdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:06.620740 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c11f2-aec1-4b75-a998-00b8adf4cdef admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:06.621014 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c11f2-aec1-4b75-a998-00b8adf4cdef admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:06.621327 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c11f2-aec1-4b75-a998-00b8adf4cdef admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:06.622201 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c11f2-aec1-4b75-a998-00b8adf4cdef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:06.623859 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c11f2-aec1-4b75-a998-00b8adf4cdef admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:06.635064 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1107/2211] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:39:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:39:06.639367 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b59a6-d3f2-46c0-9bc5-1a1fafbd0faa admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:06.649355 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b59a6-d3f2-46c0-9bc5-1a1fafbd0faa admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:06.654506 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff4a25-8384-45b8-b872-3d238af1bc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:06.655445 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff4a25-8384-45b8-b872-3d238af1bc1a admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:06.655723 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff4a25-8384-45b8-b872-3d238af1bc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:06.655991 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff4a25-8384-45b8-b872-3d238af1bc1a admin admin] PATH_INFO: `/v3/projects/da8bc08df8344a1aafeb0153039f06ce/users/1aff1022d7dc4827b0554508822b209e/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:06.672650 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff4a25-8384-45b8-b872-3d238af1bc1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=da8bc08df8344a1aafeb0153039f06ce, user_id=1aff1022d7dc4827b0554508822b209e, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:06.675345 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff4a25-8384-45b8-b872-3d238af1bc1a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:06.690976 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1105/2212] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:39:06 2021] PUT /identity/v3/projects/da8bc08df8344a1aafeb0153039f06ce/users/1aff1022d7dc4827b0554508822b209e/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:39:06.702040 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef210d-0617-457b-a5a6-e65137bbe6be None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:06.702327 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef210d-0617-457b-a5a6-e65137bbe6be None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:06.702603 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef210d-0617-457b-a5a6-e65137bbe6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:06.729452 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-56ef210d-0617-457b-a5a6-e65137bbe6be None None] MFA Rules not processed for user `1aff1022d7dc4827b0554508822b209e`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:39:06.731861 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-56ef210d-0617-457b-a5a6-e65137bbe6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:06.799672 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1108/2213] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:39:06 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:39:06.804348 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff4a25-8384-45b8-b872-3d238af1bc1a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:06.886050 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff4a25-8384-45b8-b872-3d238af1bc1a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:06.891769 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e5cc0-5321-43c4-a20d-1c4fe7c4e220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:06.892457 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e5cc0-5321-43c4-a20d-1c4fe7c4e220 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:06.892742 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e5cc0-5321-43c4-a20d-1c4fe7c4e220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:06.893014 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e5cc0-5321-43c4-a20d-1c4fe7c4e220 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:06.893896 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e5cc0-5321-43c4-a20d-1c4fe7c4e220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:06.895703 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e5cc0-5321-43c4-a20d-1c4fe7c4e220 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:06.933573 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1106/2214] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:39:06 2021] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:39:06.934490 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef210d-0617-457b-a5a6-e65137bbe6be None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:06.948840 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef210d-0617-457b-a5a6-e65137bbe6be None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:07.021464 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a3356-4c5c-47bd-adaa-b55e49048fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:07.022137 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a3356-4c5c-47bd-adaa-b55e49048fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:07.022340 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a3356-4c5c-47bd-adaa-b55e49048fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:07.022751 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a3356-4c5c-47bd-adaa-b55e49048fc8 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:07.025651 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a3356-4c5c-47bd-adaa-b55e49048fc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:07.027757 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a3356-4c5c-47bd-adaa-b55e49048fc8 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:07.050619 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1109/2215] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:39:06 2021] POST /identity/v3/users => generated 298 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:39:07.054969 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e5cc0-5321-43c4-a20d-1c4fe7c4e220 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:07.065741 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e5cc0-5321-43c4-a20d-1c4fe7c4e220 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:07.070270 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4065d-3c00-4321-b2c8-6ca4f2ba269b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:07.070975 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4065d-3c00-4321-b2c8-6ca4f2ba269b admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:07.071231 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4065d-3c00-4321-b2c8-6ca4f2ba269b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:07.071502 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4065d-3c00-4321-b2c8-6ca4f2ba269b admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:07.072250 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4065d-3c00-4321-b2c8-6ca4f2ba269b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:07.073831 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4065d-3c00-4321-b2c8-6ca4f2ba269b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:07.084784 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1107/2216] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:39:07 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:39:07.089061 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a3356-4c5c-47bd-adaa-b55e49048fc8 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:07.099515 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a3356-4c5c-47bd-adaa-b55e49048fc8 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:07.104407 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4cf2d6-d37c-4229-a62c-52b3a8cda8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:07.105302 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cf2d6-d37c-4229-a62c-52b3a8cda8ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:07.105582 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cf2d6-d37c-4229-a62c-52b3a8cda8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:07.105851 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cf2d6-d37c-4229-a62c-52b3a8cda8ba admin admin] PATH_INFO: `/v3/projects/098df54f7986427e84296209e82f66cb/users/e6ed64ceadc24a5abc2ff30c5a19d79c/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:07.123912 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4cf2d6-d37c-4229-a62c-52b3a8cda8ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=098df54f7986427e84296209e82f66cb, user_id=e6ed64ceadc24a5abc2ff30c5a19d79c, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:07.127268 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4cf2d6-d37c-4229-a62c-52b3a8cda8ba admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:07.141514 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1110/2217] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:39:07 2021] PUT /identity/v3/projects/098df54f7986427e84296209e82f66cb/users/e6ed64ceadc24a5abc2ff30c5a19d79c/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:39:07.146318 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4065d-3c00-4321-b2c8-6ca4f2ba269b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:07.159646 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4065d-3c00-4321-b2c8-6ca4f2ba269b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:07.217798 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71508d48-b19c-43ba-ac56-0be7de30c182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:07.218532 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71508d48-b19c-43ba-ac56-0be7de30c182 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:07.218778 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71508d48-b19c-43ba-ac56-0be7de30c182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:07.219088 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71508d48-b19c-43ba-ac56-0be7de30c182 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:07.219866 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71508d48-b19c-43ba-ac56-0be7de30c182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:07.221444 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71508d48-b19c-43ba-ac56-0be7de30c182 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:07.231889 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1108/2218] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:39:07 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:39:07.235764 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4cf2d6-d37c-4229-a62c-52b3a8cda8ba admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:07.246723 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4cf2d6-d37c-4229-a62c-52b3a8cda8ba admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:07.251492 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0223e-820d-4bb9-9cc7-08968c5570d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:07.252522 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0223e-820d-4bb9-9cc7-08968c5570d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:07.252827 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0223e-820d-4bb9-9cc7-08968c5570d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:07.253057 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0223e-820d-4bb9-9cc7-08968c5570d7 admin admin] PATH_INFO: `/v3/projects/098df54f7986427e84296209e82f66cb/users/e6ed64ceadc24a5abc2ff30c5a19d79c/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:07.255063 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0223e-820d-4bb9-9cc7-08968c5570d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098df54f7986427e84296209e82f66cb, user_id=e6ed64ceadc24a5abc2ff30c5a19d79c, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:07.257652 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0223e-820d-4bb9-9cc7-08968c5570d7 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:07.268641 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1111/2219] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:39:07 2021] PUT /identity/v3/projects/098df54f7986427e84296209e82f66cb/users/e6ed64ceadc24a5abc2ff30c5a19d79c/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:39:07.278600 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48feee4a-c6a1-4784-a2f5-6632b1bc6052 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:07.279066 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48feee4a-c6a1-4784-a2f5-6632b1bc6052 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:07.279409 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48feee4a-c6a1-4784-a2f5-6632b1bc6052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:07.307497 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-48feee4a-c6a1-4784-a2f5-6632b1bc6052 None None] MFA Rules not processed for user `e6ed64ceadc24a5abc2ff30c5a19d79c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:39:07.308753 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-48feee4a-c6a1-4784-a2f5-6632b1bc6052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:07.374622 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1109/2220] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:39:07 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:39:07.385211 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0223e-820d-4bb9-9cc7-08968c5570d7 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:07.387729 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-c6b0223e-820d-4bb9-9cc7-08968c5570d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:07.449493 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0223e-820d-4bb9-9cc7-08968c5570d7 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:07.453270 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc375f-684d-4feb-81d8-3c90958a35b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:07.453966 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc375f-684d-4feb-81d8-3c90958a35b1 service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:07.454240 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc375f-684d-4feb-81d8-3c90958a35b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:07.454510 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc375f-684d-4feb-81d8-3c90958a35b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:07.516902 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc375f-684d-4feb-81d8-3c90958a35b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:07.518366 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc375f-684d-4feb-81d8-3c90958a35b1 service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:07.528788 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1112/2221] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:39:07 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:39:09.016087 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48feee4a-c6a1-4784-a2f5-6632b1bc6052 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:09.026540 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48feee4a-c6a1-4784-a2f5-6632b1bc6052 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:09.030874 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83969912-21bb-4dbf-b54f-91b6d036439e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:09.031691 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83969912-21bb-4dbf-b54f-91b6d036439e service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:09.031968 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83969912-21bb-4dbf-b54f-91b6d036439e service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:09.032234 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83969912-21bb-4dbf-b54f-91b6d036439e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:09.097379 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83969912-21bb-4dbf-b54f-91b6d036439e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:09.103889 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83969912-21bb-4dbf-b54f-91b6d036439e service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:09.108914 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1110/2222] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:39:09 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:39:09.791013 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc375f-684d-4feb-81d8-3c90958a35b1 service cinder] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:09.800588 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc375f-684d-4feb-81d8-3c90958a35b1 service cinder] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:09.805187 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284f357-b389-4aa6-bea2-3db02cace4ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:09.805827 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284f357-b389-4aa6-bea2-3db02cace4ab service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:09.806099 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284f357-b389-4aa6-bea2-3db02cace4ab service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:09.806372 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284f357-b389-4aa6-bea2-3db02cace4ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:09.816349 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284f357-b389-4aa6-bea2-3db02cace4ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:09.817790 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284f357-b389-4aa6-bea2-3db02cace4ab service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:09.828078 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1113/2223] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:39:09 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:39:13.698652 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83969912-21bb-4dbf-b54f-91b6d036439e service cinder] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:13.773192 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83969912-21bb-4dbf-b54f-91b6d036439e service cinder] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:13.778098 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fd75a-1d62-4a2e-a268-bff58104b4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:13.779007 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fd75a-1d62-4a2e-a268-bff58104b4dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:13.779285 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fd75a-1d62-4a2e-a268-bff58104b4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:13.779554 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fd75a-1d62-4a2e-a268-bff58104b4dc admin admin] PATH_INFO: `/v3/users/a4641a3d72fb4e00bf55f58cf0296cb8` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:13.780853 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fd75a-1d62-4a2e-a268-bff58104b4dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4641a3d72fb4e00bf55f58cf0296cb8)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:13.782887 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fd75a-1d62-4a2e-a268-bff58104b4dc admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:13.834916 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-262fd75a-1d62-4a2e-a268-bff58104b4dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4641a3d72fb4e00bf55f58cf0296cb8'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:13.835804 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-262fd75a-1d62-4a2e-a268-bff58104b4dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4641a3d72fb4e00bf55f58cf0296cb8'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:13.845681 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-262fd75a-1d62-4a2e-a268-bff58104b4dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4641a3d72fb4e00bf55f58cf0296cb8'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:13.853206 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-262fd75a-1d62-4a2e-a268-bff58104b4dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4641a3d72fb4e00bf55f58cf0296cb8'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:13.867257 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-262fd75a-1d62-4a2e-a268-bff58104b4dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4641a3d72fb4e00bf55f58cf0296cb8'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:13.873755 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1111/2224] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:39:13 2021] DELETE /identity/v3/users/a4641a3d72fb4e00bf55f58cf0296cb8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:39:13.881364 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5b739-d2ae-44dc-b2ee-2e266d308d09 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:13.881849 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5b739-d2ae-44dc-b2ee-2e266d308d09 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:13.881939 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5b739-d2ae-44dc-b2ee-2e266d308d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:13.901878 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-81a5b739-d2ae-44dc-b2ee-2e266d308d09 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:39:13.903146 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-81a5b739-d2ae-44dc-b2ee-2e266d308d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:13.963368 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1114/2225] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:39:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:39:13.973840 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fd75a-1d62-4a2e-a268-bff58104b4dc admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:13.975695 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-262fd75a-1d62-4a2e-a268-bff58104b4dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:14.048188 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fd75a-1d62-4a2e-a268-bff58104b4dc admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:14.059497 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731792e-98f2-4b5b-ad70-eb680443865f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:14.060175 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731792e-98f2-4b5b-ad70-eb680443865f service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:14.060453 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731792e-98f2-4b5b-ad70-eb680443865f service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:14.062592 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731792e-98f2-4b5b-ad70-eb680443865f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:14.080991 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731792e-98f2-4b5b-ad70-eb680443865f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:14.082472 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731792e-98f2-4b5b-ad70-eb680443865f service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:14.099809 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1112/2226] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:39:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:39:14.404977 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5b739-d2ae-44dc-b2ee-2e266d308d09 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:14.406489 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-81a5b739-d2ae-44dc-b2ee-2e266d308d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:14.424036 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5b739-d2ae-44dc-b2ee-2e266d308d09 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:14.429238 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d10ba-1e31-42ed-8883-3eed1bc5f539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:14.430253 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d10ba-1e31-42ed-8883-3eed1bc5f539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:14.430641 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d10ba-1e31-42ed-8883-3eed1bc5f539 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:14.430953 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d10ba-1e31-42ed-8883-3eed1bc5f539 admin admin] PATH_INFO: `/v3/projects/918203710ede47dcb2a5b68353dc0a03` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:14.434003 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d10ba-1e31-42ed-8883-3eed1bc5f539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=918203710ede47dcb2a5b68353dc0a03)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:14.434207 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d10ba-1e31-42ed-8883-3eed1bc5f539 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:14.484124 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-464d10ba-1e31-42ed-8883-3eed1bc5f539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '918203710ede47dcb2a5b68353dc0a03', 'request_id': 'req-464d10ba-1e31-42ed-8883-3eed1bc5f539'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:14.490290 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-464d10ba-1e31-42ed-8883-3eed1bc5f539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '918203710ede47dcb2a5b68353dc0a03', 'request_id': 'req-464d10ba-1e31-42ed-8883-3eed1bc5f539'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:14.498833 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-464d10ba-1e31-42ed-8883-3eed1bc5f539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '918203710ede47dcb2a5b68353dc0a03', 'request_id': 'req-464d10ba-1e31-42ed-8883-3eed1bc5f539'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:14.509435 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-464d10ba-1e31-42ed-8883-3eed1bc5f539 admin admin] The token cache is being invalidate because project 918203710ede47dcb2a5b68353dc0a03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:39:14.509718 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-464d10ba-1e31-42ed-8883-3eed1bc5f539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:14.510338 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-464d10ba-1e31-42ed-8883-3eed1bc5f539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:14.511907 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1115/2227] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:39:14 2021] DELETE /identity/v3/projects/918203710ede47dcb2a5b68353dc0a03 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:39:14.515915 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731792e-98f2-4b5b-ad70-eb680443865f service neutron] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:14.526061 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731792e-98f2-4b5b-ad70-eb680443865f service neutron] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:14.584932 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1222b6-cf9c-48ad-9b6b-7c3fa8d0a436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:14.584932 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1222b6-cf9c-48ad-9b6b-7c3fa8d0a436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:14.584932 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1222b6-cf9c-48ad-9b6b-7c3fa8d0a436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:14.584932 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1222b6-cf9c-48ad-9b6b-7c3fa8d0a436 admin admin] PATH_INFO: `/v3/users/1aff1022d7dc4827b0554508822b209e` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:14.585433 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1222b6-cf9c-48ad-9b6b-7c3fa8d0a436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aff1022d7dc4827b0554508822b209e)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:14.587266 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1222b6-cf9c-48ad-9b6b-7c3fa8d0a436 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:14.635775 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-fd1222b6-cf9c-48ad-9b6b-7c3fa8d0a436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aff1022d7dc4827b0554508822b209e'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:14.636421 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-fd1222b6-cf9c-48ad-9b6b-7c3fa8d0a436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aff1022d7dc4827b0554508822b209e'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:14.644624 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-fd1222b6-cf9c-48ad-9b6b-7c3fa8d0a436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aff1022d7dc4827b0554508822b209e'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:14.652667 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-fd1222b6-cf9c-48ad-9b6b-7c3fa8d0a436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aff1022d7dc4827b0554508822b209e'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:14.666010 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-fd1222b6-cf9c-48ad-9b6b-7c3fa8d0a436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aff1022d7dc4827b0554508822b209e'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:14.672420 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1113/2228] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:39:14 2021] DELETE /identity/v3/users/1aff1022d7dc4827b0554508822b209e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:39:14.973910 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d10ba-1e31-42ed-8883-3eed1bc5f539 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:14.975458 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-464d10ba-1e31-42ed-8883-3eed1bc5f539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:14.990754 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d10ba-1e31-42ed-8883-3eed1bc5f539 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:15.049447 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a6a91-b69c-469e-884d-989db050943b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:15.050239 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a6a91-b69c-469e-884d-989db050943b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:15.050515 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a6a91-b69c-469e-884d-989db050943b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:15.050846 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a6a91-b69c-469e-884d-989db050943b admin admin] PATH_INFO: `/v3/projects/da8bc08df8344a1aafeb0153039f06ce` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:15.052007 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a6a91-b69c-469e-884d-989db050943b admin admin] RBAC: Authorizing `identity:delete_project(project_id=da8bc08df8344a1aafeb0153039f06ce)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:15.053940 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a6a91-b69c-469e-884d-989db050943b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:15.103430 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-0d5a6a91-b69c-469e-884d-989db050943b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da8bc08df8344a1aafeb0153039f06ce', 'request_id': 'req-0d5a6a91-b69c-469e-884d-989db050943b'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:15.110131 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-0d5a6a91-b69c-469e-884d-989db050943b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da8bc08df8344a1aafeb0153039f06ce', 'request_id': 'req-0d5a6a91-b69c-469e-884d-989db050943b'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:15.117767 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-0d5a6a91-b69c-469e-884d-989db050943b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da8bc08df8344a1aafeb0153039f06ce', 'request_id': 'req-0d5a6a91-b69c-469e-884d-989db050943b'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:15.129070 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-0d5a6a91-b69c-469e-884d-989db050943b admin admin] The token cache is being invalidate because project da8bc08df8344a1aafeb0153039f06ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:39:15.129362 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-0d5a6a91-b69c-469e-884d-989db050943b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:15.130118 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-0d5a6a91-b69c-469e-884d-989db050943b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:15.131925 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1116/2229] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:39:14 2021] DELETE /identity/v3/projects/da8bc08df8344a1aafeb0153039f06ce => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:39:15.136015 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1222b6-cf9c-48ad-9b6b-7c3fa8d0a436 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:15.137770 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-fd1222b6-cf9c-48ad-9b6b-7c3fa8d0a436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:15.150979 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1222b6-cf9c-48ad-9b6b-7c3fa8d0a436 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:15.208751 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91c71e-e9d8-4259-8ab3-d3cc683203c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:15.209776 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91c71e-e9d8-4259-8ab3-d3cc683203c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:15.210308 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91c71e-e9d8-4259-8ab3-d3cc683203c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:15.210627 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91c71e-e9d8-4259-8ab3-d3cc683203c1 admin admin] PATH_INFO: `/v3/users/e6ed64ceadc24a5abc2ff30c5a19d79c` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:15.212241 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91c71e-e9d8-4259-8ab3-d3cc683203c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6ed64ceadc24a5abc2ff30c5a19d79c)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:15.214170 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91c71e-e9d8-4259-8ab3-d3cc683203c1 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:15.272543 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-8c91c71e-e9d8-4259-8ab3-d3cc683203c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6ed64ceadc24a5abc2ff30c5a19d79c'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:15.273411 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-8c91c71e-e9d8-4259-8ab3-d3cc683203c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6ed64ceadc24a5abc2ff30c5a19d79c'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:15.284556 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-8c91c71e-e9d8-4259-8ab3-d3cc683203c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6ed64ceadc24a5abc2ff30c5a19d79c'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:15.296033 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-8c91c71e-e9d8-4259-8ab3-d3cc683203c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6ed64ceadc24a5abc2ff30c5a19d79c'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:15.311879 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-8c91c71e-e9d8-4259-8ab3-d3cc683203c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6ed64ceadc24a5abc2ff30c5a19d79c'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:15.319983 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1114/2230] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:39:15 2021] DELETE /identity/v3/users/e6ed64ceadc24a5abc2ff30c5a19d79c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:39:15.696342 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a6a91-b69c-469e-884d-989db050943b admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:15.698259 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-0d5a6a91-b69c-469e-884d-989db050943b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:15.716908 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a6a91-b69c-469e-884d-989db050943b admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:15.794290 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af937b-9621-4d68-928e-9ba4ea5bc14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:15.796519 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af937b-9621-4d68-928e-9ba4ea5bc14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:15.796519 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af937b-9621-4d68-928e-9ba4ea5bc14b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:15.796519 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af937b-9621-4d68-928e-9ba4ea5bc14b admin admin] PATH_INFO: `/v3/projects/098df54f7986427e84296209e82f66cb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:15.797310 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af937b-9621-4d68-928e-9ba4ea5bc14b admin admin] RBAC: Authorizing `identity:delete_project(project_id=098df54f7986427e84296209e82f66cb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:15.799364 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af937b-9621-4d68-928e-9ba4ea5bc14b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:15.847146 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-91af937b-9621-4d68-928e-9ba4ea5bc14b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '098df54f7986427e84296209e82f66cb', 'request_id': 'req-91af937b-9621-4d68-928e-9ba4ea5bc14b'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:15.853961 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-91af937b-9621-4d68-928e-9ba4ea5bc14b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '098df54f7986427e84296209e82f66cb', 'request_id': 'req-91af937b-9621-4d68-928e-9ba4ea5bc14b'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:15.872658 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-91af937b-9621-4d68-928e-9ba4ea5bc14b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '098df54f7986427e84296209e82f66cb', 'request_id': 'req-91af937b-9621-4d68-928e-9ba4ea5bc14b'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:15.883009 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-91af937b-9621-4d68-928e-9ba4ea5bc14b admin admin] The token cache is being invalidate because project 098df54f7986427e84296209e82f66cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:39:15.883284 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-91af937b-9621-4d68-928e-9ba4ea5bc14b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:15.883915 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-91af937b-9621-4d68-928e-9ba4ea5bc14b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:15.885447 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1117/2231] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:39:15 2021] DELETE /identity/v3/projects/098df54f7986427e84296209e82f66cb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:39:15.891685 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f181da-cd85-4c11-8551-539e34aa1148 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:15.892002 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f181da-cd85-4c11-8551-539e34aa1148 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:15.892309 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f181da-cd85-4c11-8551-539e34aa1148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:15.911501 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-41f181da-cd85-4c11-8551-539e34aa1148 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:39:15.912818 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-41f181da-cd85-4c11-8551-539e34aa1148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:15.974744 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1115/2232] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:39:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:39:15.983148 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e15064-a988-4b87-af66-3ee62e3de9cd None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:15.983661 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e15064-a988-4b87-af66-3ee62e3de9cd None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:15.983753 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e15064-a988-4b87-af66-3ee62e3de9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:16.002760 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-e0e15064-a988-4b87-af66-3ee62e3de9cd None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:39:16.004088 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-e0e15064-a988-4b87-af66-3ee62e3de9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:16.022941 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1118/2233] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:39:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:39:16.027552 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f181da-cd85-4c11-8551-539e34aa1148 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:16.039806 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f181da-cd85-4c11-8551-539e34aa1148 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:16.045158 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682f5ec-0354-4cf1-b13d-f592836722b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:16.045901 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682f5ec-0354-4cf1-b13d-f592836722b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:16.046240 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682f5ec-0354-4cf1-b13d-f592836722b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:16.046718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682f5ec-0354-4cf1-b13d-f592836722b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:16.047689 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682f5ec-0354-4cf1-b13d-f592836722b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:39:16.048213 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682f5ec-0354-4cf1-b13d-f592836722b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:16.050051 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682f5ec-0354-4cf1-b13d-f592836722b6 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:16.080025 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1116/2234] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:39:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:39:16.086498 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e15064-a988-4b87-af66-3ee62e3de9cd None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:16.109130 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e15064-a988-4b87-af66-3ee62e3de9cd None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:16.113969 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268cfa4-69ba-446c-ac9d-6342d7670cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:16.114720 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268cfa4-69ba-446c-ac9d-6342d7670cad admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:16.114959 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268cfa4-69ba-446c-ac9d-6342d7670cad admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:16.115227 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268cfa4-69ba-446c-ac9d-6342d7670cad admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:16.115948 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268cfa4-69ba-446c-ac9d-6342d7670cad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:16.118167 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268cfa4-69ba-446c-ac9d-6342d7670cad admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:16.149276 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1119/2235] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:39:16 2021] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:39:16.150604 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682f5ec-0354-4cf1-b13d-f592836722b6 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:16.161845 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682f5ec-0354-4cf1-b13d-f592836722b6 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:16.220945 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b693d7e-959b-465a-84c2-753fd143a3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:16.221618 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b693d7e-959b-465a-84c2-753fd143a3ca admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:16.221897 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b693d7e-959b-465a-84c2-753fd143a3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:16.222168 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b693d7e-959b-465a-84c2-753fd143a3ca admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:16.222900 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b693d7e-959b-465a-84c2-753fd143a3ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:16.224817 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b693d7e-959b-465a-84c2-753fd143a3ca admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:16.245371 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1117/2236] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:39:16 2021] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:39:16.249620 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268cfa4-69ba-446c-ac9d-6342d7670cad admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:16.261115 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268cfa4-69ba-446c-ac9d-6342d7670cad admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:16.266322 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd2556-a8a8-405f-9cac-035db979bc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:16.267060 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd2556-a8a8-405f-9cac-035db979bc6a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:16.267338 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd2556-a8a8-405f-9cac-035db979bc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:16.267666 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd2556-a8a8-405f-9cac-035db979bc6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:16.268408 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd2556-a8a8-405f-9cac-035db979bc6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:16.270040 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd2556-a8a8-405f-9cac-035db979bc6a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:16.280652 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1120/2237] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:39:16 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:39:16.284782 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b693d7e-959b-465a-84c2-753fd143a3ca admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:16.295028 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b693d7e-959b-465a-84c2-753fd143a3ca admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:16.299864 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2cc47-2e89-4ee7-b6de-4ceca4dea6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:16.300518 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2cc47-2e89-4ee7-b6de-4ceca4dea6ad admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:16.300791 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2cc47-2e89-4ee7-b6de-4ceca4dea6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:16.301061 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2cc47-2e89-4ee7-b6de-4ceca4dea6ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:16.301810 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2cc47-2e89-4ee7-b6de-4ceca4dea6ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:16.303431 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2cc47-2e89-4ee7-b6de-4ceca4dea6ad admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:16.313227 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1118/2238] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:39:16 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:39:16.317251 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd2556-a8a8-405f-9cac-035db979bc6a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:16.327666 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd2556-a8a8-405f-9cac-035db979bc6a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:16.332556 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45e690-af77-4830-9935-7b6c3f710372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:16.333373 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45e690-af77-4830-9935-7b6c3f710372 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:16.333653 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45e690-af77-4830-9935-7b6c3f710372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:16.333926 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45e690-af77-4830-9935-7b6c3f710372 admin admin] PATH_INFO: `/v3/projects/3a60e18582eb44c58052cd1c9e0249a8/users/5499ccc59dc04c588e741c48d10e77ce/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:16.348115 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb45e690-af77-4830-9935-7b6c3f710372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a60e18582eb44c58052cd1c9e0249a8, user_id=5499ccc59dc04c588e741c48d10e77ce, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:16.350757 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb45e690-af77-4830-9935-7b6c3f710372 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:16.365785 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1121/2239] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:39:16 2021] PUT /identity/v3/projects/3a60e18582eb44c58052cd1c9e0249a8/users/5499ccc59dc04c588e741c48d10e77ce/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:39:16.377084 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dff62b-6ce3-4ffb-833b-65190209d2a6 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:16.377377 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dff62b-6ce3-4ffb-833b-65190209d2a6 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:16.377647 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dff62b-6ce3-4ffb-833b-65190209d2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:16.406730 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-58dff62b-6ce3-4ffb-833b-65190209d2a6 None None] MFA Rules not processed for user `5499ccc59dc04c588e741c48d10e77ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:39:16.407979 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-58dff62b-6ce3-4ffb-833b-65190209d2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:16.477803 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1119/2240] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:39:16 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:39:16.489605 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45e690-af77-4830-9935-7b6c3f710372 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:16.491386 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-eb45e690-af77-4830-9935-7b6c3f710372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:16.553323 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45e690-af77-4830-9935-7b6c3f710372 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:16.557270 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eedc81-c259-40c2-aacf-0041b5717487 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a98d6cf23e4710bfbf71b960f81a9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:16.557939 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eedc81-c259-40c2-aacf-0041b5717487 service glance] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:16.558214 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eedc81-c259-40c2-aacf-0041b5717487 service glance] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:16.558480 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eedc81-c259-40c2-aacf-0041b5717487 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:16.566988 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eedc81-c259-40c2-aacf-0041b5717487 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:16.569173 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eedc81-c259-40c2-aacf-0041b5717487 service glance] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:16.577443 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1122/2241] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:39:16 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:39:45.676105 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6924a69-d6bd-4a9a-8ed7-a4eea047e737 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:45.676637 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6924a69-d6bd-4a9a-8ed7-a4eea047e737 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:45.676740 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6924a69-d6bd-4a9a-8ed7-a4eea047e737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:45.713266 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-b6924a69-d6bd-4a9a-8ed7-a4eea047e737 None None] MFA Rules not processed for user `62cc0165aee14b449c8a49233001f631`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:39:45.714556 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-b6924a69-d6bd-4a9a-8ed7-a4eea047e737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:45.792369 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1120/2242] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Oct 28 14:39:45 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:39:45.857732 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eedc81-c259-40c2-aacf-0041b5717487 service glance] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:45.859254 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-86eedc81-c259-40c2-aacf-0041b5717487 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:45.970171 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eedc81-c259-40c2-aacf-0041b5717487 service glance] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:45.975668 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069a736-91e3-4cbb-bb7a-36ddaac34020 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889e7be1dcaf47f599af9c9b7ad33042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:45.976319 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069a736-91e3-4cbb-bb7a-36ddaac34020 service swift] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:45.976591 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069a736-91e3-4cbb-bb7a-36ddaac34020 service swift] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:45.976861 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069a736-91e3-4cbb-bb7a-36ddaac34020 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:45.985398 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069a736-91e3-4cbb-bb7a-36ddaac34020 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:45.987014 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069a736-91e3-4cbb-bb7a-36ddaac34020 service swift] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:45.995600 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1123/2243] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Oct 28 14:39:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 14:39:56.374580 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6924a69-d6bd-4a9a-8ed7-a4eea047e737 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:56.376174 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-b6924a69-d6bd-4a9a-8ed7-a4eea047e737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:56.567171 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6924a69-d6bd-4a9a-8ed7-a4eea047e737 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:56.575260 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf5642-e070-462f-87d2-42efbde3814f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:56.576410 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf5642-e070-462f-87d2-42efbde3814f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:56.577152 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf5642-e070-462f-87d2-42efbde3814f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:56.590777 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf5642-e070-462f-87d2-42efbde3814f admin admin] PATH_INFO: `/v3/users/478109e21b1a4f3cb9690aed2d967faa` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:56.595505 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf5642-e070-462f-87d2-42efbde3814f admin admin] RBAC: Authorizing `identity:delete_user(user_id=478109e21b1a4f3cb9690aed2d967faa)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:56.602224 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf5642-e070-462f-87d2-42efbde3814f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:56.716460 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cbbf5642-e070-462f-87d2-42efbde3814f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '478109e21b1a4f3cb9690aed2d967faa'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:56.717503 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cbbf5642-e070-462f-87d2-42efbde3814f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '478109e21b1a4f3cb9690aed2d967faa'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:56.730483 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cbbf5642-e070-462f-87d2-42efbde3814f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '478109e21b1a4f3cb9690aed2d967faa'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:56.749231 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cbbf5642-e070-462f-87d2-42efbde3814f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '478109e21b1a4f3cb9690aed2d967faa'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:56.809297 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cbbf5642-e070-462f-87d2-42efbde3814f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '478109e21b1a4f3cb9690aed2d967faa'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:56.818595 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1121/2244] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:39:56 2021] DELETE /identity/v3/users/478109e21b1a4f3cb9690aed2d967faa => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:39:57.171751 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069a736-91e3-4cbb-bb7a-36ddaac34020 service swift] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:57.187912 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069a736-91e3-4cbb-bb7a-36ddaac34020 service swift] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:57.274719 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acc2a2-49c9-44cb-b8c1-65105e8e80ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:57.276110 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acc2a2-49c9-44cb-b8c1-65105e8e80ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:57.276416 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acc2a2-49c9-44cb-b8c1-65105e8e80ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:57.276686 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acc2a2-49c9-44cb-b8c1-65105e8e80ed admin admin] PATH_INFO: `/v3/projects/568d16c23053469dad2cfede8da540d0` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:57.278025 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99acc2a2-49c9-44cb-b8c1-65105e8e80ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=568d16c23053469dad2cfede8da540d0)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:57.280125 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99acc2a2-49c9-44cb-b8c1-65105e8e80ed admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:57.347591 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-99acc2a2-49c9-44cb-b8c1-65105e8e80ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '568d16c23053469dad2cfede8da540d0', 'request_id': 'req-99acc2a2-49c9-44cb-b8c1-65105e8e80ed'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:57.354514 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-99acc2a2-49c9-44cb-b8c1-65105e8e80ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '568d16c23053469dad2cfede8da540d0', 'request_id': 'req-99acc2a2-49c9-44cb-b8c1-65105e8e80ed'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:57.364356 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-99acc2a2-49c9-44cb-b8c1-65105e8e80ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '568d16c23053469dad2cfede8da540d0', 'request_id': 'req-99acc2a2-49c9-44cb-b8c1-65105e8e80ed'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:57.376803 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-99acc2a2-49c9-44cb-b8c1-65105e8e80ed admin admin] The token cache is being invalidate because project 568d16c23053469dad2cfede8da540d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:39:57.377319 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-99acc2a2-49c9-44cb-b8c1-65105e8e80ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:57.378146 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-99acc2a2-49c9-44cb-b8c1-65105e8e80ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:39:57.384711 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1124/2245] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:39:57 2021] DELETE /identity/v3/projects/568d16c23053469dad2cfede8da540d0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:39:57.386330 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908933a0-638b-4ca1-acbf-ac8b5f8b7c25 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:57.386989 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908933a0-638b-4ca1-acbf-ac8b5f8b7c25 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:57.386989 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908933a0-638b-4ca1-acbf-ac8b5f8b7c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:57.471441 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-908933a0-638b-4ca1-acbf-ac8b5f8b7c25 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:39:57.473420 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-908933a0-638b-4ca1-acbf-ac8b5f8b7c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:57.574309 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1122/2246] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:39:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:39:57.576689 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dd7d6-df0d-47d8-80ba-e18b2c85bc1a None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:57.577629 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dd7d6-df0d-47d8-80ba-e18b2c85bc1a None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:57.577629 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dd7d6-df0d-47d8-80ba-e18b2c85bc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:57.602988 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-f40dd7d6-df0d-47d8-80ba-e18b2c85bc1a None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:39:57.604236 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-f40dd7d6-df0d-47d8-80ba-e18b2c85bc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:57.626814 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1125/2247] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:39:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:39:57.630788 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908933a0-638b-4ca1-acbf-ac8b5f8b7c25 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:57.644007 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908933a0-638b-4ca1-acbf-ac8b5f8b7c25 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:57.676215 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f389b-87d4-43d9-8367-e5037bca28cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:57.676215 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f389b-87d4-43d9-8367-e5037bca28cd admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:57.676215 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f389b-87d4-43d9-8367-e5037bca28cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:57.676215 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f389b-87d4-43d9-8367-e5037bca28cd admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:57.683192 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f389b-87d4-43d9-8367-e5037bca28cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:39:57.683192 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f389b-87d4-43d9-8367-e5037bca28cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:57.690466 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f389b-87d4-43d9-8367-e5037bca28cd admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:57.736293 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dd7d6-df0d-47d8-80ba-e18b2c85bc1a None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:57.744462 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1123/2248] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:39:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:39:57.746536 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dd7d6-df0d-47d8-80ba-e18b2c85bc1a None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:57.752429 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be201662-87fc-4340-a52d-4619634f7788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:57.753281 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be201662-87fc-4340-a52d-4619634f7788 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:57.753560 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be201662-87fc-4340-a52d-4619634f7788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:57.753826 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be201662-87fc-4340-a52d-4619634f7788 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:57.754817 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be201662-87fc-4340-a52d-4619634f7788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:57.756946 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be201662-87fc-4340-a52d-4619634f7788 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:57.804390 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1126/2249] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:39:57 2021] POST /identity/v3/projects => generated 355 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:39:57.809891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f389b-87d4-43d9-8367-e5037bca28cd admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:57.822964 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f389b-87d4-43d9-8367-e5037bca28cd admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:57.952120 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12728061-bd3d-464d-92ca-06a9a5e3e2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:57.953884 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12728061-bd3d-464d-92ca-06a9a5e3e2cb admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:57.953884 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12728061-bd3d-464d-92ca-06a9a5e3e2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:57.953884 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12728061-bd3d-464d-92ca-06a9a5e3e2cb admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:57.967328 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12728061-bd3d-464d-92ca-06a9a5e3e2cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:57.970946 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12728061-bd3d-464d-92ca-06a9a5e3e2cb admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:58.041477 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1124/2250] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:39:57 2021] POST /identity/v3/users => generated 278 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:39:58.041714 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be201662-87fc-4340-a52d-4619634f7788 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:58.056213 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be201662-87fc-4340-a52d-4619634f7788 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:58.071926 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef8a5b-61e9-4ec0-9de0-d1daf36ac59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:58.074151 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef8a5b-61e9-4ec0-9de0-d1daf36ac59d admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:58.074478 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef8a5b-61e9-4ec0-9de0-d1daf36ac59d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:58.074772 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef8a5b-61e9-4ec0-9de0-d1daf36ac59d admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:58.078241 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef8a5b-61e9-4ec0-9de0-d1daf36ac59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:58.083120 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef8a5b-61e9-4ec0-9de0-d1daf36ac59d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:58.134848 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12728061-bd3d-464d-92ca-06a9a5e3e2cb admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:58.139321 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1127/2251] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:39:58 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:39:58.150726 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12728061-bd3d-464d-92ca-06a9a5e3e2cb admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:58.167948 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a922fac-3224-45d8-beb5-c8e1693210af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:58.169343 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a922fac-3224-45d8-beb5-c8e1693210af admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:58.169776 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a922fac-3224-45d8-beb5-c8e1693210af admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:58.170198 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a922fac-3224-45d8-beb5-c8e1693210af admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:58.171150 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a922fac-3224-45d8-beb5-c8e1693210af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:58.172976 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a922fac-3224-45d8-beb5-c8e1693210af admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:58.206616 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1125/2252] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:39:58 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:39:58.207517 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef8a5b-61e9-4ec0-9de0-d1daf36ac59d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:58.223965 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef8a5b-61e9-4ec0-9de0-d1daf36ac59d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:58.231099 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76e82b-a097-4a1c-8b28-ac2aef40d67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:58.232692 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76e82b-a097-4a1c-8b28-ac2aef40d67b admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:58.233167 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76e82b-a097-4a1c-8b28-ac2aef40d67b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:58.233597 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76e82b-a097-4a1c-8b28-ac2aef40d67b admin admin] PATH_INFO: `/v3/projects/adc1abcd7e7b438697fd996524151523/users/4f32bff15e074861b35468e45dab5846/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:58.262542 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76e82b-a097-4a1c-8b28-ac2aef40d67b admin admin] RBAC: Authorizing `identity:create_grant(project_id=adc1abcd7e7b438697fd996524151523, user_id=4f32bff15e074861b35468e45dab5846, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:58.265423 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76e82b-a097-4a1c-8b28-ac2aef40d67b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:58.294546 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1128/2253] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:39:58 2021] PUT /identity/v3/projects/adc1abcd7e7b438697fd996524151523/users/4f32bff15e074861b35468e45dab5846/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:39:58.305961 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e423ac6-55b4-4960-9d96-2c59f62ee17a None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:58.306708 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e423ac6-55b4-4960-9d96-2c59f62ee17a None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:58.307196 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e423ac6-55b4-4960-9d96-2c59f62ee17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:58.353681 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-0e423ac6-55b4-4960-9d96-2c59f62ee17a None None] MFA Rules not processed for user `4f32bff15e074861b35468e45dab5846`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:39:58.355056 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-0e423ac6-55b4-4960-9d96-2c59f62ee17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:58.428793 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1126/2254] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:39:58 2021] POST /identity/v3/auth/tokens => generated 3375 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:39:58.433829 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76e82b-a097-4a1c-8b28-ac2aef40d67b admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:58.498834 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76e82b-a097-4a1c-8b28-ac2aef40d67b admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:58.504207 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3dfee-0bf2-4340-b63e-25da539bca19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:58.505164 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3dfee-0bf2-4340-b63e-25da539bca19 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:58.506368 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3dfee-0bf2-4340-b63e-25da539bca19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:58.506769 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3dfee-0bf2-4340-b63e-25da539bca19 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:58.507596 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3dfee-0bf2-4340-b63e-25da539bca19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:58.509624 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3dfee-0bf2-4340-b63e-25da539bca19 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:58.539340 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1129/2255] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:39:58 2021] POST /identity/v3/projects => generated 353 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:39:58.543915 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e423ac6-55b4-4960-9d96-2c59f62ee17a None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:58.556270 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e423ac6-55b4-4960-9d96-2c59f62ee17a None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:58.616528 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18760b43-13aa-4c4a-b11e-dc4e5e7836dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:58.617215 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18760b43-13aa-4c4a-b11e-dc4e5e7836dc admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:58.617491 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18760b43-13aa-4c4a-b11e-dc4e5e7836dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:58.617759 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18760b43-13aa-4c4a-b11e-dc4e5e7836dc admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:58.618482 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18760b43-13aa-4c4a-b11e-dc4e5e7836dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:58.620489 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18760b43-13aa-4c4a-b11e-dc4e5e7836dc admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:58.648349 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1127/2256] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:39:58 2021] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:39:58.653998 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3dfee-0bf2-4340-b63e-25da539bca19 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:58.664497 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3dfee-0bf2-4340-b63e-25da539bca19 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:58.669800 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7776f-af21-40d5-8426-85bd03f8cfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:58.670498 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7776f-af21-40d5-8426-85bd03f8cfa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:58.670818 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7776f-af21-40d5-8426-85bd03f8cfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:58.671089 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7776f-af21-40d5-8426-85bd03f8cfa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:58.671824 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7776f-af21-40d5-8426-85bd03f8cfa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:58.673411 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7776f-af21-40d5-8426-85bd03f8cfa3 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:58.684394 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1130/2257] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:39:58 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:39:58.688980 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18760b43-13aa-4c4a-b11e-dc4e5e7836dc admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:58.699427 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18760b43-13aa-4c4a-b11e-dc4e5e7836dc admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:58.704555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7a05d-89cf-4d2f-b27a-15fc8e18f395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:58.705475 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7a05d-89cf-4d2f-b27a-15fc8e18f395 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:58.705750 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7a05d-89cf-4d2f-b27a-15fc8e18f395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:58.706021 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7a05d-89cf-4d2f-b27a-15fc8e18f395 admin admin] PATH_INFO: `/v3/projects/e60f0fe2ac134dea85e62c7b7ad7d180/users/e6a0d4b25e7e491090e3e4ebd867cfb7/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:58.722460 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7a05d-89cf-4d2f-b27a-15fc8e18f395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e60f0fe2ac134dea85e62c7b7ad7d180, user_id=e6a0d4b25e7e491090e3e4ebd867cfb7, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:58.725179 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7a05d-89cf-4d2f-b27a-15fc8e18f395 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:58.756998 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1128/2258] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:39:58 2021] PUT /identity/v3/projects/e60f0fe2ac134dea85e62c7b7ad7d180/users/e6a0d4b25e7e491090e3e4ebd867cfb7/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:39:58.762528 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7776f-af21-40d5-8426-85bd03f8cfa3 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:58.772796 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7776f-af21-40d5-8426-85bd03f8cfa3 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:58.828858 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9796e-2a66-434f-9719-6d1138882303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:58.829431 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9796e-2a66-434f-9719-6d1138882303 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:58.829710 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9796e-2a66-434f-9719-6d1138882303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:58.829977 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9796e-2a66-434f-9719-6d1138882303 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:58.830743 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9796e-2a66-434f-9719-6d1138882303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:58.832338 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9796e-2a66-434f-9719-6d1138882303 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:58.842375 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1131/2259] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:39:58 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:39:58.847106 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7a05d-89cf-4d2f-b27a-15fc8e18f395 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:58.857884 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7a05d-89cf-4d2f-b27a-15fc8e18f395 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:58.863198 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf5fb3-9305-4ce7-8d3e-d42987f97275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:58.864108 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf5fb3-9305-4ce7-8d3e-d42987f97275 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:58.864347 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf5fb3-9305-4ce7-8d3e-d42987f97275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:58.864616 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf5fb3-9305-4ce7-8d3e-d42987f97275 admin admin] PATH_INFO: `/v3/projects/e60f0fe2ac134dea85e62c7b7ad7d180/users/e6a0d4b25e7e491090e3e4ebd867cfb7/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:58.866813 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf5fb3-9305-4ce7-8d3e-d42987f97275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e60f0fe2ac134dea85e62c7b7ad7d180, user_id=e6a0d4b25e7e491090e3e4ebd867cfb7, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:58.869445 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf5fb3-9305-4ce7-8d3e-d42987f97275 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:58.880097 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1129/2260] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:39:58 2021] PUT /identity/v3/projects/e60f0fe2ac134dea85e62c7b7ad7d180/users/e6a0d4b25e7e491090e3e4ebd867cfb7/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:39:58.891873 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fc705-3761-4f4a-b46e-6213815a4bf1 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:58.892163 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fc705-3761-4f4a-b46e-6213815a4bf1 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:58.892438 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fc705-3761-4f4a-b46e-6213815a4bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:58.921019 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-874fc705-3761-4f4a-b46e-6213815a4bf1 None None] MFA Rules not processed for user `e6a0d4b25e7e491090e3e4ebd867cfb7`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:39:58.922309 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-874fc705-3761-4f4a-b46e-6213815a4bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:58.991680 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1132/2261] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:39:58 2021] POST /identity/v3/auth/tokens => generated 3440 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:39:59.003653 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf5fb3-9305-4ce7-8d3e-d42987f97275 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:59.005550 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-61bf5fb3-9305-4ce7-8d3e-d42987f97275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:39:59.087440 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf5fb3-9305-4ce7-8d3e-d42987f97275 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:59.091245 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ea611-5ec7-4278-8437-573369bd360c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:59.091799 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ea611-5ec7-4278-8437-573369bd360c service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:59.092070 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ea611-5ec7-4278-8437-573369bd360c service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:59.092340 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ea611-5ec7-4278-8437-573369bd360c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:59.101866 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ea611-5ec7-4278-8437-573369bd360c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:59.103334 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ea611-5ec7-4278-8437-573369bd360c service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:59.113130 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1130/2262] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:39:59 2021] GET /identity/v3/auth/tokens => generated 3440 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:39:59.197115 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874fc705-3761-4f4a-b46e-6213815a4bf1 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:39:59.207820 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874fc705-3761-4f4a-b46e-6213815a4bf1 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:39:59.211768 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5c01a-90ee-4983-8162-939be2a67bc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:39:59.212481 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5c01a-90ee-4983-8162-939be2a67bc5 service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:39:59.212825 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5c01a-90ee-4983-8162-939be2a67bc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:39:59.213167 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5c01a-90ee-4983-8162-939be2a67bc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:39:59.272817 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5c01a-90ee-4983-8162-939be2a67bc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:39:59.274304 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5c01a-90ee-4983-8162-939be2a67bc5 service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:39:59.298585 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1133/2263] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:39:59 2021] GET /identity/v3/auth/tokens => generated 3375 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:40:04.612626 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ea611-5ec7-4278-8437-573369bd360c service cinder] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:04.614201 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-876ea611-5ec7-4278-8437-573369bd360c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:04.717203 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ea611-5ec7-4278-8437-573369bd360c service cinder] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:04.724517 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee3e44-3773-4bdc-abdf-83a412a10e7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bf32a6fafb7458788a47e4774cb7bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:04.725178 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee3e44-3773-4bdc-abdf-83a412a10e7d service placement] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:04.725457 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee3e44-3773-4bdc-abdf-83a412a10e7d service placement] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:04.725748 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee3e44-3773-4bdc-abdf-83a412a10e7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:04.727531 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-42ee3e44-3773-4bdc-abdf-83a412a10e7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:04.739284 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee3e44-3773-4bdc-abdf-83a412a10e7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:04.740874 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee3e44-3773-4bdc-abdf-83a412a10e7d service placement] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:04.750897 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1131/2264] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:40:04 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:40:07.976644 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb276794-789e-4f85-9817-437bd341a76e None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:07.977255 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb276794-789e-4f85-9817-437bd341a76e None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:07.977586 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb276794-789e-4f85-9817-437bd341a76e None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:07.979550 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1134/2265] 10.222.0.79 () {54 vars in 921 bytes} [Thu Oct 28 14:40:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:40:07.986117 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853549c-8d4e-48d5-87e9-830f6344c138 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:07.986594 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853549c-8d4e-48d5-87e9-830f6344c138 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:07.986728 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853549c-8d4e-48d5-87e9-830f6344c138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:08.034659 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-0853549c-8d4e-48d5-87e9-830f6344c138 None None] MFA Rules not processed for user `18cd6636ae7847c78be910824410d295`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:40:08.035935 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-0853549c-8d4e-48d5-87e9-830f6344c138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:08.126323 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1132/2266] 10.222.0.79 () {58 vars in 1018 bytes} [Thu Oct 28 14:40:07 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:40:08.136406 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb276794-789e-4f85-9817-437bd341a76e None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:08.140316 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-eb276794-789e-4f85-9817-437bd341a76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:08.141544 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853549c-8d4e-48d5-87e9-830f6344c138 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:08.143319 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-0853549c-8d4e-48d5-87e9-830f6344c138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:08.208030 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853549c-8d4e-48d5-87e9-830f6344c138 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:08.212634 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb276794-789e-4f85-9817-437bd341a76e None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:08.212911 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7e2e0-ab3b-4b85-bdd1-d192121bac6c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a98d6cf23e4710bfbf71b960f81a9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:08.213637 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7e2e0-ab3b-4b85-bdd1-d192121bac6c service glance] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:08.214118 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7e2e0-ab3b-4b85-bdd1-d192121bac6c service glance] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:08.214450 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7e2e0-ab3b-4b85-bdd1-d192121bac6c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:08.218145 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad16396-7184-4488-8573-26a87270ddaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:08.219107 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad16396-7184-4488-8573-26a87270ddaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:08.219780 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad16396-7184-4488-8573-26a87270ddaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:08.219780 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad16396-7184-4488-8573-26a87270ddaf admin admin] PATH_INFO: `/v3/users/5499ccc59dc04c588e741c48d10e77ce` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:08.221020 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad16396-7184-4488-8573-26a87270ddaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5499ccc59dc04c588e741c48d10e77ce)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:08.222932 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad16396-7184-4488-8573-26a87270ddaf admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:08.227720 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7e2e0-ab3b-4b85-bdd1-d192121bac6c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:08.233230 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7e2e0-ab3b-4b85-bdd1-d192121bac6c service glance] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:08.252728 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1133/2267] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:40:08 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:40:08.289587 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-0ad16396-7184-4488-8573-26a87270ddaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5499ccc59dc04c588e741c48d10e77ce'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:08.298828 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-0ad16396-7184-4488-8573-26a87270ddaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5499ccc59dc04c588e741c48d10e77ce'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:08.299448 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-0ad16396-7184-4488-8573-26a87270ddaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5499ccc59dc04c588e741c48d10e77ce'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:08.317666 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-0ad16396-7184-4488-8573-26a87270ddaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5499ccc59dc04c588e741c48d10e77ce'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:08.325550 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-0ad16396-7184-4488-8573-26a87270ddaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5499ccc59dc04c588e741c48d10e77ce'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:08.330080 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d2fe1-a821-4959-801e-803d7b657bf3 None None] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:08.330386 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d2fe1-a821-4959-801e-803d7b657bf3 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:08.330656 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d2fe1-a821-4959-801e-803d7b657bf3 None None] PATH_INFO: `/` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:08.332374 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1135/2268] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:40:08 2021] DELETE /identity/v3/users/5499ccc59dc04c588e741c48d10e77ce => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:40:08.334569 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1134/2269] 10.222.0.79 () {54 vars in 921 bytes} [Thu Oct 28 14:40:08 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 14:40:08.336496 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49b7c0-2781-412b-856b-b41641f501f2 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:08.336778 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49b7c0-2781-412b-856b-b41641f501f2 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:08.337049 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49b7c0-2781-412b-856b-b41641f501f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:08.346410 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a13e65-8ae6-4265-b7b5-e123b9d93f24 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:08.347101 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a13e65-8ae6-4265-b7b5-e123b9d93f24 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:08.347485 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a13e65-8ae6-4265-b7b5-e123b9d93f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:08.354458 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-cd49b7c0-2781-412b-856b-b41641f501f2 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:40:08.355692 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-cd49b7c0-2781-412b-856b-b41641f501f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:08.401212 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-65a13e65-8ae6-4265-b7b5-e123b9d93f24 None None] MFA Rules not processed for user `a689fc75b37b4557a682f6cad357df6c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:40:08.402431 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-65a13e65-8ae6-4265-b7b5-e123b9d93f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:08.418555 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1136/2270] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:40:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:40:08.432027 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49b7c0-2781-412b-856b-b41641f501f2 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:08.434597 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-cd49b7c0-2781-412b-856b-b41641f501f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:08.478648 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1135/2271] 10.222.0.79 () {58 vars in 1018 bytes} [Thu Oct 28 14:40:08 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:40:08.492582 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a13e65-8ae6-4265-b7b5-e123b9d93f24 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:08.493983 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-65a13e65-8ae6-4265-b7b5-e123b9d93f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:08.508924 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a13e65-8ae6-4265-b7b5-e123b9d93f24 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:08.509130 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49b7c0-2781-412b-856b-b41641f501f2 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:08.512820 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2cfb4-8580-4fbd-91a4-74118637934c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:08.513535 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2cfb4-8580-4fbd-91a4-74118637934c service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:08.513911 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2cfb4-8580-4fbd-91a4-74118637934c service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:08.514341 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2cfb4-8580-4fbd-91a4-74118637934c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:08.515143 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345c3f2-fc8d-4f0d-8b47-259aef000170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:08.516000 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345c3f2-fc8d-4f0d-8b47-259aef000170 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:08.516373 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345c3f2-fc8d-4f0d-8b47-259aef000170 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:08.516802 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345c3f2-fc8d-4f0d-8b47-259aef000170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:08.522465 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2cfb4-8580-4fbd-91a4-74118637934c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:08.524139 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2cfb4-8580-4fbd-91a4-74118637934c service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:08.528292 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345c3f2-fc8d-4f0d-8b47-259aef000170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:08.530221 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345c3f2-fc8d-4f0d-8b47-259aef000170 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:08.549286 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1136/2272] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:40:08 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:40:08.553618 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1137/2273] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:40:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:40:08.875342 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2cfb4-8580-4fbd-91a4-74118637934c service neutron] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:08.876853 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-08d2cfb4-8580-4fbd-91a4-74118637934c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:08.903039 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2cfb4-8580-4fbd-91a4-74118637934c service neutron] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:08.908092 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af620c28-c2a8-4f52-b854-ce2a251e36bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:08.908409 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af620c28-c2a8-4f52-b854-ce2a251e36bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:08.908688 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af620c28-c2a8-4f52-b854-ce2a251e36bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:08.909295 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af620c28-c2a8-4f52-b854-ce2a251e36bd admin admin] PATH_INFO: `/v3/projects/3a60e18582eb44c58052cd1c9e0249a8` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:08.911651 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af620c28-c2a8-4f52-b854-ce2a251e36bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a60e18582eb44c58052cd1c9e0249a8)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:08.914466 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af620c28-c2a8-4f52-b854-ce2a251e36bd admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:08.962344 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-af620c28-c2a8-4f52-b854-ce2a251e36bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a60e18582eb44c58052cd1c9e0249a8', 'request_id': 'req-af620c28-c2a8-4f52-b854-ce2a251e36bd'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:08.968829 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-af620c28-c2a8-4f52-b854-ce2a251e36bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a60e18582eb44c58052cd1c9e0249a8', 'request_id': 'req-af620c28-c2a8-4f52-b854-ce2a251e36bd'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:08.977243 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-af620c28-c2a8-4f52-b854-ce2a251e36bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a60e18582eb44c58052cd1c9e0249a8', 'request_id': 'req-af620c28-c2a8-4f52-b854-ce2a251e36bd'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:08.988132 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-af620c28-c2a8-4f52-b854-ce2a251e36bd admin admin] The token cache is being invalidate because project 3a60e18582eb44c58052cd1c9e0249a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:40:08.988761 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-af620c28-c2a8-4f52-b854-ce2a251e36bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:08.989017 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-af620c28-c2a8-4f52-b854-ce2a251e36bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:08.990608 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1137/2274] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:40:08 2021] DELETE /identity/v3/projects/3a60e18582eb44c58052cd1c9e0249a8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:40:15.290118 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345c3f2-fc8d-4f0d-8b47-259aef000170 service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:15.291701 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-7345c3f2-fc8d-4f0d-8b47-259aef000170 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:15.304565 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345c3f2-fc8d-4f0d-8b47-259aef000170 service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:15.371091 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e5735-ec3c-4e8d-92ca-4fee7ba2dc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:15.371992 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e5735-ec3c-4e8d-92ca-4fee7ba2dc8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:15.372312 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e5735-ec3c-4e8d-92ca-4fee7ba2dc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:15.372654 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e5735-ec3c-4e8d-92ca-4fee7ba2dc8c admin admin] PATH_INFO: `/v3/users/4f32bff15e074861b35468e45dab5846` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:15.373844 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e5735-ec3c-4e8d-92ca-4fee7ba2dc8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f32bff15e074861b35468e45dab5846)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:15.375781 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e5735-ec3c-4e8d-92ca-4fee7ba2dc8c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:15.421950 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-9a3e5735-ec3c-4e8d-92ca-4fee7ba2dc8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f32bff15e074861b35468e45dab5846'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:15.430216 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-9a3e5735-ec3c-4e8d-92ca-4fee7ba2dc8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f32bff15e074861b35468e45dab5846'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:15.430853 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-9a3e5735-ec3c-4e8d-92ca-4fee7ba2dc8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f32bff15e074861b35468e45dab5846'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:15.442738 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-9a3e5735-ec3c-4e8d-92ca-4fee7ba2dc8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f32bff15e074861b35468e45dab5846'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:15.449241 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-9a3e5735-ec3c-4e8d-92ca-4fee7ba2dc8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f32bff15e074861b35468e45dab5846'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:15.455046 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1138/2275] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:40:15 2021] DELETE /identity/v3/users/4f32bff15e074861b35468e45dab5846 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:40:15.459748 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf51cfc-266a-4dfd-add2-b0f90c8ff767 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:15.460215 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf51cfc-266a-4dfd-add2-b0f90c8ff767 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:15.460325 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf51cfc-266a-4dfd-add2-b0f90c8ff767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:15.477963 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-daf51cfc-266a-4dfd-add2-b0f90c8ff767 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:40:15.479209 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-daf51cfc-266a-4dfd-add2-b0f90c8ff767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:15.541181 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1138/2276] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:40:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:40:15.553555 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e5735-ec3c-4e8d-92ca-4fee7ba2dc8c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:15.556107 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-9a3e5735-ec3c-4e8d-92ca-4fee7ba2dc8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:15.617733 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e5735-ec3c-4e8d-92ca-4fee7ba2dc8c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:15.621889 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31443fcb-b3fd-4117-9530-db4de1f62617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:15.622555 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31443fcb-b3fd-4117-9530-db4de1f62617 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:15.622861 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31443fcb-b3fd-4117-9530-db4de1f62617 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:15.623153 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31443fcb-b3fd-4117-9530-db4de1f62617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:15.633355 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31443fcb-b3fd-4117-9530-db4de1f62617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:15.634836 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31443fcb-b3fd-4117-9530-db4de1f62617 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:15.644667 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1139/2277] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:40:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:40:15.980467 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf51cfc-266a-4dfd-add2-b0f90c8ff767 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:15.982017 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-daf51cfc-266a-4dfd-add2-b0f90c8ff767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:15.998703 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf51cfc-266a-4dfd-add2-b0f90c8ff767 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:16.007482 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfb126-a566-4b79-bdf3-bdec17b7a55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:16.009326 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfb126-a566-4b79-bdf3-bdec17b7a55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:16.009589 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfb126-a566-4b79-bdf3-bdec17b7a55a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:16.009861 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfb126-a566-4b79-bdf3-bdec17b7a55a admin admin] PATH_INFO: `/v3/projects/adc1abcd7e7b438697fd996524151523` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:16.011498 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfb126-a566-4b79-bdf3-bdec17b7a55a admin admin] RBAC: Authorizing `identity:delete_project(project_id=adc1abcd7e7b438697fd996524151523)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:16.013449 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfb126-a566-4b79-bdf3-bdec17b7a55a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:16.070251 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a6dfb126-a566-4b79-bdf3-bdec17b7a55a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adc1abcd7e7b438697fd996524151523', 'request_id': 'req-a6dfb126-a566-4b79-bdf3-bdec17b7a55a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:16.079295 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a6dfb126-a566-4b79-bdf3-bdec17b7a55a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adc1abcd7e7b438697fd996524151523', 'request_id': 'req-a6dfb126-a566-4b79-bdf3-bdec17b7a55a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:16.088355 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a6dfb126-a566-4b79-bdf3-bdec17b7a55a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adc1abcd7e7b438697fd996524151523', 'request_id': 'req-a6dfb126-a566-4b79-bdf3-bdec17b7a55a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:16.100095 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a6dfb126-a566-4b79-bdf3-bdec17b7a55a admin admin] The token cache is being invalidate because project adc1abcd7e7b438697fd996524151523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:40:16.100383 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a6dfb126-a566-4b79-bdf3-bdec17b7a55a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:16.101015 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a6dfb126-a566-4b79-bdf3-bdec17b7a55a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:16.102592 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1139/2278] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:40:15 2021] DELETE /identity/v3/projects/adc1abcd7e7b438697fd996524151523 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:40:16.106666 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31443fcb-b3fd-4117-9530-db4de1f62617 service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:16.116697 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31443fcb-b3fd-4117-9530-db4de1f62617 service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:16.178122 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241df0c-fcf2-41ce-adc6-a7c059e4f52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:16.179088 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241df0c-fcf2-41ce-adc6-a7c059e4f52e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:16.179368 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241df0c-fcf2-41ce-adc6-a7c059e4f52e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:16.179640 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241df0c-fcf2-41ce-adc6-a7c059e4f52e admin admin] PATH_INFO: `/v3/users/e6a0d4b25e7e491090e3e4ebd867cfb7` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:16.180943 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241df0c-fcf2-41ce-adc6-a7c059e4f52e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6a0d4b25e7e491090e3e4ebd867cfb7)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:16.183015 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241df0c-fcf2-41ce-adc6-a7c059e4f52e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:16.229952 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-9241df0c-fcf2-41ce-adc6-a7c059e4f52e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6a0d4b25e7e491090e3e4ebd867cfb7'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:16.238714 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-9241df0c-fcf2-41ce-adc6-a7c059e4f52e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6a0d4b25e7e491090e3e4ebd867cfb7'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:16.239433 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-9241df0c-fcf2-41ce-adc6-a7c059e4f52e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6a0d4b25e7e491090e3e4ebd867cfb7'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:16.251892 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-9241df0c-fcf2-41ce-adc6-a7c059e4f52e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6a0d4b25e7e491090e3e4ebd867cfb7'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:16.259180 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-9241df0c-fcf2-41ce-adc6-a7c059e4f52e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6a0d4b25e7e491090e3e4ebd867cfb7'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:16.265350 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1140/2279] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:40:16 2021] DELETE /identity/v3/users/e6a0d4b25e7e491090e3e4ebd867cfb7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:40:16.674481 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfb126-a566-4b79-bdf3-bdec17b7a55a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:16.675990 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-a6dfb126-a566-4b79-bdf3-bdec17b7a55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:16.689612 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfb126-a566-4b79-bdf3-bdec17b7a55a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:16.748316 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd360d3-290c-48b4-9514-60871204c892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:16.749183 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd360d3-290c-48b4-9514-60871204c892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:16.749468 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd360d3-290c-48b4-9514-60871204c892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:16.749743 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd360d3-290c-48b4-9514-60871204c892 admin admin] PATH_INFO: `/v3/projects/e60f0fe2ac134dea85e62c7b7ad7d180` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:16.751080 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd360d3-290c-48b4-9514-60871204c892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e60f0fe2ac134dea85e62c7b7ad7d180)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:16.752981 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd360d3-290c-48b4-9514-60871204c892 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:16.802171 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-4bd360d3-290c-48b4-9514-60871204c892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e60f0fe2ac134dea85e62c7b7ad7d180', 'request_id': 'req-4bd360d3-290c-48b4-9514-60871204c892'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:16.808554 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-4bd360d3-290c-48b4-9514-60871204c892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e60f0fe2ac134dea85e62c7b7ad7d180', 'request_id': 'req-4bd360d3-290c-48b4-9514-60871204c892'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:16.819241 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-4bd360d3-290c-48b4-9514-60871204c892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e60f0fe2ac134dea85e62c7b7ad7d180', 'request_id': 'req-4bd360d3-290c-48b4-9514-60871204c892'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:16.829986 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-4bd360d3-290c-48b4-9514-60871204c892 admin admin] The token cache is being invalidate because project e60f0fe2ac134dea85e62c7b7ad7d180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:40:16.830257 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-4bd360d3-290c-48b4-9514-60871204c892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:16.830953 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-4bd360d3-290c-48b4-9514-60871204c892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:16.832514 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1140/2280] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:40:16 2021] DELETE /identity/v3/projects/e60f0fe2ac134dea85e62c7b7ad7d180 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:40:16.838283 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81098bd0-6cf8-4530-b034-bd16d3c1144d None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:16.838818 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81098bd0-6cf8-4530-b034-bd16d3c1144d None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:16.838818 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81098bd0-6cf8-4530-b034-bd16d3c1144d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:16.857454 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-81098bd0-6cf8-4530-b034-bd16d3c1144d None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:40:16.858722 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-81098bd0-6cf8-4530-b034-bd16d3c1144d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:16.927455 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1141/2281] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:40:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:40:16.935804 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ff81e-d55c-41a0-989e-2855bc5c655d None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:16.936084 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ff81e-d55c-41a0-989e-2855bc5c655d None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:16.936353 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ff81e-d55c-41a0-989e-2855bc5c655d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:16.956013 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-eb3ff81e-d55c-41a0-989e-2855bc5c655d None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:40:16.957213 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-eb3ff81e-d55c-41a0-989e-2855bc5c655d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:16.966442 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1141/2282] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:40:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:40:16.970870 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81098bd0-6cf8-4530-b034-bd16d3c1144d None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:16.980732 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81098bd0-6cf8-4530-b034-bd16d3c1144d None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:16.985798 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fcb599-a637-4c21-bbd0-ef9224516858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:16.986481 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcb599-a637-4c21-bbd0-ef9224516858 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:16.986797 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcb599-a637-4c21-bbd0-ef9224516858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:16.987066 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcb599-a637-4c21-bbd0-ef9224516858 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:16.987810 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fcb599-a637-4c21-bbd0-ef9224516858 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:40:16.988113 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fcb599-a637-4c21-bbd0-ef9224516858 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:16.989692 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fcb599-a637-4c21-bbd0-ef9224516858 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:17.002010 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1142/2283] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:40:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:40:17.006614 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ff81e-d55c-41a0-989e-2855bc5c655d None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:17.016269 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ff81e-d55c-41a0-989e-2855bc5c655d None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:17.021124 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa3d35-6c86-4d87-8e76-d7b9588de5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:17.021787 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa3d35-6c86-4d87-8e76-d7b9588de5a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:17.022069 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa3d35-6c86-4d87-8e76-d7b9588de5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:17.022343 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa3d35-6c86-4d87-8e76-d7b9588de5a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:17.023088 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa3d35-6c86-4d87-8e76-d7b9588de5a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:17.025051 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa3d35-6c86-4d87-8e76-d7b9588de5a1 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:17.054763 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1142/2284] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:40:17 2021] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:40:17.058807 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fcb599-a637-4c21-bbd0-ef9224516858 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:17.069546 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fcb599-a637-4c21-bbd0-ef9224516858 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:17.135193 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3710ac7-42d4-45cc-9396-14d0f00e40d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:17.135890 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3710ac7-42d4-45cc-9396-14d0f00e40d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:17.136165 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3710ac7-42d4-45cc-9396-14d0f00e40d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:17.136433 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3710ac7-42d4-45cc-9396-14d0f00e40d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:17.137144 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3710ac7-42d4-45cc-9396-14d0f00e40d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:17.139192 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3710ac7-42d4-45cc-9396-14d0f00e40d6 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:17.159494 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1143/2285] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:40:17 2021] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:40:17.163712 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa3d35-6c86-4d87-8e76-d7b9588de5a1 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:17.175029 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa3d35-6c86-4d87-8e76-d7b9588de5a1 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:17.179964 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8621b-eefd-4e5d-90da-988f3c87a191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:17.180611 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8621b-eefd-4e5d-90da-988f3c87a191 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:17.180882 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8621b-eefd-4e5d-90da-988f3c87a191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:17.181144 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8621b-eefd-4e5d-90da-988f3c87a191 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:17.181904 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8621b-eefd-4e5d-90da-988f3c87a191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:17.183856 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8621b-eefd-4e5d-90da-988f3c87a191 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:17.194126 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1143/2286] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:40:17 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:40:17.198179 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3710ac7-42d4-45cc-9396-14d0f00e40d6 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:17.208874 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3710ac7-42d4-45cc-9396-14d0f00e40d6 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:17.213947 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c7aff-faea-46b8-adb1-a56805e8f347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:17.214614 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c7aff-faea-46b8-adb1-a56805e8f347 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:17.214934 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c7aff-faea-46b8-adb1-a56805e8f347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:17.215327 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c7aff-faea-46b8-adb1-a56805e8f347 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:17.216083 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c7aff-faea-46b8-adb1-a56805e8f347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:17.217685 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c7aff-faea-46b8-adb1-a56805e8f347 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:17.227700 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1144/2287] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:40:17 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:40:17.231903 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8621b-eefd-4e5d-90da-988f3c87a191 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:17.242503 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8621b-eefd-4e5d-90da-988f3c87a191 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:17.248436 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a00f8-370c-4b0a-9602-8171be59eb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:17.249327 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a00f8-370c-4b0a-9602-8171be59eb91 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:17.249603 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a00f8-370c-4b0a-9602-8171be59eb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:17.249875 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a00f8-370c-4b0a-9602-8171be59eb91 admin admin] PATH_INFO: `/v3/projects/15b08c9b8c664ab8ac246821bfb51b26/users/4c6bc816721f41b588a4cf662b637c43/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:17.266150 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a00f8-370c-4b0a-9602-8171be59eb91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15b08c9b8c664ab8ac246821bfb51b26, user_id=4c6bc816721f41b588a4cf662b637c43, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:17.270189 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a00f8-370c-4b0a-9602-8171be59eb91 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:17.291710 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1144/2288] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:40:17 2021] PUT /identity/v3/projects/15b08c9b8c664ab8ac246821bfb51b26/users/4c6bc816721f41b588a4cf662b637c43/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:40:17.303658 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fbde2-520f-4f32-b36b-ed7f964ff253 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:17.303944 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fbde2-520f-4f32-b36b-ed7f964ff253 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:17.304217 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fbde2-520f-4f32-b36b-ed7f964ff253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:17.330884 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-a98fbde2-520f-4f32-b36b-ed7f964ff253 None None] MFA Rules not processed for user `4c6bc816721f41b588a4cf662b637c43`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:40:17.332102 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a98fbde2-520f-4f32-b36b-ed7f964ff253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:17.399869 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1145/2289] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:40:17 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:40:17.404801 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a00f8-370c-4b0a-9602-8171be59eb91 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:17.472512 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a00f8-370c-4b0a-9602-8171be59eb91 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:17.477177 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc353f-666d-4d13-b1c2-ded7ad786048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:17.477855 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc353f-666d-4d13-b1c2-ded7ad786048 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:17.478119 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc353f-666d-4d13-b1c2-ded7ad786048 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:17.478387 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc353f-666d-4d13-b1c2-ded7ad786048 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:17.479161 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc353f-666d-4d13-b1c2-ded7ad786048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:17.481043 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc353f-666d-4d13-b1c2-ded7ad786048 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:17.508274 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1145/2290] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:40:17 2021] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:40:17.512301 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fbde2-520f-4f32-b36b-ed7f964ff253 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:17.523266 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fbde2-520f-4f32-b36b-ed7f964ff253 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:17.580771 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4ad8d-bd9b-4d7e-8e39-4a05c1213d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:17.581517 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4ad8d-bd9b-4d7e-8e39-4a05c1213d6e admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:17.581802 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4ad8d-bd9b-4d7e-8e39-4a05c1213d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:17.582068 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4ad8d-bd9b-4d7e-8e39-4a05c1213d6e admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:17.582795 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4ad8d-bd9b-4d7e-8e39-4a05c1213d6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:17.584984 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4ad8d-bd9b-4d7e-8e39-4a05c1213d6e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:17.605387 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1146/2291] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:40:17 2021] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:40:17.609529 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc353f-666d-4d13-b1c2-ded7ad786048 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:17.619717 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc353f-666d-4d13-b1c2-ded7ad786048 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:17.624499 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e24c5-1ac4-4000-9424-e58739a5660f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:17.625152 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e24c5-1ac4-4000-9424-e58739a5660f admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:17.625425 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e24c5-1ac4-4000-9424-e58739a5660f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:17.625693 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e24c5-1ac4-4000-9424-e58739a5660f admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:17.626427 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e24c5-1ac4-4000-9424-e58739a5660f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:17.628046 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e24c5-1ac4-4000-9424-e58739a5660f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:17.638575 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1146/2292] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:40:17 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:40:17.642864 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4ad8d-bd9b-4d7e-8e39-4a05c1213d6e admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:17.653327 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4ad8d-bd9b-4d7e-8e39-4a05c1213d6e admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:17.658737 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd12e63-203f-4baa-a994-5d1ed2567d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:17.659655 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd12e63-203f-4baa-a994-5d1ed2567d9f admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:17.659934 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd12e63-203f-4baa-a994-5d1ed2567d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:17.660209 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd12e63-203f-4baa-a994-5d1ed2567d9f admin admin] PATH_INFO: `/v3/projects/ce7afad3e8684517b915844bbad8072f/users/07703ff9e72245e4ae3a20793c8affaa/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:17.677400 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd12e63-203f-4baa-a994-5d1ed2567d9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce7afad3e8684517b915844bbad8072f, user_id=07703ff9e72245e4ae3a20793c8affaa, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:17.680085 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd12e63-203f-4baa-a994-5d1ed2567d9f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:17.695053 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1147/2293] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:40:17 2021] PUT /identity/v3/projects/ce7afad3e8684517b915844bbad8072f/users/07703ff9e72245e4ae3a20793c8affaa/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:40:17.699183 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e24c5-1ac4-4000-9424-e58739a5660f admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:17.710704 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e24c5-1ac4-4000-9424-e58739a5660f admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:17.770029 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86e277-d3c5-490e-b08d-ae95031c2bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:17.770792 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86e277-d3c5-490e-b08d-ae95031c2bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:17.770999 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86e277-d3c5-490e-b08d-ae95031c2bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:17.771263 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86e277-d3c5-490e-b08d-ae95031c2bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:17.772008 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86e277-d3c5-490e-b08d-ae95031c2bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:17.773597 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86e277-d3c5-490e-b08d-ae95031c2bb8 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:17.783529 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1147/2294] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:40:17 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:40:17.787687 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd12e63-203f-4baa-a994-5d1ed2567d9f admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:17.800687 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd12e63-203f-4baa-a994-5d1ed2567d9f admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:17.806900 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1e41b-750d-4b54-98ae-07db6e03a2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:17.807801 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1e41b-750d-4b54-98ae-07db6e03a2fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:17.814644 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1e41b-750d-4b54-98ae-07db6e03a2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:17.814644 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1e41b-750d-4b54-98ae-07db6e03a2fa admin admin] PATH_INFO: `/v3/projects/ce7afad3e8684517b915844bbad8072f/users/07703ff9e72245e4ae3a20793c8affaa/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:17.814644 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1e41b-750d-4b54-98ae-07db6e03a2fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce7afad3e8684517b915844bbad8072f, user_id=07703ff9e72245e4ae3a20793c8affaa, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:17.814644 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1e41b-750d-4b54-98ae-07db6e03a2fa admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:17.829372 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1148/2295] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:40:17 2021] PUT /identity/v3/projects/ce7afad3e8684517b915844bbad8072f/users/07703ff9e72245e4ae3a20793c8affaa/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:40:17.841007 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919f907-e506-4a19-904e-d9b7de2d0564 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:17.841369 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919f907-e506-4a19-904e-d9b7de2d0564 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:17.841775 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919f907-e506-4a19-904e-d9b7de2d0564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:17.871175 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-6919f907-e506-4a19-904e-d9b7de2d0564 None None] MFA Rules not processed for user `07703ff9e72245e4ae3a20793c8affaa`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:40:17.872523 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-6919f907-e506-4a19-904e-d9b7de2d0564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:17.939664 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1148/2296] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:40:17 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:40:17.950308 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1e41b-750d-4b54-98ae-07db6e03a2fa admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:17.952056 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-4ee1e41b-750d-4b54-98ae-07db6e03a2fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:18.007896 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1e41b-750d-4b54-98ae-07db6e03a2fa admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:18.011886 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a8f27-c258-43fa-be1a-4640a01fb386 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:18.012578 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a8f27-c258-43fa-be1a-4640a01fb386 service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:18.012946 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a8f27-c258-43fa-be1a-4640a01fb386 service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:18.013215 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a8f27-c258-43fa-be1a-4640a01fb386 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:18.027125 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a8f27-c258-43fa-be1a-4640a01fb386 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:18.029327 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a8f27-c258-43fa-be1a-4640a01fb386 service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:18.043456 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1149/2297] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:40:17 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:40:18.097171 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919f907-e506-4a19-904e-d9b7de2d0564 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:18.098815 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-6919f907-e506-4a19-904e-d9b7de2d0564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:18.113607 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919f907-e506-4a19-904e-d9b7de2d0564 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:18.117244 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e7b76-52e7-4455-985b-ef126a2fcf38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:18.118900 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e7b76-52e7-4455-985b-ef126a2fcf38 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:18.118900 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e7b76-52e7-4455-985b-ef126a2fcf38 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:18.118900 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e7b76-52e7-4455-985b-ef126a2fcf38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:18.187230 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e7b76-52e7-4455-985b-ef126a2fcf38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:18.188753 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e7b76-52e7-4455-985b-ef126a2fcf38 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:18.197648 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1149/2298] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:40:18 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:40:21.470819 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a8f27-c258-43fa-be1a-4640a01fb386 service cinder] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:21.533051 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a8f27-c258-43fa-be1a-4640a01fb386 service cinder] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:21.539512 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8fe3a-a623-49ec-9ade-766309edf206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:21.540378 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8fe3a-a623-49ec-9ade-766309edf206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:21.540653 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8fe3a-a623-49ec-9ade-766309edf206 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:21.540917 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8fe3a-a623-49ec-9ade-766309edf206 admin admin] PATH_INFO: `/v3/users/4c6bc816721f41b588a4cf662b637c43` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:21.542310 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8fe3a-a623-49ec-9ade-766309edf206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c6bc816721f41b588a4cf662b637c43)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:21.544673 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8fe3a-a623-49ec-9ade-766309edf206 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:21.592580 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-1aa8fe3a-a623-49ec-9ade-766309edf206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c6bc816721f41b588a4cf662b637c43'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:21.600492 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-1aa8fe3a-a623-49ec-9ade-766309edf206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c6bc816721f41b588a4cf662b637c43'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:21.601174 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-1aa8fe3a-a623-49ec-9ade-766309edf206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c6bc816721f41b588a4cf662b637c43'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:21.613330 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-1aa8fe3a-a623-49ec-9ade-766309edf206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c6bc816721f41b588a4cf662b637c43'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:21.620123 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-1aa8fe3a-a623-49ec-9ade-766309edf206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c6bc816721f41b588a4cf662b637c43'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:21.626222 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1150/2299] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:40:21 2021] DELETE /identity/v3/users/4c6bc816721f41b588a4cf662b637c43 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:40:21.630935 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9444272-df70-4d6f-8ee9-0986665853ac None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:21.631443 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9444272-df70-4d6f-8ee9-0986665853ac None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:21.631535 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9444272-df70-4d6f-8ee9-0986665853ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:21.648868 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-f9444272-df70-4d6f-8ee9-0986665853ac None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:40:21.650193 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-f9444272-df70-4d6f-8ee9-0986665853ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:21.735059 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1150/2300] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:40:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:40:21.745674 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8fe3a-a623-49ec-9ade-766309edf206 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:21.747266 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-1aa8fe3a-a623-49ec-9ade-766309edf206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:21.804183 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8fe3a-a623-49ec-9ade-766309edf206 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:21.808057 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554008cc-0ef4-40e3-83df-9b8eecee45a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:21.808831 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554008cc-0ef4-40e3-83df-9b8eecee45a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:21.809111 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554008cc-0ef4-40e3-83df-9b8eecee45a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:21.809414 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554008cc-0ef4-40e3-83df-9b8eecee45a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:21.819000 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554008cc-0ef4-40e3-83df-9b8eecee45a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:21.820427 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554008cc-0ef4-40e3-83df-9b8eecee45a7 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:21.829747 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1151/2301] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:40:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:40:22.115560 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9444272-df70-4d6f-8ee9-0986665853ac None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:22.117884 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-f9444272-df70-4d6f-8ee9-0986665853ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:22.133904 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9444272-df70-4d6f-8ee9-0986665853ac None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:22.139649 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bde42-7894-4447-83f9-147a0fc9b8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:22.140685 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bde42-7894-4447-83f9-147a0fc9b8c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:22.140960 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bde42-7894-4447-83f9-147a0fc9b8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:22.141223 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bde42-7894-4447-83f9-147a0fc9b8c2 admin admin] PATH_INFO: `/v3/projects/15b08c9b8c664ab8ac246821bfb51b26` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:22.142557 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69bde42-7894-4447-83f9-147a0fc9b8c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15b08c9b8c664ab8ac246821bfb51b26)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:22.144533 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69bde42-7894-4447-83f9-147a0fc9b8c2 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:22.196080 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e69bde42-7894-4447-83f9-147a0fc9b8c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15b08c9b8c664ab8ac246821bfb51b26', 'request_id': 'req-e69bde42-7894-4447-83f9-147a0fc9b8c2'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:22.201960 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e69bde42-7894-4447-83f9-147a0fc9b8c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15b08c9b8c664ab8ac246821bfb51b26', 'request_id': 'req-e69bde42-7894-4447-83f9-147a0fc9b8c2'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:22.210438 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e69bde42-7894-4447-83f9-147a0fc9b8c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15b08c9b8c664ab8ac246821bfb51b26', 'request_id': 'req-e69bde42-7894-4447-83f9-147a0fc9b8c2'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:22.221290 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e69bde42-7894-4447-83f9-147a0fc9b8c2 admin admin] The token cache is being invalidate because project 15b08c9b8c664ab8ac246821bfb51b26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:40:22.221510 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e69bde42-7894-4447-83f9-147a0fc9b8c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:22.222118 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e69bde42-7894-4447-83f9-147a0fc9b8c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:22.223723 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1151/2302] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:40:22 2021] DELETE /identity/v3/projects/15b08c9b8c664ab8ac246821bfb51b26 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:40:22.227801 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554008cc-0ef4-40e3-83df-9b8eecee45a7 service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:22.237727 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554008cc-0ef4-40e3-83df-9b8eecee45a7 service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:22.302448 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0d98e-628b-44e9-b964-a95dd1a919c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:22.303362 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0d98e-628b-44e9-b964-a95dd1a919c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:22.303647 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0d98e-628b-44e9-b964-a95dd1a919c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:22.303919 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0d98e-628b-44e9-b964-a95dd1a919c6 admin admin] PATH_INFO: `/v3/users/07703ff9e72245e4ae3a20793c8affaa` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:22.305179 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0d98e-628b-44e9-b964-a95dd1a919c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07703ff9e72245e4ae3a20793c8affaa)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:22.307137 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0d98e-628b-44e9-b964-a95dd1a919c6 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:22.358371 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-0da0d98e-628b-44e9-b964-a95dd1a919c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07703ff9e72245e4ae3a20793c8affaa'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:22.367714 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-0da0d98e-628b-44e9-b964-a95dd1a919c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07703ff9e72245e4ae3a20793c8affaa'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:22.368322 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-0da0d98e-628b-44e9-b964-a95dd1a919c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07703ff9e72245e4ae3a20793c8affaa'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:22.382008 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-0da0d98e-628b-44e9-b964-a95dd1a919c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07703ff9e72245e4ae3a20793c8affaa'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:22.388745 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-0da0d98e-628b-44e9-b964-a95dd1a919c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07703ff9e72245e4ae3a20793c8affaa'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:22.394670 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1152/2303] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:40:22 2021] DELETE /identity/v3/users/07703ff9e72245e4ae3a20793c8affaa => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:40:22.703610 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bde42-7894-4447-83f9-147a0fc9b8c2 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:22.705378 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e69bde42-7894-4447-83f9-147a0fc9b8c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:22.720381 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bde42-7894-4447-83f9-147a0fc9b8c2 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:22.781392 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372b7b5-5da4-4920-9278-f6f9ab9b8ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:22.782331 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372b7b5-5da4-4920-9278-f6f9ab9b8ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:22.782609 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372b7b5-5da4-4920-9278-f6f9ab9b8ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:22.783032 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372b7b5-5da4-4920-9278-f6f9ab9b8ecf admin admin] PATH_INFO: `/v3/projects/ce7afad3e8684517b915844bbad8072f` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:22.784269 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372b7b5-5da4-4920-9278-f6f9ab9b8ecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce7afad3e8684517b915844bbad8072f)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:22.786542 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372b7b5-5da4-4920-9278-f6f9ab9b8ecf admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:22.834114 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-c372b7b5-5da4-4920-9278-f6f9ab9b8ecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce7afad3e8684517b915844bbad8072f', 'request_id': 'req-c372b7b5-5da4-4920-9278-f6f9ab9b8ecf'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:22.840281 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-c372b7b5-5da4-4920-9278-f6f9ab9b8ecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce7afad3e8684517b915844bbad8072f', 'request_id': 'req-c372b7b5-5da4-4920-9278-f6f9ab9b8ecf'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:22.849277 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-c372b7b5-5da4-4920-9278-f6f9ab9b8ecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce7afad3e8684517b915844bbad8072f', 'request_id': 'req-c372b7b5-5da4-4920-9278-f6f9ab9b8ecf'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:22.859893 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-c372b7b5-5da4-4920-9278-f6f9ab9b8ecf admin admin] The token cache is being invalidate because project ce7afad3e8684517b915844bbad8072f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:40:22.860206 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-c372b7b5-5da4-4920-9278-f6f9ab9b8ecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:22.860960 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-c372b7b5-5da4-4920-9278-f6f9ab9b8ecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:22.862518 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1152/2304] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:40:22 2021] DELETE /identity/v3/projects/ce7afad3e8684517b915844bbad8072f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:40:22.868501 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4dd78-edd3-4765-95dd-b6456e022835 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:22.868995 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4dd78-edd3-4765-95dd-b6456e022835 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:22.868995 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4dd78-edd3-4765-95dd-b6456e022835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:22.886973 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-c1b4dd78-edd3-4765-95dd-b6456e022835 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:40:22.888146 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-c1b4dd78-edd3-4765-95dd-b6456e022835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:22.946864 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1153/2305] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:40:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:40:22.954715 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a3f35-9d3e-4cbb-b8e5-799c2db29367 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:22.955004 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a3f35-9d3e-4cbb-b8e5-799c2db29367 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:22.955277 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a3f35-9d3e-4cbb-b8e5-799c2db29367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:22.973601 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-dd6a3f35-9d3e-4cbb-b8e5-799c2db29367 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:40:22.974856 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-dd6a3f35-9d3e-4cbb-b8e5-799c2db29367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:22.983238 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1153/2306] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:40:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:40:22.988910 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4dd78-edd3-4765-95dd-b6456e022835 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:22.999447 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4dd78-edd3-4765-95dd-b6456e022835 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:23.005579 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b34756-409d-41ea-a6fe-5055270ac7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:23.006334 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b34756-409d-41ea-a6fe-5055270ac7cb admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:23.006707 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b34756-409d-41ea-a6fe-5055270ac7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:23.007061 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b34756-409d-41ea-a6fe-5055270ac7cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:23.007815 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b34756-409d-41ea-a6fe-5055270ac7cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:40:23.008121 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b34756-409d-41ea-a6fe-5055270ac7cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:23.009718 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b34756-409d-41ea-a6fe-5055270ac7cb admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:23.025885 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1154/2307] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:40:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:40:23.027334 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a3f35-9d3e-4cbb-b8e5-799c2db29367 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:23.036800 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a3f35-9d3e-4cbb-b8e5-799c2db29367 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:23.042183 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66fa115-3099-4f1f-b2cc-11aa6ac76042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:23.043244 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fa115-3099-4f1f-b2cc-11aa6ac76042 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:23.043534 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fa115-3099-4f1f-b2cc-11aa6ac76042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:23.043807 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fa115-3099-4f1f-b2cc-11aa6ac76042 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:23.044519 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66fa115-3099-4f1f-b2cc-11aa6ac76042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:23.046478 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66fa115-3099-4f1f-b2cc-11aa6ac76042 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:23.075087 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1154/2308] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:40:23 2021] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:40:23.079582 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b34756-409d-41ea-a6fe-5055270ac7cb admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:23.089436 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b34756-409d-41ea-a6fe-5055270ac7cb admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:23.147031 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10024dd6-9512-447d-863b-5861d98c1f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:23.147720 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10024dd6-9512-447d-863b-5861d98c1f09 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:23.147975 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10024dd6-9512-447d-863b-5861d98c1f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:23.148236 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10024dd6-9512-447d-863b-5861d98c1f09 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:23.148931 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10024dd6-9512-447d-863b-5861d98c1f09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:23.150840 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10024dd6-9512-447d-863b-5861d98c1f09 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:23.172687 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1155/2309] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:40:23 2021] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:40:23.176884 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66fa115-3099-4f1f-b2cc-11aa6ac76042 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:23.187723 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66fa115-3099-4f1f-b2cc-11aa6ac76042 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:23.192458 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ffec1-4615-4be4-812f-330f45dd4792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:23.193124 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ffec1-4615-4be4-812f-330f45dd4792 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:23.193466 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ffec1-4615-4be4-812f-330f45dd4792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:23.193661 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ffec1-4615-4be4-812f-330f45dd4792 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:23.194404 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ffec1-4615-4be4-812f-330f45dd4792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:23.196217 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ffec1-4615-4be4-812f-330f45dd4792 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:23.206933 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1155/2310] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:40:23 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:40:23.211052 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10024dd6-9512-447d-863b-5861d98c1f09 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:23.221220 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10024dd6-9512-447d-863b-5861d98c1f09 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:23.226129 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc7ac2-8ebf-4b71-8524-daf415626b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:23.226909 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc7ac2-8ebf-4b71-8524-daf415626b5a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:23.227255 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc7ac2-8ebf-4b71-8524-daf415626b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:23.227592 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc7ac2-8ebf-4b71-8524-daf415626b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:23.228398 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc7ac2-8ebf-4b71-8524-daf415626b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:23.230069 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc7ac2-8ebf-4b71-8524-daf415626b5a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:23.240625 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1156/2311] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:40:23 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:40:23.249832 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ffec1-4615-4be4-812f-330f45dd4792 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:23.260057 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ffec1-4615-4be4-812f-330f45dd4792 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:23.265126 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c74da-f099-4757-a73f-016e5c1ab418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:23.266185 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c74da-f099-4757-a73f-016e5c1ab418 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:23.266596 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c74da-f099-4757-a73f-016e5c1ab418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:23.266903 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c74da-f099-4757-a73f-016e5c1ab418 admin admin] PATH_INFO: `/v3/projects/86ee9213de7749568d46f7af5b1c190c/users/2c82b379daea461ebebfb8d8267ed1f8/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:23.282018 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c74da-f099-4757-a73f-016e5c1ab418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86ee9213de7749568d46f7af5b1c190c, user_id=2c82b379daea461ebebfb8d8267ed1f8, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:23.284702 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c74da-f099-4757-a73f-016e5c1ab418 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:23.300502 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1156/2312] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:40:23 2021] PUT /identity/v3/projects/86ee9213de7749568d46f7af5b1c190c/users/2c82b379daea461ebebfb8d8267ed1f8/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:40:23.311793 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e0628-3d68-4a9e-80ab-ca235d971409 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:23.312215 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e0628-3d68-4a9e-80ab-ca235d971409 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:23.312603 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e0628-3d68-4a9e-80ab-ca235d971409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:23.340130 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-500e0628-3d68-4a9e-80ab-ca235d971409 None None] MFA Rules not processed for user `2c82b379daea461ebebfb8d8267ed1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:40:23.341431 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-500e0628-3d68-4a9e-80ab-ca235d971409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:23.421935 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1157/2313] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:40:23 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:40:23.426715 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c74da-f099-4757-a73f-016e5c1ab418 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:23.490921 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c74da-f099-4757-a73f-016e5c1ab418 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:23.496826 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03b5b9-4288-4299-a5ea-f3e853972ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:23.497570 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03b5b9-4288-4299-a5ea-f3e853972ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:23.497844 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03b5b9-4288-4299-a5ea-f3e853972ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:23.498108 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03b5b9-4288-4299-a5ea-f3e853972ad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:23.498874 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03b5b9-4288-4299-a5ea-f3e853972ad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:23.500902 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03b5b9-4288-4299-a5ea-f3e853972ad5 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:23.529882 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1157/2314] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:40:23 2021] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:40:23.534774 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e0628-3d68-4a9e-80ab-ca235d971409 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:23.558919 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e0628-3d68-4a9e-80ab-ca235d971409 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:23.626190 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b5d37-7316-4b68-ab39-850cb43865fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:23.627086 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b5d37-7316-4b68-ab39-850cb43865fb admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:23.627425 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b5d37-7316-4b68-ab39-850cb43865fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:23.628324 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b5d37-7316-4b68-ab39-850cb43865fb admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:23.628709 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b5d37-7316-4b68-ab39-850cb43865fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:23.630698 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b5d37-7316-4b68-ab39-850cb43865fb admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:23.667232 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1158/2315] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:40:23 2021] POST /identity/v3/users => generated 300 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:40:23.672129 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03b5b9-4288-4299-a5ea-f3e853972ad5 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:23.683169 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03b5b9-4288-4299-a5ea-f3e853972ad5 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:23.687950 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07780e2-b4ea-4125-a985-aae0558237fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:23.688624 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07780e2-b4ea-4125-a985-aae0558237fb admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:23.688904 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07780e2-b4ea-4125-a985-aae0558237fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:23.689176 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07780e2-b4ea-4125-a985-aae0558237fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:23.689951 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07780e2-b4ea-4125-a985-aae0558237fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:23.691596 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07780e2-b4ea-4125-a985-aae0558237fb admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:23.703393 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1158/2316] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:40:23 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:40:23.707632 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b5d37-7316-4b68-ab39-850cb43865fb admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:23.718622 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b5d37-7316-4b68-ab39-850cb43865fb admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:23.723371 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b982001-b79f-428d-99d9-12024b4c1c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:23.724273 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b982001-b79f-428d-99d9-12024b4c1c72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:23.725110 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b982001-b79f-428d-99d9-12024b4c1c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:23.725110 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b982001-b79f-428d-99d9-12024b4c1c72 admin admin] PATH_INFO: `/v3/projects/01096887d9d4466f96a84eccff096cba/users/13c292970e20451f990c46cebe35a259/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:23.740302 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b982001-b79f-428d-99d9-12024b4c1c72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01096887d9d4466f96a84eccff096cba, user_id=13c292970e20451f990c46cebe35a259, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:23.743117 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b982001-b79f-428d-99d9-12024b4c1c72 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:23.757440 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1159/2317] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:40:23 2021] PUT /identity/v3/projects/01096887d9d4466f96a84eccff096cba/users/13c292970e20451f990c46cebe35a259/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:40:23.762140 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07780e2-b4ea-4125-a985-aae0558237fb admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:23.772774 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07780e2-b4ea-4125-a985-aae0558237fb admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:23.831133 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384df462-6494-4dd9-9c9a-4c2536c3f427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:23.831836 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384df462-6494-4dd9-9c9a-4c2536c3f427 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:23.832154 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384df462-6494-4dd9-9c9a-4c2536c3f427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:23.832492 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384df462-6494-4dd9-9c9a-4c2536c3f427 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:23.833409 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384df462-6494-4dd9-9c9a-4c2536c3f427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:23.835151 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384df462-6494-4dd9-9c9a-4c2536c3f427 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:23.845982 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1159/2318] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:40:23 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:40:23.850344 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b982001-b79f-428d-99d9-12024b4c1c72 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:23.860840 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b982001-b79f-428d-99d9-12024b4c1c72 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:23.866115 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81748805-08c2-40f0-9996-1dc02d484211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:23.867035 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81748805-08c2-40f0-9996-1dc02d484211 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:23.867318 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81748805-08c2-40f0-9996-1dc02d484211 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:23.867587 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81748805-08c2-40f0-9996-1dc02d484211 admin admin] PATH_INFO: `/v3/projects/01096887d9d4466f96a84eccff096cba/users/13c292970e20451f990c46cebe35a259/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:23.869590 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81748805-08c2-40f0-9996-1dc02d484211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01096887d9d4466f96a84eccff096cba, user_id=13c292970e20451f990c46cebe35a259, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:23.872253 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81748805-08c2-40f0-9996-1dc02d484211 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:23.888922 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1160/2319] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:40:23 2021] PUT /identity/v3/projects/01096887d9d4466f96a84eccff096cba/users/13c292970e20451f990c46cebe35a259/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:40:23.899154 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b315c1-548e-4d7b-8884-00438378bb61 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:23.899475 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b315c1-548e-4d7b-8884-00438378bb61 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:23.899752 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b315c1-548e-4d7b-8884-00438378bb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:23.929662 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-d4b315c1-548e-4d7b-8884-00438378bb61 None None] MFA Rules not processed for user `13c292970e20451f990c46cebe35a259`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:40:23.930935 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-d4b315c1-548e-4d7b-8884-00438378bb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:24.006455 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1160/2320] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:40:23 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:40:24.009034 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63aff8-91f4-4d51-98f1-865c5547303f None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:24.009322 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63aff8-91f4-4d51-98f1-865c5547303f None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:24.009604 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63aff8-91f4-4d51-98f1-865c5547303f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:24.017886 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b315c1-548e-4d7b-8884-00438378bb61 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:24.019298 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-d4b315c1-548e-4d7b-8884-00438378bb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:24.061208 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-6b63aff8-91f4-4d51-98f1-865c5547303f None None] MFA Rules not processed for user `62cc0165aee14b449c8a49233001f631`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:40:24.063639 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-6b63aff8-91f4-4d51-98f1-865c5547303f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:24.080120 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b315c1-548e-4d7b-8884-00438378bb61 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:24.083826 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f98cc-2b8c-4415-9ac8-2bd9e8bb4c76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:24.085183 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f98cc-2b8c-4415-9ac8-2bd9e8bb4c76 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:24.085474 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f98cc-2b8c-4415-9ac8-2bd9e8bb4c76 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:24.085750 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f98cc-2b8c-4415-9ac8-2bd9e8bb4c76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:24.096839 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f98cc-2b8c-4415-9ac8-2bd9e8bb4c76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:24.098394 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f98cc-2b8c-4415-9ac8-2bd9e8bb4c76 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:24.109553 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1161/2321] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:40:24 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:40:24.137143 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f98cc-2b8c-4415-9ac8-2bd9e8bb4c76 service cinder] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:24.151938 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1161/2322] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Oct 28 14:40:24 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:40:24.182475 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63aff8-91f4-4d51-98f1-865c5547303f None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:24.184025 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-6b63aff8-91f4-4d51-98f1-865c5547303f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:24.215506 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f98cc-2b8c-4415-9ac8-2bd9e8bb4c76 service cinder] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:24.220852 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28390d61-443e-4571-a200-f339d1a4272e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:24.221904 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28390d61-443e-4571-a200-f339d1a4272e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:24.222352 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28390d61-443e-4571-a200-f339d1a4272e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:24.222819 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28390d61-443e-4571-a200-f339d1a4272e admin admin] PATH_INFO: `/v3/users/2c82b379daea461ebebfb8d8267ed1f8` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:24.224359 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28390d61-443e-4571-a200-f339d1a4272e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c82b379daea461ebebfb8d8267ed1f8)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:24.226409 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28390d61-443e-4571-a200-f339d1a4272e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:24.270778 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-28390d61-443e-4571-a200-f339d1a4272e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c82b379daea461ebebfb8d8267ed1f8'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:24.271541 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-28390d61-443e-4571-a200-f339d1a4272e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c82b379daea461ebebfb8d8267ed1f8'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:24.279649 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-28390d61-443e-4571-a200-f339d1a4272e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c82b379daea461ebebfb8d8267ed1f8'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:24.284669 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63aff8-91f4-4d51-98f1-865c5547303f None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:24.286660 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-28390d61-443e-4571-a200-f339d1a4272e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c82b379daea461ebebfb8d8267ed1f8'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:24.289766 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed3d75-b47b-4b2f-aa77-635293c105d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889e7be1dcaf47f599af9c9b7ad33042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:24.290439 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed3d75-b47b-4b2f-aa77-635293c105d4 service swift] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:24.290720 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed3d75-b47b-4b2f-aa77-635293c105d4 service swift] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:24.290995 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed3d75-b47b-4b2f-aa77-635293c105d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:24.293178 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-07ed3d75-b47b-4b2f-aa77-635293c105d4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:24.298589 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-28390d61-443e-4571-a200-f339d1a4272e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c82b379daea461ebebfb8d8267ed1f8'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:24.304377 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed3d75-b47b-4b2f-aa77-635293c105d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:24.304545 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1162/2323] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:40:24 2021] DELETE /identity/v3/users/2c82b379daea461ebebfb8d8267ed1f8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:40:24.308104 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed3d75-b47b-4b2f-aa77-635293c105d4 service swift] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:24.308981 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc4afc-79fa-4698-98c4-0550821475d2 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:24.309272 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc4afc-79fa-4698-98c4-0550821475d2 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:24.309552 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc4afc-79fa-4698-98c4-0550821475d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:24.316481 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1162/2324] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Oct 28 14:40:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 14:40:24.326807 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-78dc4afc-79fa-4698-98c4-0550821475d2 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:40:24.327994 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-78dc4afc-79fa-4698-98c4-0550821475d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:24.394276 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1163/2325] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:40:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:40:24.419219 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed3d75-b47b-4b2f-aa77-635293c105d4 service swift] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:24.422361 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-07ed3d75-b47b-4b2f-aa77-635293c105d4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:24.541714 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed3d75-b47b-4b2f-aa77-635293c105d4 service swift] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:24.620944 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c48737-ad45-44a0-8e9e-1a983487de9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:24.622010 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c48737-ad45-44a0-8e9e-1a983487de9e service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:24.626011 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c48737-ad45-44a0-8e9e-1a983487de9e service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:24.626413 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c48737-ad45-44a0-8e9e-1a983487de9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:24.637906 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c48737-ad45-44a0-8e9e-1a983487de9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:24.639391 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c48737-ad45-44a0-8e9e-1a983487de9e service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:24.661747 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1163/2326] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:40:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:40:25.014364 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc4afc-79fa-4698-98c4-0550821475d2 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:25.016898 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-78dc4afc-79fa-4698-98c4-0550821475d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:25.050412 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc4afc-79fa-4698-98c4-0550821475d2 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:25.055762 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b99f6-a23c-435b-8f22-6cec11ae9104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:25.056648 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b99f6-a23c-435b-8f22-6cec11ae9104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:25.056933 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b99f6-a23c-435b-8f22-6cec11ae9104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:25.057193 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b99f6-a23c-435b-8f22-6cec11ae9104 admin admin] PATH_INFO: `/v3/projects/86ee9213de7749568d46f7af5b1c190c` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:25.058405 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b99f6-a23c-435b-8f22-6cec11ae9104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86ee9213de7749568d46f7af5b1c190c)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:25.060694 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b99f6-a23c-435b-8f22-6cec11ae9104 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:25.109161 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-010b99f6-a23c-435b-8f22-6cec11ae9104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86ee9213de7749568d46f7af5b1c190c', 'request_id': 'req-010b99f6-a23c-435b-8f22-6cec11ae9104'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:25.115898 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-010b99f6-a23c-435b-8f22-6cec11ae9104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86ee9213de7749568d46f7af5b1c190c', 'request_id': 'req-010b99f6-a23c-435b-8f22-6cec11ae9104'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:25.124716 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-010b99f6-a23c-435b-8f22-6cec11ae9104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86ee9213de7749568d46f7af5b1c190c', 'request_id': 'req-010b99f6-a23c-435b-8f22-6cec11ae9104'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:25.135469 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-010b99f6-a23c-435b-8f22-6cec11ae9104 admin admin] The token cache is being invalidate because project 86ee9213de7749568d46f7af5b1c190c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:40:25.135758 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-010b99f6-a23c-435b-8f22-6cec11ae9104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:25.136399 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-010b99f6-a23c-435b-8f22-6cec11ae9104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:25.138184 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1164/2327] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:40:25 2021] DELETE /identity/v3/projects/86ee9213de7749568d46f7af5b1c190c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:40:25.142265 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c48737-ad45-44a0-8e9e-1a983487de9e service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:25.152253 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c48737-ad45-44a0-8e9e-1a983487de9e service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:25.210581 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d14b4-34d2-45d1-832f-9f1af74d081f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:25.211479 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d14b4-34d2-45d1-832f-9f1af74d081f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:25.211753 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d14b4-34d2-45d1-832f-9f1af74d081f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:25.212048 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d14b4-34d2-45d1-832f-9f1af74d081f admin admin] PATH_INFO: `/v3/users/13c292970e20451f990c46cebe35a259` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:25.213231 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d14b4-34d2-45d1-832f-9f1af74d081f admin admin] RBAC: Authorizing `identity:delete_user(user_id=13c292970e20451f990c46cebe35a259)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:25.215174 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d14b4-34d2-45d1-832f-9f1af74d081f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:25.271991 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-598d14b4-34d2-45d1-832f-9f1af74d081f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13c292970e20451f990c46cebe35a259'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:25.282788 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-598d14b4-34d2-45d1-832f-9f1af74d081f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13c292970e20451f990c46cebe35a259'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:25.283525 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-598d14b4-34d2-45d1-832f-9f1af74d081f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13c292970e20451f990c46cebe35a259'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:25.298033 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-598d14b4-34d2-45d1-832f-9f1af74d081f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13c292970e20451f990c46cebe35a259'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:25.304915 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-598d14b4-34d2-45d1-832f-9f1af74d081f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13c292970e20451f990c46cebe35a259'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:25.310877 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1164/2328] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:40:25 2021] DELETE /identity/v3/users/13c292970e20451f990c46cebe35a259 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:40:25.593379 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b99f6-a23c-435b-8f22-6cec11ae9104 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:25.595152 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-010b99f6-a23c-435b-8f22-6cec11ae9104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:25.630381 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b99f6-a23c-435b-8f22-6cec11ae9104 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:25.694590 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cab5b2-3ce6-402c-85bd-f2916b64ab99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:25.695647 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cab5b2-3ce6-402c-85bd-f2916b64ab99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:25.696003 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cab5b2-3ce6-402c-85bd-f2916b64ab99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:25.696282 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cab5b2-3ce6-402c-85bd-f2916b64ab99 admin admin] PATH_INFO: `/v3/projects/01096887d9d4466f96a84eccff096cba` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:25.697674 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cab5b2-3ce6-402c-85bd-f2916b64ab99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01096887d9d4466f96a84eccff096cba)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:25.699656 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cab5b2-3ce6-402c-85bd-f2916b64ab99 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:25.752949 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-79cab5b2-3ce6-402c-85bd-f2916b64ab99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01096887d9d4466f96a84eccff096cba', 'request_id': 'req-79cab5b2-3ce6-402c-85bd-f2916b64ab99'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:25.760299 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-79cab5b2-3ce6-402c-85bd-f2916b64ab99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01096887d9d4466f96a84eccff096cba', 'request_id': 'req-79cab5b2-3ce6-402c-85bd-f2916b64ab99'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:25.768998 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-79cab5b2-3ce6-402c-85bd-f2916b64ab99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01096887d9d4466f96a84eccff096cba', 'request_id': 'req-79cab5b2-3ce6-402c-85bd-f2916b64ab99'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:25.782602 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-79cab5b2-3ce6-402c-85bd-f2916b64ab99 admin admin] The token cache is being invalidate because project 01096887d9d4466f96a84eccff096cba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:40:25.783279 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-79cab5b2-3ce6-402c-85bd-f2916b64ab99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:25.784320 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-79cab5b2-3ce6-402c-85bd-f2916b64ab99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:25.786146 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1165/2329] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:40:25 2021] DELETE /identity/v3/projects/01096887d9d4466f96a84eccff096cba => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:40:25.794109 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9473c2-f1e8-4c98-9c6c-e5281b4b444d None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:25.794483 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9473c2-f1e8-4c98-9c6c-e5281b4b444d None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:25.794933 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9473c2-f1e8-4c98-9c6c-e5281b4b444d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:25.814888 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-0e9473c2-f1e8-4c98-9c6c-e5281b4b444d None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:40:25.816212 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-0e9473c2-f1e8-4c98-9c6c-e5281b4b444d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:25.875135 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1165/2330] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:40:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:40:25.883050 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92506723-b5df-4547-bebd-967ebee9d3eb None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:25.883350 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92506723-b5df-4547-bebd-967ebee9d3eb None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:25.883639 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92506723-b5df-4547-bebd-967ebee9d3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:25.903470 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-92506723-b5df-4547-bebd-967ebee9d3eb None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:40:25.904847 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-92506723-b5df-4547-bebd-967ebee9d3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:25.913173 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1166/2331] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:40:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:40:25.918179 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9473c2-f1e8-4c98-9c6c-e5281b4b444d None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:25.929127 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9473c2-f1e8-4c98-9c6c-e5281b4b444d None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:25.935182 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14663438-38ab-4093-8560-f2a551ace61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:25.935851 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14663438-38ab-4093-8560-f2a551ace61c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:25.936152 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14663438-38ab-4093-8560-f2a551ace61c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:25.936483 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14663438-38ab-4093-8560-f2a551ace61c admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:25.937250 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14663438-38ab-4093-8560-f2a551ace61c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:40:25.937554 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14663438-38ab-4093-8560-f2a551ace61c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:25.939170 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14663438-38ab-4093-8560-f2a551ace61c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:25.952183 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1166/2332] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:40:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:40:25.957360 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92506723-b5df-4547-bebd-967ebee9d3eb None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:25.967080 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92506723-b5df-4547-bebd-967ebee9d3eb None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:25.972332 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732af81b-a2b4-4bb3-8e06-90f9b2acd641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:25.973007 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732af81b-a2b4-4bb3-8e06-90f9b2acd641 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:25.973278 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732af81b-a2b4-4bb3-8e06-90f9b2acd641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:25.973555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732af81b-a2b4-4bb3-8e06-90f9b2acd641 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:25.974271 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732af81b-a2b4-4bb3-8e06-90f9b2acd641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:25.976298 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732af81b-a2b4-4bb3-8e06-90f9b2acd641 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:26.009022 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1167/2333] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:40:25 2021] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:40:26.010161 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14663438-38ab-4093-8560-f2a551ace61c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:26.020107 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14663438-38ab-4093-8560-f2a551ace61c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:26.092057 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f0233-8925-4692-9818-5e42025aed71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:26.092836 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f0233-8925-4692-9818-5e42025aed71 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:26.093146 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f0233-8925-4692-9818-5e42025aed71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:26.093420 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f0233-8925-4692-9818-5e42025aed71 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:26.094138 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f0233-8925-4692-9818-5e42025aed71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:26.096107 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f0233-8925-4692-9818-5e42025aed71 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:26.119276 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1167/2334] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:40:26 2021] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:40:26.120592 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732af81b-a2b4-4bb3-8e06-90f9b2acd641 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:26.131988 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732af81b-a2b4-4bb3-8e06-90f9b2acd641 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:26.136518 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d75c71-4913-44eb-8456-d6bffa880816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:26.137201 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d75c71-4913-44eb-8456-d6bffa880816 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:26.137457 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d75c71-4913-44eb-8456-d6bffa880816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:26.137753 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d75c71-4913-44eb-8456-d6bffa880816 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:26.138465 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d75c71-4913-44eb-8456-d6bffa880816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:26.140163 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d75c71-4913-44eb-8456-d6bffa880816 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:26.159923 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1168/2335] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:40:26 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:40:26.163593 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f0233-8925-4692-9818-5e42025aed71 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:26.176204 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f0233-8925-4692-9818-5e42025aed71 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:26.181278 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10b614-3b31-407f-a176-b1a13e587156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:26.182194 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10b614-3b31-407f-a176-b1a13e587156 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:26.182539 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10b614-3b31-407f-a176-b1a13e587156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:26.182896 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10b614-3b31-407f-a176-b1a13e587156 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:26.183762 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10b614-3b31-407f-a176-b1a13e587156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:26.185448 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10b614-3b31-407f-a176-b1a13e587156 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:26.197500 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1168/2336] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:40:26 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:40:26.201732 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d75c71-4913-44eb-8456-d6bffa880816 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:26.212091 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d75c71-4913-44eb-8456-d6bffa880816 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:26.216928 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e5008-1b08-4e14-a45d-741f281da371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:26.217813 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e5008-1b08-4e14-a45d-741f281da371 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:26.218133 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e5008-1b08-4e14-a45d-741f281da371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:26.218390 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e5008-1b08-4e14-a45d-741f281da371 admin admin] PATH_INFO: `/v3/projects/dea9d3f2fe8e4f0d9b16f90e9b4513c9/users/d312b496401d4cdfb1d3a927cd2f6c31/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:26.232605 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e5008-1b08-4e14-a45d-741f281da371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea9d3f2fe8e4f0d9b16f90e9b4513c9, user_id=d312b496401d4cdfb1d3a927cd2f6c31, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:26.235634 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e5008-1b08-4e14-a45d-741f281da371 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:26.250081 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1169/2337] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:40:26 2021] PUT /identity/v3/projects/dea9d3f2fe8e4f0d9b16f90e9b4513c9/users/d312b496401d4cdfb1d3a927cd2f6c31/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:40:26.255222 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316afe1-57d5-49dd-8e29-a464e623033d None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:26.255509 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316afe1-57d5-49dd-8e29-a464e623033d None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:26.255785 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316afe1-57d5-49dd-8e29-a464e623033d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:26.276498 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-0316afe1-57d5-49dd-8e29-a464e623033d None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:40:26.277734 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-0316afe1-57d5-49dd-8e29-a464e623033d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:26.349142 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1169/2338] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:40:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:40:26.358666 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e5008-1b08-4e14-a45d-741f281da371 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:26.360407 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-b37e5008-1b08-4e14-a45d-741f281da371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:26.448919 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e5008-1b08-4e14-a45d-741f281da371 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:26.453463 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b014111-e27b-4c77-91a0-69cead75967a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:26.454414 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b014111-e27b-4c77-91a0-69cead75967a service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:26.454730 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b014111-e27b-4c77-91a0-69cead75967a service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:26.455007 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b014111-e27b-4c77-91a0-69cead75967a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:26.472412 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b014111-e27b-4c77-91a0-69cead75967a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:26.474109 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b014111-e27b-4c77-91a0-69cead75967a service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:26.486487 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1170/2339] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:40:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:40:27.174814 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d85d2e-a323-471e-8306-7aafa8e2f442 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:27.175374 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d85d2e-a323-471e-8306-7aafa8e2f442 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:27.175374 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d85d2e-a323-471e-8306-7aafa8e2f442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:27.209698 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-d7d85d2e-a323-471e-8306-7aafa8e2f442 None None] MFA Rules not processed for user `d312b496401d4cdfb1d3a927cd2f6c31`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:40:27.211433 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-d7d85d2e-a323-471e-8306-7aafa8e2f442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:27.334955 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1170/2340] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:40:27 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:40:27.335773 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b014111-e27b-4c77-91a0-69cead75967a service neutron] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:27.350751 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b014111-e27b-4c77-91a0-69cead75967a service neutron] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:27.362913 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5f91c-09d4-4d88-8350-bcc86701ac1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:27.363764 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5f91c-09d4-4d88-8350-bcc86701ac1c admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:27.364139 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5f91c-09d4-4d88-8350-bcc86701ac1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:27.364503 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5f91c-09d4-4d88-8350-bcc86701ac1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:27.365304 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5f91c-09d4-4d88-8350-bcc86701ac1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:27.367452 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5f91c-09d4-4d88-8350-bcc86701ac1c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:27.410893 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1171/2341] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:40:27 2021] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:40:27.415503 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d85d2e-a323-471e-8306-7aafa8e2f442 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:27.430779 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d85d2e-a323-471e-8306-7aafa8e2f442 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:27.506942 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff389ad8-3cb9-4366-b70e-309ceaf1f53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:27.507629 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff389ad8-3cb9-4366-b70e-309ceaf1f53b admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:27.507909 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff389ad8-3cb9-4366-b70e-309ceaf1f53b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:27.508209 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff389ad8-3cb9-4366-b70e-309ceaf1f53b admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:27.508936 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff389ad8-3cb9-4366-b70e-309ceaf1f53b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:27.510875 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff389ad8-3cb9-4366-b70e-309ceaf1f53b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:27.531404 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1171/2342] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:40:27 2021] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:40:27.535405 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5f91c-09d4-4d88-8350-bcc86701ac1c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:27.545871 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5f91c-09d4-4d88-8350-bcc86701ac1c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:27.550764 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abab03-e130-4891-b759-279d0fe62efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:27.551475 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abab03-e130-4891-b759-279d0fe62efb admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:27.551770 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abab03-e130-4891-b759-279d0fe62efb admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:27.552079 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abab03-e130-4891-b759-279d0fe62efb admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:27.552846 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abab03-e130-4891-b759-279d0fe62efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:27.554841 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abab03-e130-4891-b759-279d0fe62efb admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:27.566657 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1172/2343] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:40:27 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:40:27.570973 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff389ad8-3cb9-4366-b70e-309ceaf1f53b admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:27.583103 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff389ad8-3cb9-4366-b70e-309ceaf1f53b admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:27.591507 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4805769-bc1a-472d-b61f-9daa1e581f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:27.592528 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4805769-bc1a-472d-b61f-9daa1e581f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:27.592900 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4805769-bc1a-472d-b61f-9daa1e581f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:27.593249 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4805769-bc1a-472d-b61f-9daa1e581f60 admin admin] PATH_INFO: `/v3/projects/af2552c1eb3542aea2406bab8a93341d/users/97dbde47baa8421f9d309d0c84358dc3/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:27.609364 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4805769-bc1a-472d-b61f-9daa1e581f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af2552c1eb3542aea2406bab8a93341d, user_id=97dbde47baa8421f9d309d0c84358dc3, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:27.612040 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4805769-bc1a-472d-b61f-9daa1e581f60 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:27.625865 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1172/2344] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:40:27 2021] PUT /identity/v3/projects/af2552c1eb3542aea2406bab8a93341d/users/97dbde47baa8421f9d309d0c84358dc3/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:40:27.629866 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abab03-e130-4891-b759-279d0fe62efb admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:27.640070 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abab03-e130-4891-b759-279d0fe62efb admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:27.700709 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec81dbb-778d-4134-9785-38c6368f11fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:27.701384 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec81dbb-778d-4134-9785-38c6368f11fb admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:27.701639 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec81dbb-778d-4134-9785-38c6368f11fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:27.701908 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec81dbb-778d-4134-9785-38c6368f11fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:27.702801 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec81dbb-778d-4134-9785-38c6368f11fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:27.704400 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec81dbb-778d-4134-9785-38c6368f11fb admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:27.713995 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1173/2345] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:40:27 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:40:27.718262 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4805769-bc1a-472d-b61f-9daa1e581f60 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:27.728472 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4805769-bc1a-472d-b61f-9daa1e581f60 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:27.733137 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d07351-9d5d-464f-8e56-99a1af25e2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:27.736391 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d07351-9d5d-464f-8e56-99a1af25e2ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:27.736674 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d07351-9d5d-464f-8e56-99a1af25e2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:27.736936 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d07351-9d5d-464f-8e56-99a1af25e2ca admin admin] PATH_INFO: `/v3/projects/af2552c1eb3542aea2406bab8a93341d/users/97dbde47baa8421f9d309d0c84358dc3/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:27.739094 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d07351-9d5d-464f-8e56-99a1af25e2ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=af2552c1eb3542aea2406bab8a93341d, user_id=97dbde47baa8421f9d309d0c84358dc3, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:27.741741 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d07351-9d5d-464f-8e56-99a1af25e2ca admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:27.752827 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1173/2346] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:40:27 2021] PUT /identity/v3/projects/af2552c1eb3542aea2406bab8a93341d/users/97dbde47baa8421f9d309d0c84358dc3/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:40:28.500564 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edcc95-f9dd-4f92-919b-06d042e81e8e None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:28.501257 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edcc95-f9dd-4f92-919b-06d042e81e8e None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:28.501257 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edcc95-f9dd-4f92-919b-06d042e81e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:28.550840 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-41edcc95-f9dd-4f92-919b-06d042e81e8e None None] MFA Rules not processed for user `97dbde47baa8421f9d309d0c84358dc3`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:40:28.552406 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-41edcc95-f9dd-4f92-919b-06d042e81e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:28.652455 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1174/2347] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:40:28 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:40:28.671074 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d07351-9d5d-464f-8e56-99a1af25e2ca admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:28.673585 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-47d07351-9d5d-464f-8e56-99a1af25e2ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:28.763520 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d07351-9d5d-464f-8e56-99a1af25e2ca admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:28.767460 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04ab04-70c1-4ce3-ac18-a4cfce39017a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:28.768535 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04ab04-70c1-4ce3-ac18-a4cfce39017a service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:28.769056 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04ab04-70c1-4ce3-ac18-a4cfce39017a service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:28.769449 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04ab04-70c1-4ce3-ac18-a4cfce39017a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:28.840953 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04ab04-70c1-4ce3-ac18-a4cfce39017a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:28.844063 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04ab04-70c1-4ce3-ac18-a4cfce39017a service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:28.854428 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1174/2348] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:40:28 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:40:33.451643 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edcc95-f9dd-4f92-919b-06d042e81e8e None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:33.461860 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edcc95-f9dd-4f92-919b-06d042e81e8e None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:33.466064 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf5be5-eac9-4e6f-8ec5-e2058637b43b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:33.466780 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf5be5-eac9-4e6f-8ec5-e2058637b43b service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:33.467057 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf5be5-eac9-4e6f-8ec5-e2058637b43b service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:33.467325 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf5be5-eac9-4e6f-8ec5-e2058637b43b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:33.476431 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf5be5-eac9-4e6f-8ec5-e2058637b43b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:33.477870 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf5be5-eac9-4e6f-8ec5-e2058637b43b service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:33.489015 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1175/2349] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:40:33 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:40:40.805275 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04ab04-70c1-4ce3-ac18-a4cfce39017a service cinder] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:40.806909 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-0e04ab04-70c1-4ce3-ac18-a4cfce39017a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:40.863631 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04ab04-70c1-4ce3-ac18-a4cfce39017a service cinder] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:40.867780 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d56644-6a08-4679-bbbc-19c11504433a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:40.868399 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d56644-6a08-4679-bbbc-19c11504433a service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:40.868675 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d56644-6a08-4679-bbbc-19c11504433a service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:40.868948 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d56644-6a08-4679-bbbc-19c11504433a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:40.870890 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-31d56644-6a08-4679-bbbc-19c11504433a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:40.944790 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d56644-6a08-4679-bbbc-19c11504433a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:40.946270 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d56644-6a08-4679-bbbc-19c11504433a service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:40.955977 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1175/2350] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:40:40 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:40:48.924814 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf5be5-eac9-4e6f-8ec5-e2058637b43b service cinder] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:48.992749 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf5be5-eac9-4e6f-8ec5-e2058637b43b service cinder] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:48.997907 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ac51f-3f5f-494f-9997-de95802ef73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:48.998819 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ac51f-3f5f-494f-9997-de95802ef73e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:48.999099 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ac51f-3f5f-494f-9997-de95802ef73e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:48.999371 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ac51f-3f5f-494f-9997-de95802ef73e admin admin] PATH_INFO: `/v3/users/d312b496401d4cdfb1d3a927cd2f6c31` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:49.000687 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ac51f-3f5f-494f-9997-de95802ef73e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d312b496401d4cdfb1d3a927cd2f6c31)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:49.002667 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ac51f-3f5f-494f-9997-de95802ef73e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:49.061636 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-078ac51f-3f5f-494f-9997-de95802ef73e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd312b496401d4cdfb1d3a927cd2f6c31'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:49.062397 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-078ac51f-3f5f-494f-9997-de95802ef73e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd312b496401d4cdfb1d3a927cd2f6c31'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:49.072973 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-078ac51f-3f5f-494f-9997-de95802ef73e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd312b496401d4cdfb1d3a927cd2f6c31'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:49.080091 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-078ac51f-3f5f-494f-9997-de95802ef73e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd312b496401d4cdfb1d3a927cd2f6c31'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:49.095415 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-078ac51f-3f5f-494f-9997-de95802ef73e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd312b496401d4cdfb1d3a927cd2f6c31'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:49.102386 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1176/2351] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:40:48 2021] DELETE /identity/v3/users/d312b496401d4cdfb1d3a927cd2f6c31 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:40:49.293021 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d56644-6a08-4679-bbbc-19c11504433a service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:49.304511 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d56644-6a08-4679-bbbc-19c11504433a service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:49.360899 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a258f-f3f5-464e-b7bd-0ec945e5cd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:49.361820 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a258f-f3f5-464e-b7bd-0ec945e5cd36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:49.362100 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a258f-f3f5-464e-b7bd-0ec945e5cd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:49.362378 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a258f-f3f5-464e-b7bd-0ec945e5cd36 admin admin] PATH_INFO: `/v3/projects/dea9d3f2fe8e4f0d9b16f90e9b4513c9` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:49.363609 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a258f-f3f5-464e-b7bd-0ec945e5cd36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dea9d3f2fe8e4f0d9b16f90e9b4513c9)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:49.365517 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a258f-f3f5-464e-b7bd-0ec945e5cd36 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:49.411845 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4d5a258f-f3f5-464e-b7bd-0ec945e5cd36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dea9d3f2fe8e4f0d9b16f90e9b4513c9', 'request_id': 'req-4d5a258f-f3f5-464e-b7bd-0ec945e5cd36'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:49.418400 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4d5a258f-f3f5-464e-b7bd-0ec945e5cd36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dea9d3f2fe8e4f0d9b16f90e9b4513c9', 'request_id': 'req-4d5a258f-f3f5-464e-b7bd-0ec945e5cd36'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:49.426702 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4d5a258f-f3f5-464e-b7bd-0ec945e5cd36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dea9d3f2fe8e4f0d9b16f90e9b4513c9', 'request_id': 'req-4d5a258f-f3f5-464e-b7bd-0ec945e5cd36'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:49.437300 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4d5a258f-f3f5-464e-b7bd-0ec945e5cd36 admin admin] The token cache is being invalidate because project dea9d3f2fe8e4f0d9b16f90e9b4513c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:40:49.437606 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4d5a258f-f3f5-464e-b7bd-0ec945e5cd36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:49.438231 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4d5a258f-f3f5-464e-b7bd-0ec945e5cd36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:49.439830 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1176/2352] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:40:49 2021] DELETE /identity/v3/projects/dea9d3f2fe8e4f0d9b16f90e9b4513c9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:40:49.443718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ac51f-3f5f-494f-9997-de95802ef73e admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:49.445121 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-078ac51f-3f5f-494f-9997-de95802ef73e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:49.457869 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ac51f-3f5f-494f-9997-de95802ef73e admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:49.514425 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c8c3d-19da-4177-81fb-778be7020fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:49.515405 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c8c3d-19da-4177-81fb-778be7020fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:49.515681 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c8c3d-19da-4177-81fb-778be7020fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:49.515950 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c8c3d-19da-4177-81fb-778be7020fb0 admin admin] PATH_INFO: `/v3/users/97dbde47baa8421f9d309d0c84358dc3` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:49.517164 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c8c3d-19da-4177-81fb-778be7020fb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97dbde47baa8421f9d309d0c84358dc3)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:49.519165 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c8c3d-19da-4177-81fb-778be7020fb0 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:49.565143 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-445c8c3d-19da-4177-81fb-778be7020fb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97dbde47baa8421f9d309d0c84358dc3'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:49.565808 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-445c8c3d-19da-4177-81fb-778be7020fb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97dbde47baa8421f9d309d0c84358dc3'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:49.574134 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-445c8c3d-19da-4177-81fb-778be7020fb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97dbde47baa8421f9d309d0c84358dc3'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:49.581443 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-445c8c3d-19da-4177-81fb-778be7020fb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97dbde47baa8421f9d309d0c84358dc3'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:49.594212 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-445c8c3d-19da-4177-81fb-778be7020fb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97dbde47baa8421f9d309d0c84358dc3'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:49.601991 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1177/2353] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:40:49 2021] DELETE /identity/v3/users/97dbde47baa8421f9d309d0c84358dc3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:40:49.808955 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a258f-f3f5-464e-b7bd-0ec945e5cd36 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:49.810368 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-4d5a258f-f3f5-464e-b7bd-0ec945e5cd36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:49.824897 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a258f-f3f5-464e-b7bd-0ec945e5cd36 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:49.882589 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a28739-0156-4461-851e-bf5af38cd54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:49.883518 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a28739-0156-4461-851e-bf5af38cd54a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:49.883792 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a28739-0156-4461-851e-bf5af38cd54a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:49.884058 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a28739-0156-4461-851e-bf5af38cd54a admin admin] PATH_INFO: `/v3/projects/af2552c1eb3542aea2406bab8a93341d` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:49.885257 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a28739-0156-4461-851e-bf5af38cd54a admin admin] RBAC: Authorizing `identity:delete_project(project_id=af2552c1eb3542aea2406bab8a93341d)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:49.887350 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a28739-0156-4461-851e-bf5af38cd54a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:49.935472 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-06a28739-0156-4461-851e-bf5af38cd54a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af2552c1eb3542aea2406bab8a93341d', 'request_id': 'req-06a28739-0156-4461-851e-bf5af38cd54a'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:49.941624 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-06a28739-0156-4461-851e-bf5af38cd54a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af2552c1eb3542aea2406bab8a93341d', 'request_id': 'req-06a28739-0156-4461-851e-bf5af38cd54a'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:49.951141 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-06a28739-0156-4461-851e-bf5af38cd54a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af2552c1eb3542aea2406bab8a93341d', 'request_id': 'req-06a28739-0156-4461-851e-bf5af38cd54a'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:49.963993 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-06a28739-0156-4461-851e-bf5af38cd54a admin admin] The token cache is being invalidate because project af2552c1eb3542aea2406bab8a93341d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:40:49.964271 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-06a28739-0156-4461-851e-bf5af38cd54a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:49.965043 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-06a28739-0156-4461-851e-bf5af38cd54a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:40:49.966604 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1177/2354] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:40:49 2021] DELETE /identity/v3/projects/af2552c1eb3542aea2406bab8a93341d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:40:49.974493 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d451f-4102-4f3f-83bb-d1eef9ab0a44 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:49.974961 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d451f-4102-4f3f-83bb-d1eef9ab0a44 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:49.975069 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d451f-4102-4f3f-83bb-d1eef9ab0a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:49.992743 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-5b5d451f-4102-4f3f-83bb-d1eef9ab0a44 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:40:49.994041 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-5b5d451f-4102-4f3f-83bb-d1eef9ab0a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:50.061303 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1178/2355] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:40:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:40:50.071345 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667b807-15a5-46f1-b444-feac59b67688 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:50.071653 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667b807-15a5-46f1-b444-feac59b67688 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:50.071932 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667b807-15a5-46f1-b444-feac59b67688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:50.092588 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-5667b807-15a5-46f1-b444-feac59b67688 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:40:50.093830 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-5667b807-15a5-46f1-b444-feac59b67688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:50.101849 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1178/2356] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:40:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:40:50.106351 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d451f-4102-4f3f-83bb-d1eef9ab0a44 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:50.116470 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d451f-4102-4f3f-83bb-d1eef9ab0a44 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:50.122035 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36f5bb-4720-41c2-b592-d85104976905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:50.122782 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36f5bb-4720-41c2-b592-d85104976905 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:50.123072 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36f5bb-4720-41c2-b592-d85104976905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:50.123365 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36f5bb-4720-41c2-b592-d85104976905 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:50.124184 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36f5bb-4720-41c2-b592-d85104976905 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:40:50.124501 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36f5bb-4720-41c2-b592-d85104976905 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:50.126113 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36f5bb-4720-41c2-b592-d85104976905 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:50.138163 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1179/2357] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:40:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:40:50.142616 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667b807-15a5-46f1-b444-feac59b67688 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:50.152052 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667b807-15a5-46f1-b444-feac59b67688 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:50.157448 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6e57c-8fa2-4921-925c-ae0c90be6a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:50.158143 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6e57c-8fa2-4921-925c-ae0c90be6a92 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:50.158457 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6e57c-8fa2-4921-925c-ae0c90be6a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:50.158757 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6e57c-8fa2-4921-925c-ae0c90be6a92 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:50.159454 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6e57c-8fa2-4921-925c-ae0c90be6a92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:50.161415 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6e57c-8fa2-4921-925c-ae0c90be6a92 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:50.188816 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1179/2358] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:40:50 2021] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:40:50.193224 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36f5bb-4720-41c2-b592-d85104976905 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:50.204102 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36f5bb-4720-41c2-b592-d85104976905 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:50.263833 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccb9be-f8ac-4864-ad74-c0dde1a00b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:50.264653 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccb9be-f8ac-4864-ad74-c0dde1a00b5c admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:50.264931 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccb9be-f8ac-4864-ad74-c0dde1a00b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:50.265201 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccb9be-f8ac-4864-ad74-c0dde1a00b5c admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:50.265947 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccb9be-f8ac-4864-ad74-c0dde1a00b5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:50.267994 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccb9be-f8ac-4864-ad74-c0dde1a00b5c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:50.294803 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1180/2359] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:40:50 2021] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:40:50.296281 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6e57c-8fa2-4921-925c-ae0c90be6a92 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:50.306438 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6e57c-8fa2-4921-925c-ae0c90be6a92 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:50.311234 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a5e86-b17c-445d-adb2-87f2b039b169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:50.311924 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a5e86-b17c-445d-adb2-87f2b039b169 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:50.312658 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a5e86-b17c-445d-adb2-87f2b039b169 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:50.312658 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a5e86-b17c-445d-adb2-87f2b039b169 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:50.313178 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a5e86-b17c-445d-adb2-87f2b039b169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:50.314847 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a5e86-b17c-445d-adb2-87f2b039b169 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:50.325401 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1180/2360] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:40:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:40:50.329603 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccb9be-f8ac-4864-ad74-c0dde1a00b5c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:50.339954 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccb9be-f8ac-4864-ad74-c0dde1a00b5c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:50.345388 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4810ae-4873-4575-8cb8-86a5822f84cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:50.346195 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4810ae-4873-4575-8cb8-86a5822f84cf admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:50.346519 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4810ae-4873-4575-8cb8-86a5822f84cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:50.346838 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4810ae-4873-4575-8cb8-86a5822f84cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:50.347587 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4810ae-4873-4575-8cb8-86a5822f84cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:50.349221 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4810ae-4873-4575-8cb8-86a5822f84cf admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:50.360593 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1181/2361] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:40:50 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:40:50.364936 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a5e86-b17c-445d-adb2-87f2b039b169 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:50.374966 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a5e86-b17c-445d-adb2-87f2b039b169 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:50.379689 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13926b-f3ae-4660-9776-2e12af3772a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:50.380571 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13926b-f3ae-4660-9776-2e12af3772a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:50.380848 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13926b-f3ae-4660-9776-2e12af3772a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:50.381111 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13926b-f3ae-4660-9776-2e12af3772a1 admin admin] PATH_INFO: `/v3/projects/84311f9716e643ef896b3d37eb16f6a9/users/a7a35fbe2ba24ae6b64d4d856abd0596/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:50.396303 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13926b-f3ae-4660-9776-2e12af3772a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84311f9716e643ef896b3d37eb16f6a9, user_id=a7a35fbe2ba24ae6b64d4d856abd0596, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:50.398974 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13926b-f3ae-4660-9776-2e12af3772a1 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:50.412692 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1181/2362] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:40:50 2021] PUT /identity/v3/projects/84311f9716e643ef896b3d37eb16f6a9/users/a7a35fbe2ba24ae6b64d4d856abd0596/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:40:50.423481 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430ef2d-1036-4e5f-a11d-d3b34f4dac15 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:50.423850 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430ef2d-1036-4e5f-a11d-d3b34f4dac15 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:50.424280 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430ef2d-1036-4e5f-a11d-d3b34f4dac15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:50.453011 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-7430ef2d-1036-4e5f-a11d-d3b34f4dac15 None None] MFA Rules not processed for user `a7a35fbe2ba24ae6b64d4d856abd0596`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:40:50.454137 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-7430ef2d-1036-4e5f-a11d-d3b34f4dac15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:50.531308 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1182/2363] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:40:50 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:40:50.541933 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13926b-f3ae-4660-9776-2e12af3772a1 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:50.543987 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-ad13926b-f3ae-4660-9776-2e12af3772a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:50.599520 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13926b-f3ae-4660-9776-2e12af3772a1 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:50.603649 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23285e4-a7bb-42a9-b8a2-c234eab87da6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:50.604336 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23285e4-a7bb-42a9-b8a2-c234eab87da6 service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:50.604768 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23285e4-a7bb-42a9-b8a2-c234eab87da6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:50.605046 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23285e4-a7bb-42a9-b8a2-c234eab87da6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:50.614330 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23285e4-a7bb-42a9-b8a2-c234eab87da6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:50.615829 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23285e4-a7bb-42a9-b8a2-c234eab87da6 service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:50.625512 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1182/2364] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:40:50 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:40:51.910825 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b09cf2-75ea-4efb-83c9-a501067d04e8 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:51.911381 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b09cf2-75ea-4efb-83c9-a501067d04e8 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:51.911467 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b09cf2-75ea-4efb-83c9-a501067d04e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:51.932465 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-55b09cf2-75ea-4efb-83c9-a501067d04e8 None None] MFA Rules not processed for user `6c878a666cea4ff2be87715c4dcfcbd5`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:40:51.933910 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-55b09cf2-75ea-4efb-83c9-a501067d04e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:51.997683 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1183/2365] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:40:51 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:40:57.119369 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e52cc-5cee-4244-b4ff-91ef3b100c9c None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:57.119888 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e52cc-5cee-4244-b4ff-91ef3b100c9c None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:57.119888 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e52cc-5cee-4244-b4ff-91ef3b100c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:57.140302 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-a84e52cc-5cee-4244-b4ff-91ef3b100c9c None None] MFA Rules not processed for user `62cc0165aee14b449c8a49233001f631`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:40:57.141767 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a84e52cc-5cee-4244-b4ff-91ef3b100c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:57.206640 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1183/2366] 10.222.0.79 () {58 vars in 967 bytes} [Thu Oct 28 14:40:57 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:40:57.230670 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b09cf2-75ea-4efb-83c9-a501067d04e8 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:40:57.232400 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-55b09cf2-75ea-4efb-83c9-a501067d04e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:40:57.306817 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b09cf2-75ea-4efb-83c9-a501067d04e8 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:40:57.312053 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196de36-8e0f-450f-a0cf-10e11aca8987 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889e7be1dcaf47f599af9c9b7ad33042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:40:57.312759 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196de36-8e0f-450f-a0cf-10e11aca8987 service swift] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:40:57.313038 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196de36-8e0f-450f-a0cf-10e11aca8987 service swift] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:40:57.313308 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196de36-8e0f-450f-a0cf-10e11aca8987 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:40:57.322763 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196de36-8e0f-450f-a0cf-10e11aca8987 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:40:57.324523 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196de36-8e0f-450f-a0cf-10e11aca8987 service swift] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:40:57.333889 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1184/2367] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Oct 28 14:40:57 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 14:41:00.128363 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e52cc-5cee-4244-b4ff-91ef3b100c9c None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:00.129930 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a84e52cc-5cee-4244-b4ff-91ef3b100c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:41:00.205552 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e52cc-5cee-4244-b4ff-91ef3b100c9c None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:00.210068 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b88411-bce4-426a-94e6-6012edd21123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:00.210981 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b88411-bce4-426a-94e6-6012edd21123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:00.211260 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b88411-bce4-426a-94e6-6012edd21123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:00.211532 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b88411-bce4-426a-94e6-6012edd21123 admin admin] PATH_INFO: `/v3/users/1389d849e741448abf4fdebd6d30845f` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:00.212800 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b88411-bce4-426a-94e6-6012edd21123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1389d849e741448abf4fdebd6d30845f)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:00.214873 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b88411-bce4-426a-94e6-6012edd21123 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:00.264785 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-80b88411-bce4-426a-94e6-6012edd21123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1389d849e741448abf4fdebd6d30845f'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:00.272158 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-80b88411-bce4-426a-94e6-6012edd21123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1389d849e741448abf4fdebd6d30845f'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:00.272774 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-80b88411-bce4-426a-94e6-6012edd21123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1389d849e741448abf4fdebd6d30845f'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:00.284152 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-80b88411-bce4-426a-94e6-6012edd21123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1389d849e741448abf4fdebd6d30845f'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:00.290710 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-80b88411-bce4-426a-94e6-6012edd21123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1389d849e741448abf4fdebd6d30845f'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:00.296880 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1184/2368] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:41:00 2021] DELETE /identity/v3/users/1389d849e741448abf4fdebd6d30845f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:41:00.469843 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196de36-8e0f-450f-a0cf-10e11aca8987 service swift] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:00.485131 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196de36-8e0f-450f-a0cf-10e11aca8987 service swift] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:00.551601 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2990f91-4396-46c6-b4b5-e8b4aa301be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:00.552640 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2990f91-4396-46c6-b4b5-e8b4aa301be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:00.552842 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2990f91-4396-46c6-b4b5-e8b4aa301be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:00.553114 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2990f91-4396-46c6-b4b5-e8b4aa301be6 admin admin] PATH_INFO: `/v3/projects/5dda0d6d1b084868853338165ea3601d` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:00.554302 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2990f91-4396-46c6-b4b5-e8b4aa301be6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dda0d6d1b084868853338165ea3601d)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:00.556248 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2990f91-4396-46c6-b4b5-e8b4aa301be6 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:00.603406 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-f2990f91-4396-46c6-b4b5-e8b4aa301be6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dda0d6d1b084868853338165ea3601d', 'request_id': 'req-f2990f91-4396-46c6-b4b5-e8b4aa301be6'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:00.609852 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-f2990f91-4396-46c6-b4b5-e8b4aa301be6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dda0d6d1b084868853338165ea3601d', 'request_id': 'req-f2990f91-4396-46c6-b4b5-e8b4aa301be6'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:00.620180 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-f2990f91-4396-46c6-b4b5-e8b4aa301be6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dda0d6d1b084868853338165ea3601d', 'request_id': 'req-f2990f91-4396-46c6-b4b5-e8b4aa301be6'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:00.630293 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-f2990f91-4396-46c6-b4b5-e8b4aa301be6 admin admin] The token cache is being invalidate because project 5dda0d6d1b084868853338165ea3601d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:41:00.630574 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-f2990f91-4396-46c6-b4b5-e8b4aa301be6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:00.631201 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-f2990f91-4396-46c6-b4b5-e8b4aa301be6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:00.632731 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1185/2369] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:41:00 2021] DELETE /identity/v3/projects/5dda0d6d1b084868853338165ea3601d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:41:00.638607 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e0288-fdba-40cf-b2ec-2692501cc500 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:00.638939 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e0288-fdba-40cf-b2ec-2692501cc500 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:00.639213 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e0288-fdba-40cf-b2ec-2692501cc500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:00.656668 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-573e0288-fdba-40cf-b2ec-2692501cc500 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:41:00.657855 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-573e0288-fdba-40cf-b2ec-2692501cc500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:41:00.721099 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1185/2370] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:41:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:41:00.733272 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106947e-0b4e-48c6-ba0a-8c5ddd4b8ce3 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:00.733664 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106947e-0b4e-48c6-ba0a-8c5ddd4b8ce3 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:00.734048 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106947e-0b4e-48c6-ba0a-8c5ddd4b8ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:00.754586 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-5106947e-0b4e-48c6-ba0a-8c5ddd4b8ce3 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:41:00.755845 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-5106947e-0b4e-48c6-ba0a-8c5ddd4b8ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:41:00.767187 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1186/2371] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:41:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:41:00.772348 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e0288-fdba-40cf-b2ec-2692501cc500 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:00.787375 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e0288-fdba-40cf-b2ec-2692501cc500 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:00.793820 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfde2a-2dbb-4b90-ac3e-fc13b5cfb237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:00.794495 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfde2a-2dbb-4b90-ac3e-fc13b5cfb237 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:00.794796 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfde2a-2dbb-4b90-ac3e-fc13b5cfb237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:00.795092 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfde2a-2dbb-4b90-ac3e-fc13b5cfb237 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:00.795839 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfde2a-2dbb-4b90-ac3e-fc13b5cfb237 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:41:00.796087 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfde2a-2dbb-4b90-ac3e-fc13b5cfb237 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:00.797721 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfde2a-2dbb-4b90-ac3e-fc13b5cfb237 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:00.810168 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1186/2372] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:41:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:41:00.814852 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106947e-0b4e-48c6-ba0a-8c5ddd4b8ce3 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:00.824573 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106947e-0b4e-48c6-ba0a-8c5ddd4b8ce3 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:00.830398 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7c1b7-6fbb-4778-bd9f-77b9358f50b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:00.831090 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7c1b7-6fbb-4778-bd9f-77b9358f50b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:00.831364 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7c1b7-6fbb-4778-bd9f-77b9358f50b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:00.831634 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7c1b7-6fbb-4778-bd9f-77b9358f50b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:00.832345 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff7c1b7-6fbb-4778-bd9f-77b9358f50b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:00.834247 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff7c1b7-6fbb-4778-bd9f-77b9358f50b5 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:00.865455 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1187/2373] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:41:00 2021] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:41:00.866771 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfde2a-2dbb-4b90-ac3e-fc13b5cfb237 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:00.881417 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfde2a-2dbb-4b90-ac3e-fc13b5cfb237 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:00.944306 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce283a05-fd0d-4a1b-a58e-e02433660dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:00.944990 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce283a05-fd0d-4a1b-a58e-e02433660dff admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:00.945273 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce283a05-fd0d-4a1b-a58e-e02433660dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:00.945550 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce283a05-fd0d-4a1b-a58e-e02433660dff admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:00.946261 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce283a05-fd0d-4a1b-a58e-e02433660dff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:00.948185 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce283a05-fd0d-4a1b-a58e-e02433660dff admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:00.969600 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1187/2374] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:41:00 2021] POST /identity/v3/users => generated 303 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:41:00.973976 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7c1b7-6fbb-4778-bd9f-77b9358f50b5 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:00.984391 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7c1b7-6fbb-4778-bd9f-77b9358f50b5 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:00.989718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c61e39-bf29-4eb5-b6c8-437af97a4277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:00.990381 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c61e39-bf29-4eb5-b6c8-437af97a4277 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:00.990658 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c61e39-bf29-4eb5-b6c8-437af97a4277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:00.990972 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c61e39-bf29-4eb5-b6c8-437af97a4277 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:00.991720 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c61e39-bf29-4eb5-b6c8-437af97a4277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:00.993324 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c61e39-bf29-4eb5-b6c8-437af97a4277 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:01.004140 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1188/2375] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:41:00 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:41:01.008148 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce283a05-fd0d-4a1b-a58e-e02433660dff admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:01.018930 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce283a05-fd0d-4a1b-a58e-e02433660dff admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:01.024870 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce1f8d-b23a-4a3b-bc8b-b3d73187ad99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:01.025552 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce1f8d-b23a-4a3b-bc8b-b3d73187ad99 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:01.025827 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce1f8d-b23a-4a3b-bc8b-b3d73187ad99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:01.026129 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce1f8d-b23a-4a3b-bc8b-b3d73187ad99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:01.026909 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce1f8d-b23a-4a3b-bc8b-b3d73187ad99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:01.028907 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce1f8d-b23a-4a3b-bc8b-b3d73187ad99 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:01.040252 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1188/2376] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:41:01 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:41:01.045594 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c61e39-bf29-4eb5-b6c8-437af97a4277 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:01.056348 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c61e39-bf29-4eb5-b6c8-437af97a4277 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:01.062308 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881c6f8-5af1-403f-b93b-16cecc90fe12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:01.063263 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881c6f8-5af1-403f-b93b-16cecc90fe12 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:01.063536 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881c6f8-5af1-403f-b93b-16cecc90fe12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:01.063810 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881c6f8-5af1-403f-b93b-16cecc90fe12 admin admin] PATH_INFO: `/v3/projects/edda4624f5724d91b68c8ca7e328397b/users/2c07c30915d545288c036305f8a98db8/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:01.079200 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881c6f8-5af1-403f-b93b-16cecc90fe12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edda4624f5724d91b68c8ca7e328397b, user_id=2c07c30915d545288c036305f8a98db8, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:01.081854 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881c6f8-5af1-403f-b93b-16cecc90fe12 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:01.096833 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1189/2377] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:41:01 2021] PUT /identity/v3/projects/edda4624f5724d91b68c8ca7e328397b/users/2c07c30915d545288c036305f8a98db8/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:41:01.102521 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5a231-5e03-4380-9a81-ccb43537b385 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:01.102843 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5a231-5e03-4380-9a81-ccb43537b385 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:01.103166 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5a231-5e03-4380-9a81-ccb43537b385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:01.122577 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-f6b5a231-5e03-4380-9a81-ccb43537b385 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:41:01.123840 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-f6b5a231-5e03-4380-9a81-ccb43537b385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:41:01.198951 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1189/2378] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:41:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:41:01.209178 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881c6f8-5af1-403f-b93b-16cecc90fe12 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:01.211006 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-1881c6f8-5af1-403f-b93b-16cecc90fe12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:41:01.270028 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881c6f8-5af1-403f-b93b-16cecc90fe12 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:01.273657 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb17da9-7deb-430a-b14c-87a0a3cd935e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:01.274303 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb17da9-7deb-430a-b14c-87a0a3cd935e service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:01.274576 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb17da9-7deb-430a-b14c-87a0a3cd935e service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:01.274872 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb17da9-7deb-430a-b14c-87a0a3cd935e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:01.284424 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb17da9-7deb-430a-b14c-87a0a3cd935e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:01.285854 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb17da9-7deb-430a-b14c-87a0a3cd935e service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:01.299787 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1190/2379] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:41:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:41:01.928885 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c2959-2a87-4209-a524-f9e679038919 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:01.929422 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c2959-2a87-4209-a524-f9e679038919 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:01.929696 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c2959-2a87-4209-a524-f9e679038919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:01.959460 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-856c2959-2a87-4209-a524-f9e679038919 None None] MFA Rules not processed for user `2c07c30915d545288c036305f8a98db8`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:41:01.960792 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-856c2959-2a87-4209-a524-f9e679038919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:41:02.022247 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1190/2380] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:41:01 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:41:02.027048 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb17da9-7deb-430a-b14c-87a0a3cd935e service neutron] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:02.037530 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb17da9-7deb-430a-b14c-87a0a3cd935e service neutron] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:02.043139 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d69b39-ac26-430f-925b-5cac7cefb7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:02.043804 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d69b39-ac26-430f-925b-5cac7cefb7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:02.044082 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d69b39-ac26-430f-925b-5cac7cefb7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:02.044353 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d69b39-ac26-430f-925b-5cac7cefb7a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:02.045056 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d69b39-ac26-430f-925b-5cac7cefb7a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:02.046981 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d69b39-ac26-430f-925b-5cac7cefb7a7 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:02.075169 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1191/2381] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:41:02 2021] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:41:02.079162 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c2959-2a87-4209-a524-f9e679038919 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:02.089546 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c2959-2a87-4209-a524-f9e679038919 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:02.145719 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e644c43-e3ff-4017-9f02-c57c900974ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:02.146416 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e644c43-e3ff-4017-9f02-c57c900974ed admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:02.146671 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e644c43-e3ff-4017-9f02-c57c900974ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:02.146966 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e644c43-e3ff-4017-9f02-c57c900974ed admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:02.147684 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e644c43-e3ff-4017-9f02-c57c900974ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:02.149578 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e644c43-e3ff-4017-9f02-c57c900974ed admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:02.170467 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1191/2382] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:41:02 2021] POST /identity/v3/users => generated 308 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:41:02.174456 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d69b39-ac26-430f-925b-5cac7cefb7a7 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:02.185280 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d69b39-ac26-430f-925b-5cac7cefb7a7 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:02.190015 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c8cdf-1176-484c-8c5c-a1f37d58b331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:02.190731 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c8cdf-1176-484c-8c5c-a1f37d58b331 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:02.191012 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c8cdf-1176-484c-8c5c-a1f37d58b331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:02.191307 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c8cdf-1176-484c-8c5c-a1f37d58b331 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:02.192027 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c8cdf-1176-484c-8c5c-a1f37d58b331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:02.193643 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c8cdf-1176-484c-8c5c-a1f37d58b331 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:02.204251 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1192/2383] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:41:02 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:41:02.208692 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e644c43-e3ff-4017-9f02-c57c900974ed admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:02.218591 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e644c43-e3ff-4017-9f02-c57c900974ed admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:02.224104 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23cec2-ba60-42d7-8c7b-463a1312663d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:02.224625 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23cec2-ba60-42d7-8c7b-463a1312663d admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:02.224903 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23cec2-ba60-42d7-8c7b-463a1312663d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:02.225154 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23cec2-ba60-42d7-8c7b-463a1312663d admin admin] PATH_INFO: `/v3/projects/f7c2fe8b8ffa44e1a8a7adf3c66ce14a/users/3f1f690e9b40486f8bd684f0dbabc148/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:02.240060 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23cec2-ba60-42d7-8c7b-463a1312663d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7c2fe8b8ffa44e1a8a7adf3c66ce14a, user_id=3f1f690e9b40486f8bd684f0dbabc148, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:02.243148 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23cec2-ba60-42d7-8c7b-463a1312663d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:02.256959 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1192/2384] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:41:02 2021] PUT /identity/v3/projects/f7c2fe8b8ffa44e1a8a7adf3c66ce14a/users/3f1f690e9b40486f8bd684f0dbabc148/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:41:02.260904 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c8cdf-1176-484c-8c5c-a1f37d58b331 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:02.271932 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c8cdf-1176-484c-8c5c-a1f37d58b331 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:02.333973 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2e547-9ad3-4990-adb6-fa839d23987f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:02.334816 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2e547-9ad3-4990-adb6-fa839d23987f admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:02.335494 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2e547-9ad3-4990-adb6-fa839d23987f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:02.335494 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2e547-9ad3-4990-adb6-fa839d23987f admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:02.336419 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2e547-9ad3-4990-adb6-fa839d23987f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:02.338174 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2e547-9ad3-4990-adb6-fa839d23987f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:02.352517 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1193/2385] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:41:02 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:41:02.353778 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23cec2-ba60-42d7-8c7b-463a1312663d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:02.364863 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23cec2-ba60-42d7-8c7b-463a1312663d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:02.372131 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cedbf-9148-4074-bab9-c7116d3bff19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:02.373092 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cedbf-9148-4074-bab9-c7116d3bff19 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:02.373441 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cedbf-9148-4074-bab9-c7116d3bff19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:02.373715 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cedbf-9148-4074-bab9-c7116d3bff19 admin admin] PATH_INFO: `/v3/projects/f7c2fe8b8ffa44e1a8a7adf3c66ce14a/users/3f1f690e9b40486f8bd684f0dbabc148/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:02.375939 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46cedbf-9148-4074-bab9-c7116d3bff19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7c2fe8b8ffa44e1a8a7adf3c66ce14a, user_id=3f1f690e9b40486f8bd684f0dbabc148, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:02.378972 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46cedbf-9148-4074-bab9-c7116d3bff19 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:02.389523 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1193/2386] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:41:02 2021] PUT /identity/v3/projects/f7c2fe8b8ffa44e1a8a7adf3c66ce14a/users/3f1f690e9b40486f8bd684f0dbabc148/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:41:03.043900 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c38494-3bd0-43d7-a716-b895527ea5cb None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:03.044942 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c38494-3bd0-43d7-a716-b895527ea5cb None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:03.045438 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c38494-3bd0-43d7-a716-b895527ea5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:03.083969 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-41c38494-3bd0-43d7-a716-b895527ea5cb None None] MFA Rules not processed for user `3f1f690e9b40486f8bd684f0dbabc148`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:41:03.085966 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-41c38494-3bd0-43d7-a716-b895527ea5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:41:03.189234 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1194/2387] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:41:03 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:41:04.547089 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cedbf-9148-4074-bab9-c7116d3bff19 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:04.607770 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cedbf-9148-4074-bab9-c7116d3bff19 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:04.613090 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62b351-6d24-4210-a9d5-342147c7473a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:04.614017 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62b351-6d24-4210-a9d5-342147c7473a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:04.614362 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62b351-6d24-4210-a9d5-342147c7473a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:04.614564 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62b351-6d24-4210-a9d5-342147c7473a admin admin] PATH_INFO: `/v3/users/2c07c30915d545288c036305f8a98db8` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:04.615770 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62b351-6d24-4210-a9d5-342147c7473a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c07c30915d545288c036305f8a98db8)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:04.617675 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62b351-6d24-4210-a9d5-342147c7473a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:04.670630 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-2b62b351-6d24-4210-a9d5-342147c7473a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c07c30915d545288c036305f8a98db8'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:04.678986 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-2b62b351-6d24-4210-a9d5-342147c7473a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c07c30915d545288c036305f8a98db8'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:04.679582 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-2b62b351-6d24-4210-a9d5-342147c7473a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c07c30915d545288c036305f8a98db8'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:04.693421 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-2b62b351-6d24-4210-a9d5-342147c7473a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c07c30915d545288c036305f8a98db8'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:04.700563 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-2b62b351-6d24-4210-a9d5-342147c7473a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c07c30915d545288c036305f8a98db8'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:04.706769 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1194/2388] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:41:04 2021] DELETE /identity/v3/users/2c07c30915d545288c036305f8a98db8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:41:04.924463 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c38494-3bd0-43d7-a716-b895527ea5cb None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:04.942735 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c38494-3bd0-43d7-a716-b895527ea5cb None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:05.009312 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f9ded-a101-4726-9137-1cd775bde518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:05.010201 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f9ded-a101-4726-9137-1cd775bde518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:05.010598 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f9ded-a101-4726-9137-1cd775bde518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:05.010934 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f9ded-a101-4726-9137-1cd775bde518 admin admin] PATH_INFO: `/v3/projects/edda4624f5724d91b68c8ca7e328397b` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:05.012148 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f9ded-a101-4726-9137-1cd775bde518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edda4624f5724d91b68c8ca7e328397b)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:05.014126 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f9ded-a101-4726-9137-1cd775bde518 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:05.061200 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-4e5f9ded-a101-4726-9137-1cd775bde518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edda4624f5724d91b68c8ca7e328397b', 'request_id': 'req-4e5f9ded-a101-4726-9137-1cd775bde518'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:05.067478 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-4e5f9ded-a101-4726-9137-1cd775bde518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edda4624f5724d91b68c8ca7e328397b', 'request_id': 'req-4e5f9ded-a101-4726-9137-1cd775bde518'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:05.075800 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-4e5f9ded-a101-4726-9137-1cd775bde518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edda4624f5724d91b68c8ca7e328397b', 'request_id': 'req-4e5f9ded-a101-4726-9137-1cd775bde518'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:05.087516 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-4e5f9ded-a101-4726-9137-1cd775bde518 admin admin] The token cache is being invalidate because project edda4624f5724d91b68c8ca7e328397b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:41:05.087801 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-4e5f9ded-a101-4726-9137-1cd775bde518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:05.088459 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-4e5f9ded-a101-4726-9137-1cd775bde518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:05.090022 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1195/2389] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:41:04 2021] DELETE /identity/v3/projects/edda4624f5724d91b68c8ca7e328397b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:41:05.095975 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62b351-6d24-4210-a9d5-342147c7473a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:05.097926 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-2b62b351-6d24-4210-a9d5-342147c7473a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:41:05.117283 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62b351-6d24-4210-a9d5-342147c7473a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:05.174231 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcacab-d973-4739-87c5-d9e08661d9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:05.175289 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcacab-d973-4739-87c5-d9e08661d9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:05.175479 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcacab-d973-4739-87c5-d9e08661d9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:05.175748 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcacab-d973-4739-87c5-d9e08661d9aa admin admin] PATH_INFO: `/v3/users/3f1f690e9b40486f8bd684f0dbabc148` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:05.177019 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fcacab-d973-4739-87c5-d9e08661d9aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f1f690e9b40486f8bd684f0dbabc148)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:05.178968 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fcacab-d973-4739-87c5-d9e08661d9aa admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:05.240615 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c8fcacab-d973-4739-87c5-d9e08661d9aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f1f690e9b40486f8bd684f0dbabc148'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:05.249055 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c8fcacab-d973-4739-87c5-d9e08661d9aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f1f690e9b40486f8bd684f0dbabc148'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:05.249671 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c8fcacab-d973-4739-87c5-d9e08661d9aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f1f690e9b40486f8bd684f0dbabc148'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:05.261296 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c8fcacab-d973-4739-87c5-d9e08661d9aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f1f690e9b40486f8bd684f0dbabc148'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:05.268481 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c8fcacab-d973-4739-87c5-d9e08661d9aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f1f690e9b40486f8bd684f0dbabc148'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:05.274610 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1195/2390] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:41:05 2021] DELETE /identity/v3/users/3f1f690e9b40486f8bd684f0dbabc148 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:41:05.456383 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f9ded-a101-4726-9137-1cd775bde518 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:05.458048 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-4e5f9ded-a101-4726-9137-1cd775bde518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:41:05.471893 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f9ded-a101-4726-9137-1cd775bde518 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:05.528424 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bddd8-c7d4-44d4-9044-309bbcce00d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:05.529257 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bddd8-c7d4-44d4-9044-309bbcce00d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:05.529532 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bddd8-c7d4-44d4-9044-309bbcce00d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:05.529794 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bddd8-c7d4-44d4-9044-309bbcce00d6 admin admin] PATH_INFO: `/v3/projects/f7c2fe8b8ffa44e1a8a7adf3c66ce14a` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:05.531067 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bddd8-c7d4-44d4-9044-309bbcce00d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7c2fe8b8ffa44e1a8a7adf3c66ce14a)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:05.532975 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bddd8-c7d4-44d4-9044-309bbcce00d6 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:05.582810 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-bd6bddd8-c7d4-44d4-9044-309bbcce00d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7c2fe8b8ffa44e1a8a7adf3c66ce14a', 'request_id': 'req-bd6bddd8-c7d4-44d4-9044-309bbcce00d6'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:05.589229 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-bd6bddd8-c7d4-44d4-9044-309bbcce00d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7c2fe8b8ffa44e1a8a7adf3c66ce14a', 'request_id': 'req-bd6bddd8-c7d4-44d4-9044-309bbcce00d6'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:05.597277 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-bd6bddd8-c7d4-44d4-9044-309bbcce00d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7c2fe8b8ffa44e1a8a7adf3c66ce14a', 'request_id': 'req-bd6bddd8-c7d4-44d4-9044-309bbcce00d6'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:05.607735 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-bd6bddd8-c7d4-44d4-9044-309bbcce00d6 admin admin] The token cache is being invalidate because project f7c2fe8b8ffa44e1a8a7adf3c66ce14a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:41:05.608020 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-bd6bddd8-c7d4-44d4-9044-309bbcce00d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:05.608646 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-bd6bddd8-c7d4-44d4-9044-309bbcce00d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:05.610216 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1196/2391] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:41:05 2021] DELETE /identity/v3/projects/f7c2fe8b8ffa44e1a8a7adf3c66ce14a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:41:05.616231 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2e269-0687-481c-a55d-90d64d23da27 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:05.616710 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2e269-0687-481c-a55d-90d64d23da27 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:05.616806 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2e269-0687-481c-a55d-90d64d23da27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:05.633796 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-7aa2e269-0687-481c-a55d-90d64d23da27 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:41:05.635010 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-7aa2e269-0687-481c-a55d-90d64d23da27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:41:05.697853 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1196/2392] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:41:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:41:05.705864 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9f995-feb3-4397-bba8-bf6bdbb63476 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:05.706154 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9f995-feb3-4397-bba8-bf6bdbb63476 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:05.706436 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9f995-feb3-4397-bba8-bf6bdbb63476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:05.725110 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-56b9f995-feb3-4397-bba8-bf6bdbb63476 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:41:05.726313 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-56b9f995-feb3-4397-bba8-bf6bdbb63476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:41:05.734830 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1197/2393] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:41:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:41:05.739220 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2e269-0687-481c-a55d-90d64d23da27 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:05.749833 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2e269-0687-481c-a55d-90d64d23da27 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:05.755289 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3a4d5-fc64-4d14-9045-eb0dceafe12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:05.755943 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3a4d5-fc64-4d14-9045-eb0dceafe12d admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:05.756220 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3a4d5-fc64-4d14-9045-eb0dceafe12d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:05.756517 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3a4d5-fc64-4d14-9045-eb0dceafe12d admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:05.757279 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3a4d5-fc64-4d14-9045-eb0dceafe12d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:41:05.757576 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3a4d5-fc64-4d14-9045-eb0dceafe12d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:05.759493 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3a4d5-fc64-4d14-9045-eb0dceafe12d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:05.772693 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1197/2394] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:41:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:41:05.777072 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9f995-feb3-4397-bba8-bf6bdbb63476 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:05.787962 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9f995-feb3-4397-bba8-bf6bdbb63476 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:05.795859 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990ab98-bf40-4cf8-882b-2ee773e073c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:05.796553 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990ab98-bf40-4cf8-882b-2ee773e073c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:05.797073 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990ab98-bf40-4cf8-882b-2ee773e073c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:05.797434 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990ab98-bf40-4cf8-882b-2ee773e073c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:05.798895 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990ab98-bf40-4cf8-882b-2ee773e073c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:05.801318 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990ab98-bf40-4cf8-882b-2ee773e073c0 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:05.833526 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1198/2395] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:41:05 2021] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:41:05.835391 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3a4d5-fc64-4d14-9045-eb0dceafe12d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:05.847318 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3a4d5-fc64-4d14-9045-eb0dceafe12d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:05.913344 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfce4a-a364-4444-a016-6bed2e899fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:05.913669 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfce4a-a364-4444-a016-6bed2e899fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:05.913942 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfce4a-a364-4444-a016-6bed2e899fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:05.914233 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfce4a-a364-4444-a016-6bed2e899fc8 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:05.914929 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfce4a-a364-4444-a016-6bed2e899fc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:05.917247 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfce4a-a364-4444-a016-6bed2e899fc8 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:05.938750 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1198/2396] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:41:05 2021] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:41:05.942963 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990ab98-bf40-4cf8-882b-2ee773e073c0 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:05.954105 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990ab98-bf40-4cf8-882b-2ee773e073c0 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:05.959000 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c18444-e658-41a3-a209-064736756980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:05.959678 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c18444-e658-41a3-a209-064736756980 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:05.959957 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c18444-e658-41a3-a209-064736756980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:05.960256 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c18444-e658-41a3-a209-064736756980 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:05.961039 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c18444-e658-41a3-a209-064736756980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:05.962869 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c18444-e658-41a3-a209-064736756980 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:05.974165 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1199/2397] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:41:05 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:41:05.978436 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfce4a-a364-4444-a016-6bed2e899fc8 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:05.988460 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfce4a-a364-4444-a016-6bed2e899fc8 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:05.993092 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24a8f9-192a-4259-ab75-b7c3a1d6fbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:05.993755 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24a8f9-192a-4259-ab75-b7c3a1d6fbc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:05.994017 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24a8f9-192a-4259-ab75-b7c3a1d6fbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:05.994284 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24a8f9-192a-4259-ab75-b7c3a1d6fbc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:05.995170 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24a8f9-192a-4259-ab75-b7c3a1d6fbc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:05.996770 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24a8f9-192a-4259-ab75-b7c3a1d6fbc1 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:06.006400 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1199/2398] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:41:05 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:41:06.010478 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c18444-e658-41a3-a209-064736756980 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:06.020730 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c18444-e658-41a3-a209-064736756980 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:06.026059 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78acec1-5e6f-46f1-b7ce-12419883baf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:06.026993 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78acec1-5e6f-46f1-b7ce-12419883baf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:06.027273 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78acec1-5e6f-46f1-b7ce-12419883baf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:06.027531 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78acec1-5e6f-46f1-b7ce-12419883baf3 admin admin] PATH_INFO: `/v3/projects/ce9c42b4505e4ddf993fe38d9d1b1afb/users/834e744ceed34284b918f83c997946ee/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:06.042807 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78acec1-5e6f-46f1-b7ce-12419883baf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce9c42b4505e4ddf993fe38d9d1b1afb, user_id=834e744ceed34284b918f83c997946ee, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:06.045496 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78acec1-5e6f-46f1-b7ce-12419883baf3 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:06.059884 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1200/2399] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:41:06 2021] PUT /identity/v3/projects/ce9c42b4505e4ddf993fe38d9d1b1afb/users/834e744ceed34284b918f83c997946ee/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:41:06.071428 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaeda5f-5991-4552-b3e8-48a87a3f25e3 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:06.071703 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaeda5f-5991-4552-b3e8-48a87a3f25e3 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:06.072178 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaeda5f-5991-4552-b3e8-48a87a3f25e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:06.099042 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-fdaeda5f-5991-4552-b3e8-48a87a3f25e3 None None] MFA Rules not processed for user `834e744ceed34284b918f83c997946ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:41:06.100293 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-fdaeda5f-5991-4552-b3e8-48a87a3f25e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:41:06.166271 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1200/2400] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:41:06 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:41:06.171160 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78acec1-5e6f-46f1-b7ce-12419883baf3 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:06.232907 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78acec1-5e6f-46f1-b7ce-12419883baf3 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:06.237863 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df8933-fdce-4ac5-b88b-01bc1e7b829c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:06.238524 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df8933-fdce-4ac5-b88b-01bc1e7b829c admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:06.238833 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df8933-fdce-4ac5-b88b-01bc1e7b829c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:06.239107 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df8933-fdce-4ac5-b88b-01bc1e7b829c admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:06.239826 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df8933-fdce-4ac5-b88b-01bc1e7b829c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:06.241725 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df8933-fdce-4ac5-b88b-01bc1e7b829c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:06.281310 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1201/2401] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:41:06 2021] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:41:06.285933 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaeda5f-5991-4552-b3e8-48a87a3f25e3 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:06.298119 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaeda5f-5991-4552-b3e8-48a87a3f25e3 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:06.356553 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6552218-3827-4077-958f-f38b7f2f22c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:06.357227 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6552218-3827-4077-958f-f38b7f2f22c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:06.357499 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6552218-3827-4077-958f-f38b7f2f22c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:06.357785 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6552218-3827-4077-958f-f38b7f2f22c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:06.358495 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6552218-3827-4077-958f-f38b7f2f22c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:06.360445 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6552218-3827-4077-958f-f38b7f2f22c4 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:06.385871 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1201/2402] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:41:06 2021] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:41:06.390308 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df8933-fdce-4ac5-b88b-01bc1e7b829c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:06.401444 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df8933-fdce-4ac5-b88b-01bc1e7b829c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:06.406758 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed71bed-8b31-4039-b0ec-80743f958384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:06.407432 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed71bed-8b31-4039-b0ec-80743f958384 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:06.407714 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed71bed-8b31-4039-b0ec-80743f958384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:06.407990 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed71bed-8b31-4039-b0ec-80743f958384 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:06.408744 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed71bed-8b31-4039-b0ec-80743f958384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:06.410351 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed71bed-8b31-4039-b0ec-80743f958384 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:06.421266 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1202/2403] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:41:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:41:06.426136 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6552218-3827-4077-958f-f38b7f2f22c4 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:06.441715 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6552218-3827-4077-958f-f38b7f2f22c4 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:06.450228 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d7c37-d77e-4bd0-ae7e-5cd3e562eb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:06.451533 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d7c37-d77e-4bd0-ae7e-5cd3e562eb85 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:06.451841 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d7c37-d77e-4bd0-ae7e-5cd3e562eb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:06.452192 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d7c37-d77e-4bd0-ae7e-5cd3e562eb85 admin admin] PATH_INFO: `/v3/projects/fb51480899634bc89e6be93b29f1f2e0/users/81cae53d3b7943c0bb37db3475235f28/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:06.468435 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d7c37-d77e-4bd0-ae7e-5cd3e562eb85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb51480899634bc89e6be93b29f1f2e0, user_id=81cae53d3b7943c0bb37db3475235f28, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:06.471118 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d7c37-d77e-4bd0-ae7e-5cd3e562eb85 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:06.488762 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1202/2404] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:41:06 2021] PUT /identity/v3/projects/fb51480899634bc89e6be93b29f1f2e0/users/81cae53d3b7943c0bb37db3475235f28/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:41:06.489589 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed71bed-8b31-4039-b0ec-80743f958384 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:06.499737 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed71bed-8b31-4039-b0ec-80743f958384 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:06.560175 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd3f20-96a2-47d6-843d-97e3e222f77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:06.560864 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd3f20-96a2-47d6-843d-97e3e222f77f admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:06.561146 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd3f20-96a2-47d6-843d-97e3e222f77f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:06.561440 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd3f20-96a2-47d6-843d-97e3e222f77f admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:06.562187 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd3f20-96a2-47d6-843d-97e3e222f77f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:06.563828 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd3f20-96a2-47d6-843d-97e3e222f77f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:06.577045 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1203/2405] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:41:06 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:41:06.578231 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d7c37-d77e-4bd0-ae7e-5cd3e562eb85 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:06.589174 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d7c37-d77e-4bd0-ae7e-5cd3e562eb85 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:06.597423 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf8ddd-7d8d-4b62-82a3-7c83cbfe7f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:06.598345 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf8ddd-7d8d-4b62-82a3-7c83cbfe7f7f admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:06.598599 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf8ddd-7d8d-4b62-82a3-7c83cbfe7f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:06.598889 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf8ddd-7d8d-4b62-82a3-7c83cbfe7f7f admin admin] PATH_INFO: `/v3/projects/fb51480899634bc89e6be93b29f1f2e0/users/81cae53d3b7943c0bb37db3475235f28/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:06.601033 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf8ddd-7d8d-4b62-82a3-7c83cbfe7f7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb51480899634bc89e6be93b29f1f2e0, user_id=81cae53d3b7943c0bb37db3475235f28, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:06.603764 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf8ddd-7d8d-4b62-82a3-7c83cbfe7f7f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:06.614808 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1203/2406] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:41:06 2021] PUT /identity/v3/projects/fb51480899634bc89e6be93b29f1f2e0/users/81cae53d3b7943c0bb37db3475235f28/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:41:06.624718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456b292-27e2-4d94-bc87-9cb90cb8ad30 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:06.625000 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456b292-27e2-4d94-bc87-9cb90cb8ad30 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:06.625300 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456b292-27e2-4d94-bc87-9cb90cb8ad30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:06.652564 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-9456b292-27e2-4d94-bc87-9cb90cb8ad30 None None] MFA Rules not processed for user `81cae53d3b7943c0bb37db3475235f28`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:41:06.653909 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-9456b292-27e2-4d94-bc87-9cb90cb8ad30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:41:06.722035 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1204/2407] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:41:06 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:41:06.733786 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf8ddd-7d8d-4b62-82a3-7c83cbfe7f7f admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:06.735788 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-cddf8ddd-7d8d-4b62-82a3-7c83cbfe7f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:41:06.799731 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf8ddd-7d8d-4b62-82a3-7c83cbfe7f7f admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:06.804308 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc696d-efc4-4c89-bd9f-3d5bd2c574d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:06.804981 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc696d-efc4-4c89-bd9f-3d5bd2c574d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:06.805342 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc696d-efc4-4c89-bd9f-3d5bd2c574d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:06.805593 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc696d-efc4-4c89-bd9f-3d5bd2c574d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:06.816588 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc696d-efc4-4c89-bd9f-3d5bd2c574d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:06.818075 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc696d-efc4-4c89-bd9f-3d5bd2c574d3 service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:06.828267 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1204/2408] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:41:06 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:41:06.912445 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456b292-27e2-4d94-bc87-9cb90cb8ad30 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:06.913851 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-9456b292-27e2-4d94-bc87-9cb90cb8ad30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:41:06.927676 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456b292-27e2-4d94-bc87-9cb90cb8ad30 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:06.931305 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91807f77-3599-4727-a8de-c868282b36d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:06.931985 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91807f77-3599-4727-a8de-c868282b36d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:06.932270 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91807f77-3599-4727-a8de-c868282b36d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:06.932549 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91807f77-3599-4727-a8de-c868282b36d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:06.989283 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91807f77-3599-4727-a8de-c868282b36d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:06.991013 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91807f77-3599-4727-a8de-c868282b36d3 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:07.000273 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1205/2409] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:41:06 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:41:47.626193 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc696d-efc4-4c89-bd9f-3d5bd2c574d3 service cinder] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:47.627672 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-41bc696d-efc4-4c89-bd9f-3d5bd2c574d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:41:47.703385 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc696d-efc4-4c89-bd9f-3d5bd2c574d3 service cinder] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:47.708210 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165b417-a8d8-48df-9db4-38f28285482e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:47.709090 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165b417-a8d8-48df-9db4-38f28285482e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:47.709367 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165b417-a8d8-48df-9db4-38f28285482e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:47.709637 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165b417-a8d8-48df-9db4-38f28285482e admin admin] PATH_INFO: `/v3/users/a7a35fbe2ba24ae6b64d4d856abd0596` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:47.710945 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165b417-a8d8-48df-9db4-38f28285482e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7a35fbe2ba24ae6b64d4d856abd0596)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:47.712856 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165b417-a8d8-48df-9db4-38f28285482e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:47.763124 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-b165b417-a8d8-48df-9db4-38f28285482e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7a35fbe2ba24ae6b64d4d856abd0596'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:47.772062 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-b165b417-a8d8-48df-9db4-38f28285482e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7a35fbe2ba24ae6b64d4d856abd0596'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:47.772699 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-b165b417-a8d8-48df-9db4-38f28285482e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7a35fbe2ba24ae6b64d4d856abd0596'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:47.785967 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-b165b417-a8d8-48df-9db4-38f28285482e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7a35fbe2ba24ae6b64d4d856abd0596'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:47.794154 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-b165b417-a8d8-48df-9db4-38f28285482e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7a35fbe2ba24ae6b64d4d856abd0596'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:47.804513 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1205/2410] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:41:47 2021] DELETE /identity/v3/users/a7a35fbe2ba24ae6b64d4d856abd0596 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:41:47.806204 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1ee5d-5a19-4896-baa4-7e125200061b None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:47.806752 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1ee5d-5a19-4896-baa4-7e125200061b None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:47.806908 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1ee5d-5a19-4896-baa4-7e125200061b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:47.824405 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-91e1ee5d-5a19-4896-baa4-7e125200061b None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:41:47.825604 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-91e1ee5d-5a19-4896-baa4-7e125200061b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:41:47.884573 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1206/2411] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:41:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:41:47.894488 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165b417-a8d8-48df-9db4-38f28285482e admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:47.896093 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-b165b417-a8d8-48df-9db4-38f28285482e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:41:47.953735 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165b417-a8d8-48df-9db4-38f28285482e admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:47.957673 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e38dc-b9af-4ee2-b249-0fc2a5be204a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:47.958547 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e38dc-b9af-4ee2-b249-0fc2a5be204a service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:47.958898 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e38dc-b9af-4ee2-b249-0fc2a5be204a service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:47.959178 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e38dc-b9af-4ee2-b249-0fc2a5be204a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:47.968849 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e38dc-b9af-4ee2-b249-0fc2a5be204a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:47.970365 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e38dc-b9af-4ee2-b249-0fc2a5be204a service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:47.980309 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1206/2412] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:41:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:41:48.255878 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1ee5d-5a19-4896-baa4-7e125200061b None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:48.257334 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-91e1ee5d-5a19-4896-baa4-7e125200061b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:41:48.269032 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1ee5d-5a19-4896-baa4-7e125200061b None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:48.274968 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354f157-0743-4d0f-97e1-a53bb123052a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:48.275908 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354f157-0743-4d0f-97e1-a53bb123052a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:48.276191 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354f157-0743-4d0f-97e1-a53bb123052a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:48.276521 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354f157-0743-4d0f-97e1-a53bb123052a admin admin] PATH_INFO: `/v3/projects/84311f9716e643ef896b3d37eb16f6a9` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:48.277669 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354f157-0743-4d0f-97e1-a53bb123052a admin admin] RBAC: Authorizing `identity:delete_project(project_id=84311f9716e643ef896b3d37eb16f6a9)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:48.280815 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354f157-0743-4d0f-97e1-a53bb123052a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:48.332291 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-2354f157-0743-4d0f-97e1-a53bb123052a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84311f9716e643ef896b3d37eb16f6a9', 'request_id': 'req-2354f157-0743-4d0f-97e1-a53bb123052a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:48.338403 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-2354f157-0743-4d0f-97e1-a53bb123052a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84311f9716e643ef896b3d37eb16f6a9', 'request_id': 'req-2354f157-0743-4d0f-97e1-a53bb123052a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:48.346982 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-2354f157-0743-4d0f-97e1-a53bb123052a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84311f9716e643ef896b3d37eb16f6a9', 'request_id': 'req-2354f157-0743-4d0f-97e1-a53bb123052a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:48.356949 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-2354f157-0743-4d0f-97e1-a53bb123052a admin admin] The token cache is being invalidate because project 84311f9716e643ef896b3d37eb16f6a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:41:48.357215 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-2354f157-0743-4d0f-97e1-a53bb123052a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:48.357824 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-2354f157-0743-4d0f-97e1-a53bb123052a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:48.359382 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1207/2413] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:41:48 2021] DELETE /identity/v3/projects/84311f9716e643ef896b3d37eb16f6a9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:41:58.904282 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e38dc-b9af-4ee2-b249-0fc2a5be204a service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:58.905862 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-7c1e38dc-b9af-4ee2-b249-0fc2a5be204a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:41:58.920383 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e38dc-b9af-4ee2-b249-0fc2a5be204a service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:58.985445 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e17a4-a8ba-4c66-853f-673bb3f0c031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:58.987040 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e17a4-a8ba-4c66-853f-673bb3f0c031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:58.987522 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e17a4-a8ba-4c66-853f-673bb3f0c031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:58.987979 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e17a4-a8ba-4c66-853f-673bb3f0c031 admin admin] PATH_INFO: `/v3/users/834e744ceed34284b918f83c997946ee` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:58.990122 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e17a4-a8ba-4c66-853f-673bb3f0c031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=834e744ceed34284b918f83c997946ee)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:58.993220 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e17a4-a8ba-4c66-853f-673bb3f0c031 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:59.047129 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-933e17a4-a8ba-4c66-853f-673bb3f0c031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '834e744ceed34284b918f83c997946ee'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:59.056381 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-933e17a4-a8ba-4c66-853f-673bb3f0c031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '834e744ceed34284b918f83c997946ee'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:59.057205 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-933e17a4-a8ba-4c66-853f-673bb3f0c031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '834e744ceed34284b918f83c997946ee'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:59.069509 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-933e17a4-a8ba-4c66-853f-673bb3f0c031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '834e744ceed34284b918f83c997946ee'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:59.076879 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-933e17a4-a8ba-4c66-853f-673bb3f0c031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '834e744ceed34284b918f83c997946ee'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:59.082728 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1207/2414] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:41:58 2021] DELETE /identity/v3/users/834e744ceed34284b918f83c997946ee => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:41:59.087564 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34efef9-4255-4177-a6c4-bc39ba719b19 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:59.088085 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34efef9-4255-4177-a6c4-bc39ba719b19 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:59.088085 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34efef9-4255-4177-a6c4-bc39ba719b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:59.106567 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-a34efef9-4255-4177-a6c4-bc39ba719b19 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:41:59.107796 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-a34efef9-4255-4177-a6c4-bc39ba719b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:41:59.172419 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1208/2415] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:41:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:41:59.183213 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e17a4-a8ba-4c66-853f-673bb3f0c031 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:59.185640 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-933e17a4-a8ba-4c66-853f-673bb3f0c031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:41:59.249247 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e17a4-a8ba-4c66-853f-673bb3f0c031 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:59.253743 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65a548-4802-4b8c-aec8-bb5b4fff8c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:59.254414 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65a548-4802-4b8c-aec8-bb5b4fff8c2f service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:59.254710 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65a548-4802-4b8c-aec8-bb5b4fff8c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:59.255002 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65a548-4802-4b8c-aec8-bb5b4fff8c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:59.264439 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65a548-4802-4b8c-aec8-bb5b4fff8c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:59.265859 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65a548-4802-4b8c-aec8-bb5b4fff8c2f service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:59.275216 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1208/2416] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:41:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:41:59.543653 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34efef9-4255-4177-a6c4-bc39ba719b19 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:59.545335 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-a34efef9-4255-4177-a6c4-bc39ba719b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:41:59.557954 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34efef9-4255-4177-a6c4-bc39ba719b19 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:59.564167 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7eb43-5883-4c2c-8ef8-b5bbabea7ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:59.564737 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7eb43-5883-4c2c-8ef8-b5bbabea7ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:59.565056 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7eb43-5883-4c2c-8ef8-b5bbabea7ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:59.565333 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7eb43-5883-4c2c-8ef8-b5bbabea7ce6 admin admin] PATH_INFO: `/v3/projects/ce9c42b4505e4ddf993fe38d9d1b1afb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:59.566762 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7eb43-5883-4c2c-8ef8-b5bbabea7ce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce9c42b4505e4ddf993fe38d9d1b1afb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:59.568585 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7eb43-5883-4c2c-8ef8-b5bbabea7ce6 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:59.616564 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-58c7eb43-5883-4c2c-8ef8-b5bbabea7ce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce9c42b4505e4ddf993fe38d9d1b1afb', 'request_id': 'req-58c7eb43-5883-4c2c-8ef8-b5bbabea7ce6'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:59.622870 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-58c7eb43-5883-4c2c-8ef8-b5bbabea7ce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce9c42b4505e4ddf993fe38d9d1b1afb', 'request_id': 'req-58c7eb43-5883-4c2c-8ef8-b5bbabea7ce6'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:59.632018 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-58c7eb43-5883-4c2c-8ef8-b5bbabea7ce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce9c42b4505e4ddf993fe38d9d1b1afb', 'request_id': 'req-58c7eb43-5883-4c2c-8ef8-b5bbabea7ce6'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:59.643998 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-58c7eb43-5883-4c2c-8ef8-b5bbabea7ce6 admin admin] The token cache is being invalidate because project ce9c42b4505e4ddf993fe38d9d1b1afb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:41:59.644287 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-58c7eb43-5883-4c2c-8ef8-b5bbabea7ce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:59.644932 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-58c7eb43-5883-4c2c-8ef8-b5bbabea7ce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:59.646542 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1209/2417] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:41:59 2021] DELETE /identity/v3/projects/ce9c42b4505e4ddf993fe38d9d1b1afb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:41:59.651251 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65a548-4802-4b8c-aec8-bb5b4fff8c2f service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:41:59.661882 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65a548-4802-4b8c-aec8-bb5b4fff8c2f service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:41:59.722623 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9344880-48c3-40a2-8f2a-577a921a376c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:41:59.723677 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9344880-48c3-40a2-8f2a-577a921a376c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:41:59.724280 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9344880-48c3-40a2-8f2a-577a921a376c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:41:59.724652 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9344880-48c3-40a2-8f2a-577a921a376c admin admin] PATH_INFO: `/v3/users/81cae53d3b7943c0bb37db3475235f28` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:41:59.726032 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9344880-48c3-40a2-8f2a-577a921a376c admin admin] RBAC: Authorizing `identity:delete_user(user_id=81cae53d3b7943c0bb37db3475235f28)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:41:59.728031 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9344880-48c3-40a2-8f2a-577a921a376c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:41:59.781061 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-f9344880-48c3-40a2-8f2a-577a921a376c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81cae53d3b7943c0bb37db3475235f28'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:59.790108 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-f9344880-48c3-40a2-8f2a-577a921a376c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81cae53d3b7943c0bb37db3475235f28'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:59.791207 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-f9344880-48c3-40a2-8f2a-577a921a376c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81cae53d3b7943c0bb37db3475235f28'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:59.803089 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-f9344880-48c3-40a2-8f2a-577a921a376c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81cae53d3b7943c0bb37db3475235f28'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:59.809880 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-f9344880-48c3-40a2-8f2a-577a921a376c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81cae53d3b7943c0bb37db3475235f28'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:41:59.816308 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1209/2418] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:41:59 2021] DELETE /identity/v3/users/81cae53d3b7943c0bb37db3475235f28 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:42:00.106493 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7eb43-5883-4c2c-8ef8-b5bbabea7ce6 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:00.108188 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-58c7eb43-5883-4c2c-8ef8-b5bbabea7ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:00.122380 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7eb43-5883-4c2c-8ef8-b5bbabea7ce6 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:00.182633 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7d2ee-c95b-4389-ba08-f8dc23238f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:00.183475 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7d2ee-c95b-4389-ba08-f8dc23238f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:00.183756 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7d2ee-c95b-4389-ba08-f8dc23238f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:00.184044 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7d2ee-c95b-4389-ba08-f8dc23238f69 admin admin] PATH_INFO: `/v3/projects/fb51480899634bc89e6be93b29f1f2e0` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:00.185336 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7d2ee-c95b-4389-ba08-f8dc23238f69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb51480899634bc89e6be93b29f1f2e0)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:00.187326 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7d2ee-c95b-4389-ba08-f8dc23238f69 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:00.244891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1cb7d2ee-c95b-4389-ba08-f8dc23238f69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb51480899634bc89e6be93b29f1f2e0', 'request_id': 'req-1cb7d2ee-c95b-4389-ba08-f8dc23238f69'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:00.251069 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1cb7d2ee-c95b-4389-ba08-f8dc23238f69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb51480899634bc89e6be93b29f1f2e0', 'request_id': 'req-1cb7d2ee-c95b-4389-ba08-f8dc23238f69'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:00.260721 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1cb7d2ee-c95b-4389-ba08-f8dc23238f69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb51480899634bc89e6be93b29f1f2e0', 'request_id': 'req-1cb7d2ee-c95b-4389-ba08-f8dc23238f69'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:00.271595 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1cb7d2ee-c95b-4389-ba08-f8dc23238f69 admin admin] The token cache is being invalidate because project fb51480899634bc89e6be93b29f1f2e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:42:00.271889 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1cb7d2ee-c95b-4389-ba08-f8dc23238f69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:00.272569 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1cb7d2ee-c95b-4389-ba08-f8dc23238f69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:00.274200 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1210/2419] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:42:00 2021] DELETE /identity/v3/projects/fb51480899634bc89e6be93b29f1f2e0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:42:00.280579 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e3167-aa4c-4b93-942e-13993048f6ca None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:00.281079 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e3167-aa4c-4b93-942e-13993048f6ca None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:00.281186 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e3167-aa4c-4b93-942e-13993048f6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:00.299617 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-b81e3167-aa4c-4b93-942e-13993048f6ca None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:42:00.300852 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-b81e3167-aa4c-4b93-942e-13993048f6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:00.363025 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1210/2420] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:42:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:42:00.372508 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d12868-5395-49f6-994a-32aa14e580b8 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:00.372896 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d12868-5395-49f6-994a-32aa14e580b8 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:00.373326 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d12868-5395-49f6-994a-32aa14e580b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:00.403380 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-d8d12868-5395-49f6-994a-32aa14e580b8 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:42:00.404591 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-d8d12868-5395-49f6-994a-32aa14e580b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:00.413784 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1211/2421] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:42:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:42:00.420483 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e3167-aa4c-4b93-942e-13993048f6ca None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:00.434474 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e3167-aa4c-4b93-942e-13993048f6ca None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:00.439396 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bb814-f19e-414a-9235-da2d8dbe847a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:00.440051 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bb814-f19e-414a-9235-da2d8dbe847a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:00.440330 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bb814-f19e-414a-9235-da2d8dbe847a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:00.440610 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bb814-f19e-414a-9235-da2d8dbe847a admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:00.441348 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209bb814-f19e-414a-9235-da2d8dbe847a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:42:00.441655 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209bb814-f19e-414a-9235-da2d8dbe847a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:00.443284 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209bb814-f19e-414a-9235-da2d8dbe847a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:00.454792 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1211/2422] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:42:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:42:00.459091 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d12868-5395-49f6-994a-32aa14e580b8 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:00.468726 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d12868-5395-49f6-994a-32aa14e580b8 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:00.474467 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48cc35-1476-44a0-92f9-3a2eac1843e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:00.475150 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48cc35-1476-44a0-92f9-3a2eac1843e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:00.475428 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48cc35-1476-44a0-92f9-3a2eac1843e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:00.475699 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48cc35-1476-44a0-92f9-3a2eac1843e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:00.476434 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48cc35-1476-44a0-92f9-3a2eac1843e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:00.478316 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48cc35-1476-44a0-92f9-3a2eac1843e8 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:00.506321 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1212/2423] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:42:00 2021] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:42:00.510579 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bb814-f19e-414a-9235-da2d8dbe847a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:00.520695 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bb814-f19e-414a-9235-da2d8dbe847a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:00.588658 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9c79a-3b46-4351-820c-cecbe7e79365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:00.589313 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9c79a-3b46-4351-820c-cecbe7e79365 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:00.589629 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9c79a-3b46-4351-820c-cecbe7e79365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:00.589890 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9c79a-3b46-4351-820c-cecbe7e79365 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:00.590601 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9c79a-3b46-4351-820c-cecbe7e79365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:00.592539 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9c79a-3b46-4351-820c-cecbe7e79365 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:00.618015 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1212/2424] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:42:00 2021] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:42:00.622443 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48cc35-1476-44a0-92f9-3a2eac1843e8 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:00.633233 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48cc35-1476-44a0-92f9-3a2eac1843e8 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:00.639129 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb4aec-962f-49b5-97a5-32d86e4a5dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:00.639814 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb4aec-962f-49b5-97a5-32d86e4a5dae admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:00.640088 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb4aec-962f-49b5-97a5-32d86e4a5dae admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:00.640354 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb4aec-962f-49b5-97a5-32d86e4a5dae admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:00.641086 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb4aec-962f-49b5-97a5-32d86e4a5dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:00.642727 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb4aec-962f-49b5-97a5-32d86e4a5dae admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:00.653844 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1213/2425] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:42:00 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:42:00.657896 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9c79a-3b46-4351-820c-cecbe7e79365 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:00.668517 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9c79a-3b46-4351-820c-cecbe7e79365 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:00.673452 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0bc54-0d52-4eec-b7d2-be9b45457d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:00.674104 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0bc54-0d52-4eec-b7d2-be9b45457d0e admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:00.674384 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0bc54-0d52-4eec-b7d2-be9b45457d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:00.674635 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0bc54-0d52-4eec-b7d2-be9b45457d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:00.675404 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0bc54-0d52-4eec-b7d2-be9b45457d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:00.676981 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0bc54-0d52-4eec-b7d2-be9b45457d0e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:00.687004 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1213/2426] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:42:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:42:00.691077 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb4aec-962f-49b5-97a5-32d86e4a5dae admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:00.701466 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb4aec-962f-49b5-97a5-32d86e4a5dae admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:00.707614 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afb008-873f-4341-88e5-aacea321373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:00.708500 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afb008-873f-4341-88e5-aacea321373d admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:00.708778 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afb008-873f-4341-88e5-aacea321373d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:00.709056 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afb008-873f-4341-88e5-aacea321373d admin admin] PATH_INFO: `/v3/projects/24b2ae6fb276462f98bf7fb2c0b4b749/users/bf5b84b958bd41878268d0b13b9cc146/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:00.724999 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afb008-873f-4341-88e5-aacea321373d admin admin] RBAC: Authorizing `identity:create_grant(project_id=24b2ae6fb276462f98bf7fb2c0b4b749, user_id=bf5b84b958bd41878268d0b13b9cc146, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:00.727666 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afb008-873f-4341-88e5-aacea321373d admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:00.745304 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1214/2427] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:42:00 2021] PUT /identity/v3/projects/24b2ae6fb276462f98bf7fb2c0b4b749/users/bf5b84b958bd41878268d0b13b9cc146/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:42:00.755459 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0d797-8117-4f2c-a4ce-501ace79db4e None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:00.755751 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0d797-8117-4f2c-a4ce-501ace79db4e None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:00.756051 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0d797-8117-4f2c-a4ce-501ace79db4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:00.782604 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-cec0d797-8117-4f2c-a4ce-501ace79db4e None None] MFA Rules not processed for user `bf5b84b958bd41878268d0b13b9cc146`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:42:00.783924 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-cec0d797-8117-4f2c-a4ce-501ace79db4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:00.848445 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1214/2428] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:42:00 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:42:00.853257 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afb008-873f-4341-88e5-aacea321373d admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:00.919736 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afb008-873f-4341-88e5-aacea321373d admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:00.927527 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392265ff-fde3-45d7-aed9-7a9e9155a487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:00.928384 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392265ff-fde3-45d7-aed9-7a9e9155a487 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:00.928662 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392265ff-fde3-45d7-aed9-7a9e9155a487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:00.928985 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392265ff-fde3-45d7-aed9-7a9e9155a487 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:00.929708 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392265ff-fde3-45d7-aed9-7a9e9155a487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:00.931749 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392265ff-fde3-45d7-aed9-7a9e9155a487 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:00.958586 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1215/2429] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:42:00 2021] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:42:00.963033 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0d797-8117-4f2c-a4ce-501ace79db4e None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:00.974151 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0d797-8117-4f2c-a4ce-501ace79db4e None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:01.031988 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e0c71-9727-4ed1-9ae7-a918d798a4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:01.032663 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e0c71-9727-4ed1-9ae7-a918d798a4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:01.032942 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e0c71-9727-4ed1-9ae7-a918d798a4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:01.033215 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e0c71-9727-4ed1-9ae7-a918d798a4c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:01.033916 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e0c71-9727-4ed1-9ae7-a918d798a4c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:01.035902 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e0c71-9727-4ed1-9ae7-a918d798a4c1 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:01.057763 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1215/2430] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:42:00 2021] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:42:01.061926 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392265ff-fde3-45d7-aed9-7a9e9155a487 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:01.072377 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392265ff-fde3-45d7-aed9-7a9e9155a487 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:01.077428 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09819080-47a5-4986-b6ac-2a63622146b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:01.078082 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09819080-47a5-4986-b6ac-2a63622146b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:01.078357 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09819080-47a5-4986-b6ac-2a63622146b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:01.078629 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09819080-47a5-4986-b6ac-2a63622146b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:01.079400 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09819080-47a5-4986-b6ac-2a63622146b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:01.080994 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09819080-47a5-4986-b6ac-2a63622146b8 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:01.093151 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1216/2431] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:42:01 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:42:01.097387 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e0c71-9727-4ed1-9ae7-a918d798a4c1 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:01.107863 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e0c71-9727-4ed1-9ae7-a918d798a4c1 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:01.113244 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1423bd-832e-4479-b239-b29ea570a5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:01.114126 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1423bd-832e-4479-b239-b29ea570a5f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:01.114403 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1423bd-832e-4479-b239-b29ea570a5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:01.114698 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1423bd-832e-4479-b239-b29ea570a5f4 admin admin] PATH_INFO: `/v3/projects/4ac47bcd904d402581c491afdf13eae0/users/f6de96f874df4bfaa87454b0c5268e3a/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:01.130805 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1423bd-832e-4479-b239-b29ea570a5f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac47bcd904d402581c491afdf13eae0, user_id=f6de96f874df4bfaa87454b0c5268e3a, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:01.133842 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1423bd-832e-4479-b239-b29ea570a5f4 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:01.149681 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1216/2432] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:42:01 2021] PUT /identity/v3/projects/4ac47bcd904d402581c491afdf13eae0/users/f6de96f874df4bfaa87454b0c5268e3a/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:42:01.153935 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09819080-47a5-4986-b6ac-2a63622146b8 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:01.168549 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09819080-47a5-4986-b6ac-2a63622146b8 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:01.230149 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5c309-be6c-4a55-8297-e09f503004d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:01.230948 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5c309-be6c-4a55-8297-e09f503004d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:01.231226 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5c309-be6c-4a55-8297-e09f503004d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:01.231498 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5c309-be6c-4a55-8297-e09f503004d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:01.232240 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5c309-be6c-4a55-8297-e09f503004d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:01.233861 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5c309-be6c-4a55-8297-e09f503004d1 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:01.244023 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1217/2433] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:42:01 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:42:01.248341 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1423bd-832e-4479-b239-b29ea570a5f4 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:01.258944 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1423bd-832e-4479-b239-b29ea570a5f4 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:01.264912 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd2117-0e4c-46ef-8444-6346fe6cd8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:01.265801 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd2117-0e4c-46ef-8444-6346fe6cd8c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:01.266079 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd2117-0e4c-46ef-8444-6346fe6cd8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:01.266349 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd2117-0e4c-46ef-8444-6346fe6cd8c5 admin admin] PATH_INFO: `/v3/projects/4ac47bcd904d402581c491afdf13eae0/users/f6de96f874df4bfaa87454b0c5268e3a/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:01.268668 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd2117-0e4c-46ef-8444-6346fe6cd8c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac47bcd904d402581c491afdf13eae0, user_id=f6de96f874df4bfaa87454b0c5268e3a, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:01.271408 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd2117-0e4c-46ef-8444-6346fe6cd8c5 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:01.282712 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1217/2434] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:42:01 2021] PUT /identity/v3/projects/4ac47bcd904d402581c491afdf13eae0/users/f6de96f874df4bfaa87454b0c5268e3a/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:42:01.295422 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0a7ee-1e0c-49aa-bc44-70089bb46bb0 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:01.295697 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0a7ee-1e0c-49aa-bc44-70089bb46bb0 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:01.296051 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0a7ee-1e0c-49aa-bc44-70089bb46bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:01.332354 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-5ca0a7ee-1e0c-49aa-bc44-70089bb46bb0 None None] MFA Rules not processed for user `f6de96f874df4bfaa87454b0c5268e3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:42:01.333550 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-5ca0a7ee-1e0c-49aa-bc44-70089bb46bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:01.409292 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1218/2435] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:42:01 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:42:01.421233 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd2117-0e4c-46ef-8444-6346fe6cd8c5 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:01.423120 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-23fd2117-0e4c-46ef-8444-6346fe6cd8c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:01.480572 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd2117-0e4c-46ef-8444-6346fe6cd8c5 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:01.484513 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cb6a6-5b6c-48c0-b9ed-9d9048e46c25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:01.485146 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cb6a6-5b6c-48c0-b9ed-9d9048e46c25 service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:01.485417 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cb6a6-5b6c-48c0-b9ed-9d9048e46c25 service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:01.485688 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cb6a6-5b6c-48c0-b9ed-9d9048e46c25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:01.495753 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5cb6a6-5b6c-48c0-b9ed-9d9048e46c25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:01.497242 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5cb6a6-5b6c-48c0-b9ed-9d9048e46c25 service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:01.507051 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1218/2436] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:42:01 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:42:01.598888 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0a7ee-1e0c-49aa-bc44-70089bb46bb0 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:01.608984 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0a7ee-1e0c-49aa-bc44-70089bb46bb0 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:01.612703 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06346c3f-9812-439a-98bf-f6bd20388deb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:01.613476 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06346c3f-9812-439a-98bf-f6bd20388deb service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:01.613727 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06346c3f-9812-439a-98bf-f6bd20388deb service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:01.613993 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06346c3f-9812-439a-98bf-f6bd20388deb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:01.672255 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06346c3f-9812-439a-98bf-f6bd20388deb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:01.673757 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06346c3f-9812-439a-98bf-f6bd20388deb service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:01.684023 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1219/2437] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:42:01 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:42:01.841227 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cb6a6-5b6c-48c0-b9ed-9d9048e46c25 service cinder] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:01.843956 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-8c5cb6a6-5b6c-48c0-b9ed-9d9048e46c25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:01.856051 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cb6a6-5b6c-48c0-b9ed-9d9048e46c25 service cinder] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:01.859935 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe256714-70db-4515-a9ce-009a767b6266 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:01.860593 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe256714-70db-4515-a9ce-009a767b6266 service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:01.860874 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe256714-70db-4515-a9ce-009a767b6266 service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:01.861147 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe256714-70db-4515-a9ce-009a767b6266 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:01.862943 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-fe256714-70db-4515-a9ce-009a767b6266 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:01.949200 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe256714-70db-4515-a9ce-009a767b6266 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:01.951059 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe256714-70db-4515-a9ce-009a767b6266 service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:01.965402 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1219/2438] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:42:01 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:42:04.269843 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06346c3f-9812-439a-98bf-f6bd20388deb service cinder] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:04.336050 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06346c3f-9812-439a-98bf-f6bd20388deb service cinder] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:04.340981 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7815292-c168-445a-b815-063a62f8643d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:04.341854 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7815292-c168-445a-b815-063a62f8643d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:04.342137 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7815292-c168-445a-b815-063a62f8643d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:04.342411 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7815292-c168-445a-b815-063a62f8643d admin admin] PATH_INFO: `/v3/users/bf5b84b958bd41878268d0b13b9cc146` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:04.343700 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7815292-c168-445a-b815-063a62f8643d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf5b84b958bd41878268d0b13b9cc146)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:04.345633 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7815292-c168-445a-b815-063a62f8643d admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:04.393708 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d7815292-c168-445a-b815-063a62f8643d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf5b84b958bd41878268d0b13b9cc146'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:04.394452 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d7815292-c168-445a-b815-063a62f8643d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf5b84b958bd41878268d0b13b9cc146'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:04.402846 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d7815292-c168-445a-b815-063a62f8643d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf5b84b958bd41878268d0b13b9cc146'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:04.409715 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d7815292-c168-445a-b815-063a62f8643d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf5b84b958bd41878268d0b13b9cc146'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:04.422835 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d7815292-c168-445a-b815-063a62f8643d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf5b84b958bd41878268d0b13b9cc146'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:04.430933 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1220/2439] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:42:04 2021] DELETE /identity/v3/users/bf5b84b958bd41878268d0b13b9cc146 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:42:04.435533 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c0b3f-0632-4cea-82ab-1d514152e2a4 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:04.436044 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c0b3f-0632-4cea-82ab-1d514152e2a4 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:04.436373 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c0b3f-0632-4cea-82ab-1d514152e2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:04.454344 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-660c0b3f-0632-4cea-82ab-1d514152e2a4 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:42:04.455608 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-660c0b3f-0632-4cea-82ab-1d514152e2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:04.522509 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1220/2440] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:42:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:42:04.545503 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7815292-c168-445a-b815-063a62f8643d admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:04.547001 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-d7815292-c168-445a-b815-063a62f8643d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:04.611115 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7815292-c168-445a-b815-063a62f8643d admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:04.614762 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9357ad-9ec8-4033-8f50-d850f2cfd768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:04.615418 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9357ad-9ec8-4033-8f50-d850f2cfd768 service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:04.615701 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9357ad-9ec8-4033-8f50-d850f2cfd768 service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:04.615961 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9357ad-9ec8-4033-8f50-d850f2cfd768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:04.625562 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9357ad-9ec8-4033-8f50-d850f2cfd768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:04.627089 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9357ad-9ec8-4033-8f50-d850f2cfd768 service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:04.636849 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1221/2441] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:42:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:42:04.651805 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c0b3f-0632-4cea-82ab-1d514152e2a4 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:04.653660 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-660c0b3f-0632-4cea-82ab-1d514152e2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:04.666554 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c0b3f-0632-4cea-82ab-1d514152e2a4 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:04.670336 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851f092-d820-423a-a5a6-5d88dc8a119f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:04.671098 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851f092-d820-423a-a5a6-5d88dc8a119f service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:04.671439 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851f092-d820-423a-a5a6-5d88dc8a119f service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:04.671773 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851f092-d820-423a-a5a6-5d88dc8a119f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:04.673977 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-7851f092-d820-423a-a5a6-5d88dc8a119f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:04.751241 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851f092-d820-423a-a5a6-5d88dc8a119f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:04.753019 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851f092-d820-423a-a5a6-5d88dc8a119f service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:04.766337 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1221/2442] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:42:04 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:42:04.917009 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9357ad-9ec8-4033-8f50-d850f2cfd768 service neutron] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:04.918801 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-6f9357ad-9ec8-4033-8f50-d850f2cfd768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:04.934886 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9357ad-9ec8-4033-8f50-d850f2cfd768 service neutron] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:04.940479 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a5b72-8840-4076-a87b-c63c43ab2639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:04.941361 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a5b72-8840-4076-a87b-c63c43ab2639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:04.941639 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a5b72-8840-4076-a87b-c63c43ab2639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:04.941913 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a5b72-8840-4076-a87b-c63c43ab2639 admin admin] PATH_INFO: `/v3/projects/24b2ae6fb276462f98bf7fb2c0b4b749` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:04.943182 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a5b72-8840-4076-a87b-c63c43ab2639 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24b2ae6fb276462f98bf7fb2c0b4b749)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:04.946023 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a5b72-8840-4076-a87b-c63c43ab2639 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:04.978329 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851f092-d820-423a-a5a6-5d88dc8a119f service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:04.979834 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-7851f092-d820-423a-a5a6-5d88dc8a119f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:04.993199 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851f092-d820-423a-a5a6-5d88dc8a119f service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:04.998176 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1973e2a-14bd-4e09-a86a-e1da77fa918c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:04.999108 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1973e2a-14bd-4e09-a86a-e1da77fa918c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:04.999491 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1973e2a-14bd-4e09-a86a-e1da77fa918c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:04.999776 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1973e2a-14bd-4e09-a86a-e1da77fa918c admin admin] PATH_INFO: `/v3/users/6c878a666cea4ff2be87715c4dcfcbd5` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:05.000980 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1973e2a-14bd-4e09-a86a-e1da77fa918c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c878a666cea4ff2be87715c4dcfcbd5)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:05.002921 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1973e2a-14bd-4e09-a86a-e1da77fa918c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:05.010984 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e41a5b72-8840-4076-a87b-c63c43ab2639 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24b2ae6fb276462f98bf7fb2c0b4b749', 'request_id': 'req-e41a5b72-8840-4076-a87b-c63c43ab2639'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:05.017145 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e41a5b72-8840-4076-a87b-c63c43ab2639 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24b2ae6fb276462f98bf7fb2c0b4b749', 'request_id': 'req-e41a5b72-8840-4076-a87b-c63c43ab2639'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:05.026296 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e41a5b72-8840-4076-a87b-c63c43ab2639 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24b2ae6fb276462f98bf7fb2c0b4b749', 'request_id': 'req-e41a5b72-8840-4076-a87b-c63c43ab2639'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:05.038440 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e41a5b72-8840-4076-a87b-c63c43ab2639 admin admin] The token cache is being invalidate because project 24b2ae6fb276462f98bf7fb2c0b4b749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:42:05.038792 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e41a5b72-8840-4076-a87b-c63c43ab2639 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:05.039835 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e41a5b72-8840-4076-a87b-c63c43ab2639 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:05.041982 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1222/2443] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:42:04 2021] DELETE /identity/v3/projects/24b2ae6fb276462f98bf7fb2c0b4b749 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:42:05.046082 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a5b72-8840-4076-a87b-c63c43ab2639 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:05.047459 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e41a5b72-8840-4076-a87b-c63c43ab2639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:05.057333 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a1973e2a-14bd-4e09-a86a-e1da77fa918c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c878a666cea4ff2be87715c4dcfcbd5'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:05.065822 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a1973e2a-14bd-4e09-a86a-e1da77fa918c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c878a666cea4ff2be87715c4dcfcbd5'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:05.066428 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a1973e2a-14bd-4e09-a86a-e1da77fa918c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c878a666cea4ff2be87715c4dcfcbd5'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:05.078810 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a1973e2a-14bd-4e09-a86a-e1da77fa918c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c878a666cea4ff2be87715c4dcfcbd5'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:05.085679 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a1973e2a-14bd-4e09-a86a-e1da77fa918c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c878a666cea4ff2be87715c4dcfcbd5'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:05.091706 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1222/2444] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:42:04 2021] DELETE /identity/v3/users/6c878a666cea4ff2be87715c4dcfcbd5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:42:05.109866 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a5b72-8840-4076-a87b-c63c43ab2639 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:05.166593 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e7cb7-ac56-4237-ac57-a5681a8d799a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:05.167562 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e7cb7-ac56-4237-ac57-a5681a8d799a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:05.167841 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e7cb7-ac56-4237-ac57-a5681a8d799a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:05.168106 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e7cb7-ac56-4237-ac57-a5681a8d799a admin admin] PATH_INFO: `/v3/users/f6de96f874df4bfaa87454b0c5268e3a` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:05.169318 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e7cb7-ac56-4237-ac57-a5681a8d799a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6de96f874df4bfaa87454b0c5268e3a)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:05.171287 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e7cb7-ac56-4237-ac57-a5681a8d799a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:05.219136 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ab7e7cb7-ac56-4237-ac57-a5681a8d799a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6de96f874df4bfaa87454b0c5268e3a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:05.219846 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ab7e7cb7-ac56-4237-ac57-a5681a8d799a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6de96f874df4bfaa87454b0c5268e3a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:05.230150 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ab7e7cb7-ac56-4237-ac57-a5681a8d799a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6de96f874df4bfaa87454b0c5268e3a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:05.239704 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ab7e7cb7-ac56-4237-ac57-a5681a8d799a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6de96f874df4bfaa87454b0c5268e3a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:05.256261 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ab7e7cb7-ac56-4237-ac57-a5681a8d799a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6de96f874df4bfaa87454b0c5268e3a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:05.264078 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1223/2445] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:42:05 2021] DELETE /identity/v3/users/f6de96f874df4bfaa87454b0c5268e3a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:42:05.268792 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1973e2a-14bd-4e09-a86a-e1da77fa918c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:05.270490 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a1973e2a-14bd-4e09-a86a-e1da77fa918c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:05.284574 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1973e2a-14bd-4e09-a86a-e1da77fa918c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:05.342911 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1ac6f-b94a-4051-a38f-f61c00979014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:05.343995 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1ac6f-b94a-4051-a38f-f61c00979014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:05.344273 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1ac6f-b94a-4051-a38f-f61c00979014 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:05.344570 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1ac6f-b94a-4051-a38f-f61c00979014 admin admin] PATH_INFO: `/v3/projects/c550273fcf3242e683f9f92f9456dbee` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:05.345767 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1ac6f-b94a-4051-a38f-f61c00979014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c550273fcf3242e683f9f92f9456dbee)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:05.347698 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1ac6f-b94a-4051-a38f-f61c00979014 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:05.393701 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-5af1ac6f-b94a-4051-a38f-f61c00979014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c550273fcf3242e683f9f92f9456dbee', 'request_id': 'req-5af1ac6f-b94a-4051-a38f-f61c00979014'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:05.400106 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-5af1ac6f-b94a-4051-a38f-f61c00979014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c550273fcf3242e683f9f92f9456dbee', 'request_id': 'req-5af1ac6f-b94a-4051-a38f-f61c00979014'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:05.408593 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-5af1ac6f-b94a-4051-a38f-f61c00979014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c550273fcf3242e683f9f92f9456dbee', 'request_id': 'req-5af1ac6f-b94a-4051-a38f-f61c00979014'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:05.422861 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-5af1ac6f-b94a-4051-a38f-f61c00979014 admin admin] The token cache is being invalidate because project c550273fcf3242e683f9f92f9456dbee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:42:05.423455 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-5af1ac6f-b94a-4051-a38f-f61c00979014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:05.424444 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-5af1ac6f-b94a-4051-a38f-f61c00979014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:05.426887 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1223/2446] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:42:05 2021] DELETE /identity/v3/projects/c550273fcf3242e683f9f92f9456dbee => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:42:05.695802 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e7cb7-ac56-4237-ac57-a5681a8d799a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:05.697304 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-ab7e7cb7-ac56-4237-ac57-a5681a8d799a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:05.719389 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e7cb7-ac56-4237-ac57-a5681a8d799a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:05.783188 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba4990-ce0f-467f-aba3-3c552daacc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:05.783977 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba4990-ce0f-467f-aba3-3c552daacc45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:05.784250 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba4990-ce0f-467f-aba3-3c552daacc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:05.784526 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba4990-ce0f-467f-aba3-3c552daacc45 admin admin] PATH_INFO: `/v3/projects/4ac47bcd904d402581c491afdf13eae0` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:05.785815 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba4990-ce0f-467f-aba3-3c552daacc45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ac47bcd904d402581c491afdf13eae0)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:05.787805 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba4990-ce0f-467f-aba3-3c552daacc45 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:05.843620 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-f1ba4990-ce0f-467f-aba3-3c552daacc45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac47bcd904d402581c491afdf13eae0', 'request_id': 'req-f1ba4990-ce0f-467f-aba3-3c552daacc45'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:05.849871 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-f1ba4990-ce0f-467f-aba3-3c552daacc45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac47bcd904d402581c491afdf13eae0', 'request_id': 'req-f1ba4990-ce0f-467f-aba3-3c552daacc45'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:05.858593 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-f1ba4990-ce0f-467f-aba3-3c552daacc45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac47bcd904d402581c491afdf13eae0', 'request_id': 'req-f1ba4990-ce0f-467f-aba3-3c552daacc45'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:05.869145 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-f1ba4990-ce0f-467f-aba3-3c552daacc45 admin admin] The token cache is being invalidate because project 4ac47bcd904d402581c491afdf13eae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:42:05.869563 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-f1ba4990-ce0f-467f-aba3-3c552daacc45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:05.870219 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-f1ba4990-ce0f-467f-aba3-3c552daacc45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:05.871840 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1224/2447] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:42:05 2021] DELETE /identity/v3/projects/4ac47bcd904d402581c491afdf13eae0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:42:05.879439 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6b84b-3ba6-4bba-98ec-5e970bc3c95e None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:05.880381 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6b84b-3ba6-4bba-98ec-5e970bc3c95e None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:05.880662 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6b84b-3ba6-4bba-98ec-5e970bc3c95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:05.900722 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-23f6b84b-3ba6-4bba-98ec-5e970bc3c95e None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:42:05.901995 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-23f6b84b-3ba6-4bba-98ec-5e970bc3c95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:05.963667 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1224/2448] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:42:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:42:05.973889 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fb956-24a9-46da-8d95-80eff9d47f44 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:05.974444 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fb956-24a9-46da-8d95-80eff9d47f44 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:05.974755 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fb956-24a9-46da-8d95-80eff9d47f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:06.002091 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-109fb956-24a9-46da-8d95-80eff9d47f44 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:42:06.003659 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-109fb956-24a9-46da-8d95-80eff9d47f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:06.012987 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1225/2449] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:42:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:42:06.017279 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6b84b-3ba6-4bba-98ec-5e970bc3c95e None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:06.027533 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6b84b-3ba6-4bba-98ec-5e970bc3c95e None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:06.032721 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1f5cf-8051-4f65-9f66-b237be08e493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:06.033802 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1f5cf-8051-4f65-9f66-b237be08e493 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:06.034241 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1f5cf-8051-4f65-9f66-b237be08e493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:06.034714 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1f5cf-8051-4f65-9f66-b237be08e493 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:06.035611 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1f5cf-8051-4f65-9f66-b237be08e493 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:42:06.036069 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1f5cf-8051-4f65-9f66-b237be08e493 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:06.037830 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1f5cf-8051-4f65-9f66-b237be08e493 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:06.051696 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1225/2450] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:42:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:42:06.056172 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fb956-24a9-46da-8d95-80eff9d47f44 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:06.065796 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fb956-24a9-46da-8d95-80eff9d47f44 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:06.071355 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a630f7-d9bb-4472-a8cf-008e9dab84bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:06.072155 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a630f7-d9bb-4472-a8cf-008e9dab84bd admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:06.072493 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a630f7-d9bb-4472-a8cf-008e9dab84bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:06.072690 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a630f7-d9bb-4472-a8cf-008e9dab84bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:06.073485 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a630f7-d9bb-4472-a8cf-008e9dab84bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:06.075648 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a630f7-d9bb-4472-a8cf-008e9dab84bd admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:06.104156 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1226/2451] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:42:06 2021] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:42:06.108148 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1f5cf-8051-4f65-9f66-b237be08e493 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:06.118510 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1f5cf-8051-4f65-9f66-b237be08e493 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:06.175163 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3980556-ee0e-4059-83cd-44d490ec5ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:06.176166 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3980556-ee0e-4059-83cd-44d490ec5ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:06.176600 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3980556-ee0e-4059-83cd-44d490ec5ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:06.177179 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3980556-ee0e-4059-83cd-44d490ec5ae6 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:06.178060 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3980556-ee0e-4059-83cd-44d490ec5ae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:06.180454 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3980556-ee0e-4059-83cd-44d490ec5ae6 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:06.204862 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1226/2452] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:42:06 2021] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:42:06.209339 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a630f7-d9bb-4472-a8cf-008e9dab84bd admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:06.227098 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a630f7-d9bb-4472-a8cf-008e9dab84bd admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:06.235123 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3968a-9951-4d03-8a12-318f8c5b1359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:06.235831 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3968a-9951-4d03-8a12-318f8c5b1359 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:06.236109 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3968a-9951-4d03-8a12-318f8c5b1359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:06.236383 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3968a-9951-4d03-8a12-318f8c5b1359 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:06.237142 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3968a-9951-4d03-8a12-318f8c5b1359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:06.238802 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3968a-9951-4d03-8a12-318f8c5b1359 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:06.252076 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1227/2453] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:42:06 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:42:06.256377 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3980556-ee0e-4059-83cd-44d490ec5ae6 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:06.270129 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3980556-ee0e-4059-83cd-44d490ec5ae6 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:06.276084 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cd940-0801-48fb-aea9-947291702562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:06.276848 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cd940-0801-48fb-aea9-947291702562 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:06.277126 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cd940-0801-48fb-aea9-947291702562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:06.277391 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cd940-0801-48fb-aea9-947291702562 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:06.278134 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9cd940-0801-48fb-aea9-947291702562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:06.279939 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9cd940-0801-48fb-aea9-947291702562 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:06.295316 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1227/2454] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:42:06 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:42:06.296804 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3968a-9951-4d03-8a12-318f8c5b1359 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:06.307734 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3968a-9951-4d03-8a12-318f8c5b1359 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:06.313024 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26618a92-d346-4686-8f8f-3d08d7182565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:06.313899 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26618a92-d346-4686-8f8f-3d08d7182565 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:06.314137 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26618a92-d346-4686-8f8f-3d08d7182565 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:06.314440 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26618a92-d346-4686-8f8f-3d08d7182565 admin admin] PATH_INFO: `/v3/projects/7972e473d2074c7ba6d41413bb1e9c37/users/f8114cd8070148ebbe15bbf670678418/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:06.331000 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26618a92-d346-4686-8f8f-3d08d7182565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7972e473d2074c7ba6d41413bb1e9c37, user_id=f8114cd8070148ebbe15bbf670678418, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:06.333697 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26618a92-d346-4686-8f8f-3d08d7182565 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:06.348469 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1228/2455] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:42:06 2021] PUT /identity/v3/projects/7972e473d2074c7ba6d41413bb1e9c37/users/f8114cd8070148ebbe15bbf670678418/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:42:06.358819 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6a15a-336f-40bb-85e3-b7b0ce9a39e9 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:06.359104 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6a15a-336f-40bb-85e3-b7b0ce9a39e9 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:06.359372 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6a15a-336f-40bb-85e3-b7b0ce9a39e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:06.386608 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-6bf6a15a-336f-40bb-85e3-b7b0ce9a39e9 None None] MFA Rules not processed for user `f8114cd8070148ebbe15bbf670678418`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:42:06.387853 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-6bf6a15a-336f-40bb-85e3-b7b0ce9a39e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:06.456589 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1228/2456] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:42:06 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:42:06.471243 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26618a92-d346-4686-8f8f-3d08d7182565 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:06.476022 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-26618a92-d346-4686-8f8f-3d08d7182565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:06.546295 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26618a92-d346-4686-8f8f-3d08d7182565 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:06.551341 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074a617-2e2c-41dc-9be9-09908b77dde7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:06.552213 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074a617-2e2c-41dc-9be9-09908b77dde7 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:06.552497 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074a617-2e2c-41dc-9be9-09908b77dde7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:06.552770 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074a617-2e2c-41dc-9be9-09908b77dde7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:06.563775 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074a617-2e2c-41dc-9be9-09908b77dde7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:06.568256 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074a617-2e2c-41dc-9be9-09908b77dde7 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:06.582563 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1229/2457] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:42:06 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:42:06.603615 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6a15a-336f-40bb-85e3-b7b0ce9a39e9 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:06.678353 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6a15a-336f-40bb-85e3-b7b0ce9a39e9 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:06.683103 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0db07-738a-4ba6-8e9a-70d2fa868d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:06.684085 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0db07-738a-4ba6-8e9a-70d2fa868d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:06.684451 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0db07-738a-4ba6-8e9a-70d2fa868d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:06.684787 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0db07-738a-4ba6-8e9a-70d2fa868d59 admin admin] PATH_INFO: `/v3/users/f8114cd8070148ebbe15bbf670678418` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:06.686068 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0db07-738a-4ba6-8e9a-70d2fa868d59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8114cd8070148ebbe15bbf670678418)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:06.688115 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0db07-738a-4ba6-8e9a-70d2fa868d59 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:06.737559 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-91b0db07-738a-4ba6-8e9a-70d2fa868d59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8114cd8070148ebbe15bbf670678418'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:06.746462 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-91b0db07-738a-4ba6-8e9a-70d2fa868d59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8114cd8070148ebbe15bbf670678418'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:06.747145 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-91b0db07-738a-4ba6-8e9a-70d2fa868d59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8114cd8070148ebbe15bbf670678418'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:06.760362 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-91b0db07-738a-4ba6-8e9a-70d2fa868d59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8114cd8070148ebbe15bbf670678418'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:06.770644 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-91b0db07-738a-4ba6-8e9a-70d2fa868d59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8114cd8070148ebbe15bbf670678418'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:06.778202 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1229/2458] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:42:06 2021] DELETE /identity/v3/users/f8114cd8070148ebbe15bbf670678418 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:42:06.783007 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39646c1-5fb1-4ce6-a8bf-9f3682df9881 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:06.783485 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39646c1-5fb1-4ce6-a8bf-9f3682df9881 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:06.783614 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39646c1-5fb1-4ce6-a8bf-9f3682df9881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:06.802983 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-e39646c1-5fb1-4ce6-a8bf-9f3682df9881 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:42:06.804132 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e39646c1-5fb1-4ce6-a8bf-9f3682df9881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:06.871174 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1230/2459] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:42:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:42:06.877436 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0db07-738a-4ba6-8e9a-70d2fa868d59 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:06.878879 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-91b0db07-738a-4ba6-8e9a-70d2fa868d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:06.964492 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0db07-738a-4ba6-8e9a-70d2fa868d59 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:06.968685 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751bde1-bd32-4909-aef0-7997a8281146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:06.969423 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751bde1-bd32-4909-aef0-7997a8281146 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:06.969687 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751bde1-bd32-4909-aef0-7997a8281146 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:06.969959 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751bde1-bd32-4909-aef0-7997a8281146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:06.983626 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751bde1-bd32-4909-aef0-7997a8281146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:06.985734 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751bde1-bd32-4909-aef0-7997a8281146 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:07.000262 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1230/2460] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:42:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:42:07.293365 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39646c1-5fb1-4ce6-a8bf-9f3682df9881 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:07.295075 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e39646c1-5fb1-4ce6-a8bf-9f3682df9881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:07.309924 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39646c1-5fb1-4ce6-a8bf-9f3682df9881 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:07.317217 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76379ee-4365-479e-819e-f479c0251767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:07.318229 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76379ee-4365-479e-819e-f479c0251767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:07.319232 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76379ee-4365-479e-819e-f479c0251767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:07.319619 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76379ee-4365-479e-819e-f479c0251767 admin admin] PATH_INFO: `/v3/projects/7972e473d2074c7ba6d41413bb1e9c37` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:07.321327 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76379ee-4365-479e-819e-f479c0251767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7972e473d2074c7ba6d41413bb1e9c37)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:07.323486 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76379ee-4365-479e-819e-f479c0251767 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:07.377292 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-c76379ee-4365-479e-819e-f479c0251767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7972e473d2074c7ba6d41413bb1e9c37', 'request_id': 'req-c76379ee-4365-479e-819e-f479c0251767'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:07.384132 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-c76379ee-4365-479e-819e-f479c0251767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7972e473d2074c7ba6d41413bb1e9c37', 'request_id': 'req-c76379ee-4365-479e-819e-f479c0251767'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:07.391839 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-c76379ee-4365-479e-819e-f479c0251767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7972e473d2074c7ba6d41413bb1e9c37', 'request_id': 'req-c76379ee-4365-479e-819e-f479c0251767'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:07.403803 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-c76379ee-4365-479e-819e-f479c0251767 admin admin] The token cache is being invalidate because project 7972e473d2074c7ba6d41413bb1e9c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:42:07.404201 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-c76379ee-4365-479e-819e-f479c0251767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:07.404963 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-c76379ee-4365-479e-819e-f479c0251767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:07.406570 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1231/2461] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:42:07 2021] DELETE /identity/v3/projects/7972e473d2074c7ba6d41413bb1e9c37 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:42:07.412508 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c6ee5-362b-4ae0-a456-3eb9dfd55e73 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:07.412788 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c6ee5-362b-4ae0-a456-3eb9dfd55e73 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:07.413054 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c6ee5-362b-4ae0-a456-3eb9dfd55e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:07.430910 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-f75c6ee5-362b-4ae0-a456-3eb9dfd55e73 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:42:07.432210 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-f75c6ee5-362b-4ae0-a456-3eb9dfd55e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:07.500340 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1231/2462] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:42:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:42:07.508416 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3e839-e8ba-4500-889c-136d16ecb36f None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:07.508787 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3e839-e8ba-4500-889c-136d16ecb36f None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:07.509136 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3e839-e8ba-4500-889c-136d16ecb36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:07.531332 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-c1d3e839-e8ba-4500-889c-136d16ecb36f None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:42:07.532639 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-c1d3e839-e8ba-4500-889c-136d16ecb36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:07.543667 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1232/2463] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:42:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:42:07.547941 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c6ee5-362b-4ae0-a456-3eb9dfd55e73 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:07.558082 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c6ee5-362b-4ae0-a456-3eb9dfd55e73 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:07.562816 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91845e15-d60c-426f-a262-7d53bda7ea6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:07.563497 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91845e15-d60c-426f-a262-7d53bda7ea6a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:07.563774 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91845e15-d60c-426f-a262-7d53bda7ea6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:07.564045 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91845e15-d60c-426f-a262-7d53bda7ea6a admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:07.564795 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91845e15-d60c-426f-a262-7d53bda7ea6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:42:07.565098 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91845e15-d60c-426f-a262-7d53bda7ea6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:07.566876 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91845e15-d60c-426f-a262-7d53bda7ea6a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:07.579120 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1232/2464] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:42:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:42:07.584212 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3e839-e8ba-4500-889c-136d16ecb36f None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:07.592922 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3e839-e8ba-4500-889c-136d16ecb36f None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:07.597944 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b297b2d-1cbe-4cd2-abf7-afb4f115988e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:07.598649 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b297b2d-1cbe-4cd2-abf7-afb4f115988e admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:07.598966 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b297b2d-1cbe-4cd2-abf7-afb4f115988e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:07.599246 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b297b2d-1cbe-4cd2-abf7-afb4f115988e admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:07.600046 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b297b2d-1cbe-4cd2-abf7-afb4f115988e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:07.602716 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b297b2d-1cbe-4cd2-abf7-afb4f115988e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:07.633998 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1233/2465] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:42:07 2021] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:42:07.638292 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91845e15-d60c-426f-a262-7d53bda7ea6a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:07.650857 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91845e15-d60c-426f-a262-7d53bda7ea6a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:07.720573 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b7af9-8360-48c1-b0e7-e4f734a0aea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:07.721361 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b7af9-8360-48c1-b0e7-e4f734a0aea4 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:07.721646 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b7af9-8360-48c1-b0e7-e4f734a0aea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:07.721920 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b7af9-8360-48c1-b0e7-e4f734a0aea4 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:07.722852 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b7af9-8360-48c1-b0e7-e4f734a0aea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:07.724828 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b7af9-8360-48c1-b0e7-e4f734a0aea4 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:07.750597 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1233/2466] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:42:07 2021] POST /identity/v3/users => generated 285 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:42:07.754758 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b297b2d-1cbe-4cd2-abf7-afb4f115988e admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:07.778336 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b297b2d-1cbe-4cd2-abf7-afb4f115988e admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:07.793182 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79141ea-af7f-4ef6-bfb5-0d87a4038a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:07.793874 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79141ea-af7f-4ef6-bfb5-0d87a4038a82 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:07.794155 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79141ea-af7f-4ef6-bfb5-0d87a4038a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:07.794433 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79141ea-af7f-4ef6-bfb5-0d87a4038a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:07.795224 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79141ea-af7f-4ef6-bfb5-0d87a4038a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:07.796840 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79141ea-af7f-4ef6-bfb5-0d87a4038a82 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:07.811997 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1234/2467] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:42:07 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:42:07.814044 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b7af9-8360-48c1-b0e7-e4f734a0aea4 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:07.829458 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b7af9-8360-48c1-b0e7-e4f734a0aea4 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:07.837588 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdce9d-cbdf-4617-a99a-7f3259b712d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:07.838303 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdce9d-cbdf-4617-a99a-7f3259b712d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:07.838588 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdce9d-cbdf-4617-a99a-7f3259b712d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:07.839012 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdce9d-cbdf-4617-a99a-7f3259b712d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:07.839888 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbdce9d-cbdf-4617-a99a-7f3259b712d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:07.842170 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbdce9d-cbdf-4617-a99a-7f3259b712d7 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:07.858444 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1234/2468] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:42:07 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:42:07.859801 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79141ea-af7f-4ef6-bfb5-0d87a4038a82 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:07.870148 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79141ea-af7f-4ef6-bfb5-0d87a4038a82 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:07.875191 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9b0ea-7392-4c6c-ad61-531a7c002cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:07.876415 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9b0ea-7392-4c6c-ad61-531a7c002cd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:07.876690 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9b0ea-7392-4c6c-ad61-531a7c002cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:07.876969 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9b0ea-7392-4c6c-ad61-531a7c002cd9 admin admin] PATH_INFO: `/v3/projects/bc2c50bec95e425d9e52ff67f8f3d1df/users/06df0542ed1a49938df85797061fc19a/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:07.891445 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9b0ea-7392-4c6c-ad61-531a7c002cd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc2c50bec95e425d9e52ff67f8f3d1df, user_id=06df0542ed1a49938df85797061fc19a, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:07.894024 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9b0ea-7392-4c6c-ad61-531a7c002cd9 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:07.908901 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1235/2469] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:42:07 2021] PUT /identity/v3/projects/bc2c50bec95e425d9e52ff67f8f3d1df/users/06df0542ed1a49938df85797061fc19a/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:42:07.919657 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fb983-44e0-492f-b3d7-8aeba531012f None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:07.920176 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fb983-44e0-492f-b3d7-8aeba531012f None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:07.920553 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fb983-44e0-492f-b3d7-8aeba531012f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:07.947731 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-6e7fb983-44e0-492f-b3d7-8aeba531012f None None] MFA Rules not processed for user `06df0542ed1a49938df85797061fc19a`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:42:07.948961 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-6e7fb983-44e0-492f-b3d7-8aeba531012f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:08.012071 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1235/2470] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:42:07 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:42:08.023009 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9b0ea-7392-4c6c-ad61-531a7c002cd9 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:08.024825 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-2ea9b0ea-7392-4c6c-ad61-531a7c002cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:08.087661 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9b0ea-7392-4c6c-ad61-531a7c002cd9 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:08.094220 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3bd4e-c267-43d5-b77f-26d7d67cc374 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:08.095169 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3bd4e-c267-43d5-b77f-26d7d67cc374 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:08.095558 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3bd4e-c267-43d5-b77f-26d7d67cc374 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:08.095874 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3bd4e-c267-43d5-b77f-26d7d67cc374 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:08.108651 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3bd4e-c267-43d5-b77f-26d7d67cc374 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:08.110096 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3bd4e-c267-43d5-b77f-26d7d67cc374 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:08.118979 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1236/2471] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:42:08 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:42:08.143126 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fb983-44e0-492f-b3d7-8aeba531012f None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:08.210657 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fb983-44e0-492f-b3d7-8aeba531012f None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:08.219501 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84c820-0aeb-409a-844b-00c94e5fa5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:08.220395 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84c820-0aeb-409a-844b-00c94e5fa5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:08.220669 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84c820-0aeb-409a-844b-00c94e5fa5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:08.220972 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84c820-0aeb-409a-844b-00c94e5fa5a7 admin admin] PATH_INFO: `/v3/users/06df0542ed1a49938df85797061fc19a` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:08.222234 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84c820-0aeb-409a-844b-00c94e5fa5a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06df0542ed1a49938df85797061fc19a)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:08.224319 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84c820-0aeb-409a-844b-00c94e5fa5a7 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:08.270803 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-cb84c820-0aeb-409a-844b-00c94e5fa5a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06df0542ed1a49938df85797061fc19a'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:08.279555 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-cb84c820-0aeb-409a-844b-00c94e5fa5a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06df0542ed1a49938df85797061fc19a'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:08.280195 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-cb84c820-0aeb-409a-844b-00c94e5fa5a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06df0542ed1a49938df85797061fc19a'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:08.292889 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-cb84c820-0aeb-409a-844b-00c94e5fa5a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06df0542ed1a49938df85797061fc19a'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:08.300067 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-cb84c820-0aeb-409a-844b-00c94e5fa5a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06df0542ed1a49938df85797061fc19a'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:08.306116 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1236/2472] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:42:08 2021] DELETE /identity/v3/users/06df0542ed1a49938df85797061fc19a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:42:08.310994 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386d5a8-2d16-48c7-997f-ef1008a1facc None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:08.311831 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386d5a8-2d16-48c7-997f-ef1008a1facc None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:08.312187 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386d5a8-2d16-48c7-997f-ef1008a1facc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:08.330362 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-7386d5a8-2d16-48c7-997f-ef1008a1facc None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:42:08.331739 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-7386d5a8-2d16-48c7-997f-ef1008a1facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:08.421721 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1237/2473] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:42:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:42:08.428579 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84c820-0aeb-409a-844b-00c94e5fa5a7 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:08.430021 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-cb84c820-0aeb-409a-844b-00c94e5fa5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:08.492807 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84c820-0aeb-409a-844b-00c94e5fa5a7 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:08.497330 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd56413-932c-422a-a4b3-b347c92278a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:08.498005 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd56413-932c-422a-a4b3-b347c92278a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:08.498283 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd56413-932c-422a-a4b3-b347c92278a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:08.498562 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd56413-932c-422a-a4b3-b347c92278a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:08.509304 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd56413-932c-422a-a4b3-b347c92278a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:08.510937 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd56413-932c-422a-a4b3-b347c92278a2 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:08.523860 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1237/2474] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:42:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:42:08.801517 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386d5a8-2d16-48c7-997f-ef1008a1facc None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:08.804241 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-7386d5a8-2d16-48c7-997f-ef1008a1facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:08.818672 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386d5a8-2d16-48c7-997f-ef1008a1facc None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:08.824743 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322f2b3-802b-45a4-b85b-9148743c304d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:08.825986 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322f2b3-802b-45a4-b85b-9148743c304d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:08.826484 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322f2b3-802b-45a4-b85b-9148743c304d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:08.826975 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322f2b3-802b-45a4-b85b-9148743c304d admin admin] PATH_INFO: `/v3/projects/bc2c50bec95e425d9e52ff67f8f3d1df` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:08.828691 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322f2b3-802b-45a4-b85b-9148743c304d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc2c50bec95e425d9e52ff67f8f3d1df)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:08.830986 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322f2b3-802b-45a4-b85b-9148743c304d admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:08.877248 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9322f2b3-802b-45a4-b85b-9148743c304d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc2c50bec95e425d9e52ff67f8f3d1df', 'request_id': 'req-9322f2b3-802b-45a4-b85b-9148743c304d'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:08.883717 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9322f2b3-802b-45a4-b85b-9148743c304d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc2c50bec95e425d9e52ff67f8f3d1df', 'request_id': 'req-9322f2b3-802b-45a4-b85b-9148743c304d'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:08.891708 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9322f2b3-802b-45a4-b85b-9148743c304d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc2c50bec95e425d9e52ff67f8f3d1df', 'request_id': 'req-9322f2b3-802b-45a4-b85b-9148743c304d'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:08.902827 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9322f2b3-802b-45a4-b85b-9148743c304d admin admin] The token cache is being invalidate because project bc2c50bec95e425d9e52ff67f8f3d1df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:42:08.903120 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9322f2b3-802b-45a4-b85b-9148743c304d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:08.903754 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9322f2b3-802b-45a4-b85b-9148743c304d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:42:08.906147 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1238/2475] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:42:08 2021] DELETE /identity/v3/projects/bc2c50bec95e425d9e52ff67f8f3d1df => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:42:08.912615 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930cb9d-28cb-48f1-80dc-696dd3555ee2 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:08.912942 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930cb9d-28cb-48f1-80dc-696dd3555ee2 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:08.913259 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930cb9d-28cb-48f1-80dc-696dd3555ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:08.937884 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-1930cb9d-28cb-48f1-80dc-696dd3555ee2 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:42:08.939046 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-1930cb9d-28cb-48f1-80dc-696dd3555ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:08.998692 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1238/2476] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:42:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:42:09.006644 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d90829-e848-48e9-8d6a-a8d83a57f483 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:09.007041 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d90829-e848-48e9-8d6a-a8d83a57f483 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:09.007327 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d90829-e848-48e9-8d6a-a8d83a57f483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:09.026158 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-77d90829-e848-48e9-8d6a-a8d83a57f483 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:42:09.027421 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-77d90829-e848-48e9-8d6a-a8d83a57f483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:09.035771 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1239/2477] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:42:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:42:09.040096 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930cb9d-28cb-48f1-80dc-696dd3555ee2 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:09.050433 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930cb9d-28cb-48f1-80dc-696dd3555ee2 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:09.055750 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c3731-3081-4c6b-b853-c82730ebbfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:09.056417 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c3731-3081-4c6b-b853-c82730ebbfd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:09.056702 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c3731-3081-4c6b-b853-c82730ebbfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:09.056973 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c3731-3081-4c6b-b853-c82730ebbfd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:09.057738 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c3731-3081-4c6b-b853-c82730ebbfd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:42:09.058228 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c3731-3081-4c6b-b853-c82730ebbfd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:09.059862 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c3731-3081-4c6b-b853-c82730ebbfd4 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:09.071521 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1239/2478] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:42:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:42:09.076020 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d90829-e848-48e9-8d6a-a8d83a57f483 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:09.085207 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d90829-e848-48e9-8d6a-a8d83a57f483 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:09.089961 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ea81d-64f1-44e3-8784-9c294b99d489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:09.090622 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ea81d-64f1-44e3-8784-9c294b99d489 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:09.090946 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ea81d-64f1-44e3-8784-9c294b99d489 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:09.091257 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ea81d-64f1-44e3-8784-9c294b99d489 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:09.092189 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ea81d-64f1-44e3-8784-9c294b99d489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:09.094248 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ea81d-64f1-44e3-8784-9c294b99d489 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:09.121399 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1240/2479] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:42:09 2021] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:42:09.125888 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c3731-3081-4c6b-b853-c82730ebbfd4 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:09.135610 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c3731-3081-4c6b-b853-c82730ebbfd4 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:09.191756 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0c611-e8d1-4750-bd77-43e535b7a9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:09.192359 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0c611-e8d1-4750-bd77-43e535b7a9cf admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:09.192626 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0c611-e8d1-4750-bd77-43e535b7a9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:09.192896 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0c611-e8d1-4750-bd77-43e535b7a9cf admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:09.193610 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0c611-e8d1-4750-bd77-43e535b7a9cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:09.195653 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0c611-e8d1-4750-bd77-43e535b7a9cf admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:09.216363 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1240/2480] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:42:09 2021] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:42:09.220560 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ea81d-64f1-44e3-8784-9c294b99d489 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:09.231475 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ea81d-64f1-44e3-8784-9c294b99d489 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:09.237208 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a79869-ddb2-458a-9b5c-aae2340d4346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:09.237867 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a79869-ddb2-458a-9b5c-aae2340d4346 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:09.238143 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a79869-ddb2-458a-9b5c-aae2340d4346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:09.238411 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a79869-ddb2-458a-9b5c-aae2340d4346 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:09.239188 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a79869-ddb2-458a-9b5c-aae2340d4346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:09.240789 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a79869-ddb2-458a-9b5c-aae2340d4346 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:09.251559 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1241/2481] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:42:09 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:42:09.256886 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0c611-e8d1-4750-bd77-43e535b7a9cf admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:09.267177 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0c611-e8d1-4750-bd77-43e535b7a9cf admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:09.271732 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f68642-d481-4532-9ee9-96a0b17fb148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:09.272382 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f68642-d481-4532-9ee9-96a0b17fb148 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:09.272668 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f68642-d481-4532-9ee9-96a0b17fb148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:09.272932 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f68642-d481-4532-9ee9-96a0b17fb148 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:09.273695 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f68642-d481-4532-9ee9-96a0b17fb148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:09.275330 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f68642-d481-4532-9ee9-96a0b17fb148 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:09.285033 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1241/2482] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:42:09 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:42:09.289028 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a79869-ddb2-458a-9b5c-aae2340d4346 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:09.299181 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a79869-ddb2-458a-9b5c-aae2340d4346 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:09.304522 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd9af6-fa45-41fc-91df-11cd215bfa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:09.305498 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd9af6-fa45-41fc-91df-11cd215bfa84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:09.305913 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd9af6-fa45-41fc-91df-11cd215bfa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:09.306186 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd9af6-fa45-41fc-91df-11cd215bfa84 admin admin] PATH_INFO: `/v3/projects/6a5ee01a79924e0db3458eaeac6bd1d5/users/219ac7ecffe642179ea82d847a2b3eb1/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:09.322031 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd9af6-fa45-41fc-91df-11cd215bfa84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a5ee01a79924e0db3458eaeac6bd1d5, user_id=219ac7ecffe642179ea82d847a2b3eb1, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:09.324694 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd9af6-fa45-41fc-91df-11cd215bfa84 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:09.339552 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1242/2483] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:42:09 2021] PUT /identity/v3/projects/6a5ee01a79924e0db3458eaeac6bd1d5/users/219ac7ecffe642179ea82d847a2b3eb1/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:42:09.344870 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d55fe8-5e29-4f7f-8471-568c7d5e242d None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:09.345157 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d55fe8-5e29-4f7f-8471-568c7d5e242d None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:09.345461 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d55fe8-5e29-4f7f-8471-568c7d5e242d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:09.363677 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-57d55fe8-5e29-4f7f-8471-568c7d5e242d None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:42:09.364883 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-57d55fe8-5e29-4f7f-8471-568c7d5e242d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:09.425624 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1242/2484] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:42:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:42:09.435725 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd9af6-fa45-41fc-91df-11cd215bfa84 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:09.437611 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-dadd9af6-fa45-41fc-91df-11cd215bfa84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:09.496050 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd9af6-fa45-41fc-91df-11cd215bfa84 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:09.500530 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b2e2c-3e45-4d2b-ab06-bab71c13259f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:09.501178 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b2e2c-3e45-4d2b-ab06-bab71c13259f service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:09.501453 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b2e2c-3e45-4d2b-ab06-bab71c13259f service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:09.501724 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b2e2c-3e45-4d2b-ab06-bab71c13259f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:09.512805 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b2e2c-3e45-4d2b-ab06-bab71c13259f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:09.514389 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b2e2c-3e45-4d2b-ab06-bab71c13259f service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:09.525905 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1243/2485] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:42:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:42:10.245804 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b70bf8-12dc-4e54-b777-3e38e5169202 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:10.246302 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b70bf8-12dc-4e54-b777-3e38e5169202 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:10.246543 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b70bf8-12dc-4e54-b777-3e38e5169202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:10.275751 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-f7b70bf8-12dc-4e54-b777-3e38e5169202 None None] MFA Rules not processed for user `219ac7ecffe642179ea82d847a2b3eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:42:10.277086 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-f7b70bf8-12dc-4e54-b777-3e38e5169202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:10.349881 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1243/2486] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:42:10 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:42:10.360784 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b2e2c-3e45-4d2b-ab06-bab71c13259f service neutron] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:10.363169 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-4e3b2e2c-3e45-4d2b-ab06-bab71c13259f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:10.430378 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b2e2c-3e45-4d2b-ab06-bab71c13259f service neutron] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:10.434579 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464611a-7d0b-40bb-aef8-a4b0ccbe1801 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:10.435373 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464611a-7d0b-40bb-aef8-a4b0ccbe1801 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:10.435746 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464611a-7d0b-40bb-aef8-a4b0ccbe1801 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:10.436120 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464611a-7d0b-40bb-aef8-a4b0ccbe1801 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:10.445870 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e464611a-7d0b-40bb-aef8-a4b0ccbe1801 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:10.447447 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e464611a-7d0b-40bb-aef8-a4b0ccbe1801 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:10.457228 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1244/2487] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:42:10 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:42:11.165735 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d857e-ad0d-4466-9623-5c83576c63cc None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:11.166050 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d857e-ad0d-4466-9623-5c83576c63cc None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:11.166321 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d857e-ad0d-4466-9623-5c83576c63cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:11.184170 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-875d857e-ad0d-4466-9623-5c83576c63cc None None] MFA Rules not processed for user `8b1e077f454b471ba851db9431f1011d`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:42:11.185392 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-875d857e-ad0d-4466-9623-5c83576c63cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:11.240416 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1244/2488] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:42:11 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:42:11.577343 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464611a-7d0b-40bb-aef8-a4b0ccbe1801 service cinder] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:11.578949 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e464611a-7d0b-40bb-aef8-a4b0ccbe1801 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:11.591131 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464611a-7d0b-40bb-aef8-a4b0ccbe1801 service cinder] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:11.595144 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea441719-d3b8-459c-8168-c253de0f8210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:11.595782 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea441719-d3b8-459c-8168-c253de0f8210 service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:11.596047 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea441719-d3b8-459c-8168-c253de0f8210 service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:11.596319 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea441719-d3b8-459c-8168-c253de0f8210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:11.598124 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-ea441719-d3b8-459c-8168-c253de0f8210 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:11.607616 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea441719-d3b8-459c-8168-c253de0f8210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:11.609032 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea441719-d3b8-459c-8168-c253de0f8210 service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:11.617066 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1245/2489] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:42:11 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:42:11.802066 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e674cb3-ddfe-413a-a075-5bb3f092890b None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:11.802614 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e674cb3-ddfe-413a-a075-5bb3f092890b None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:11.802614 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e674cb3-ddfe-413a-a075-5bb3f092890b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:11.821480 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-0e674cb3-ddfe-413a-a075-5bb3f092890b None None] MFA Rules not processed for user `219ac7ecffe642179ea82d847a2b3eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:42:11.822777 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-0e674cb3-ddfe-413a-a075-5bb3f092890b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:11.829857 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1245/2490] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:42:11 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:42:11.886151 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea441719-d3b8-459c-8168-c253de0f8210 service neutron] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:11.895956 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea441719-d3b8-459c-8168-c253de0f8210 service neutron] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:11.907463 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc791d-2b94-4d04-b428-2936a9df3995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:11.908575 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc791d-2b94-4d04-b428-2936a9df3995 service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:11.908817 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc791d-2b94-4d04-b428-2936a9df3995 service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:11.909407 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc791d-2b94-4d04-b428-2936a9df3995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:11.912450 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-3abc791d-2b94-4d04-b428-2936a9df3995 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:11.940505 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8218fd5-a76c-4e1b-b81d-44351e6041e0 None None] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:11.941145 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8218fd5-a76c-4e1b-b81d-44351e6041e0 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:11.941432 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8218fd5-a76c-4e1b-b81d-44351e6041e0 None None] PATH_INFO: `/` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:11.943848 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1246/2491] 10.222.0.79 () {54 vars in 960 bytes} [Thu Oct 28 14:42:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 14:42:11.949877 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e180f7-ecc8-4288-9ba5-eb121a52983d None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:11.950391 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e180f7-ecc8-4288-9ba5-eb121a52983d None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:11.950669 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e180f7-ecc8-4288-9ba5-eb121a52983d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:11.991121 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc791d-2b94-4d04-b428-2936a9df3995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:11.991740 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-b6e180f7-ecc8-4288-9ba5-eb121a52983d None None] MFA Rules not processed for user `8bf32a6fafb7458788a47e4774cb7bc8`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:42:11.992736 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc791d-2b94-4d04-b428-2936a9df3995 service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:11.993019 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-b6e180f7-ecc8-4288-9ba5-eb121a52983d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:12.004024 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1246/2492] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:42:11 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:42:12.067060 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1247/2493] 10.222.0.79 () {58 vars in 1057 bytes} [Thu Oct 28 14:42:11 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:42:12.075680 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc791d-2b94-4d04-b428-2936a9df3995 service neutron] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:12.087832 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc791d-2b94-4d04-b428-2936a9df3995 service neutron] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:12.093657 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c52cb-2fb5-4a76-bed5-69aee79262b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bf32a6fafb7458788a47e4774cb7bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:12.094433 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c52cb-2fb5-4a76-bed5-69aee79262b4 service placement] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:12.094992 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c52cb-2fb5-4a76-bed5-69aee79262b4 service placement] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:12.095365 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c52cb-2fb5-4a76-bed5-69aee79262b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:12.099158 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-2c2c52cb-2fb5-4a76-bed5-69aee79262b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:12.112086 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c52cb-2fb5-4a76-bed5-69aee79262b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:12.113961 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c52cb-2fb5-4a76-bed5-69aee79262b4 service placement] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:12.124855 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1247/2494] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:42:12 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:42:12.127842 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e180f7-ecc8-4288-9ba5-eb121a52983d None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:12.138006 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e180f7-ecc8-4288-9ba5-eb121a52983d None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:12.142163 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c2435-dfd0-4516-840c-c1cbfcadaf6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:12.142995 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c2435-dfd0-4516-840c-c1cbfcadaf6d service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:12.143400 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c2435-dfd0-4516-840c-c1cbfcadaf6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:12.144096 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c2435-dfd0-4516-840c-c1cbfcadaf6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:12.146016 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-d24c2435-dfd0-4516-840c-c1cbfcadaf6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:12.156409 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c2435-dfd0-4516-840c-c1cbfcadaf6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:12.157929 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c2435-dfd0-4516-840c-c1cbfcadaf6d service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:12.166967 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1248/2495] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:42:12 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:42:13.043462 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c52cb-2fb5-4a76-bed5-69aee79262b4 service placement] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:13.045787 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-2c2c52cb-2fb5-4a76-bed5-69aee79262b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:13.147394 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c2435-dfd0-4516-840c-c1cbfcadaf6d service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:13.162589 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c2435-dfd0-4516-840c-c1cbfcadaf6d service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:13.168299 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5e280-e16a-447f-964b-a85c5aacad10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:13.169751 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5e280-e16a-447f-964b-a85c5aacad10 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:13.170204 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5e280-e16a-447f-964b-a85c5aacad10 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:13.170638 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5e280-e16a-447f-964b-a85c5aacad10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:13.174368 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-48c5e280-e16a-447f-964b-a85c5aacad10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:13.200337 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5e280-e16a-447f-964b-a85c5aacad10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:13.202106 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5e280-e16a-447f-964b-a85c5aacad10 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:13.203444 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c52cb-2fb5-4a76-bed5-69aee79262b4 service placement] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:13.217867 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1249/2496] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:42:13 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:42:13.223588 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee651aeb-ffb7-4072-9b76-375ad95ea701 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:13.224911 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee651aeb-ffb7-4072-9b76-375ad95ea701 service nova] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:13.225282 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee651aeb-ffb7-4072-9b76-375ad95ea701 service nova] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:13.225790 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee651aeb-ffb7-4072-9b76-375ad95ea701 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:13.240860 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee651aeb-ffb7-4072-9b76-375ad95ea701 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:13.242858 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee651aeb-ffb7-4072-9b76-375ad95ea701 service nova] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:13.253805 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1248/2497] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:42:13 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:42:14.297397 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5e280-e16a-447f-964b-a85c5aacad10 service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:14.310075 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5e280-e16a-447f-964b-a85c5aacad10 service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:14.320091 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488857a-e900-4446-ac9a-5f7a29e9b9d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:14.321137 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488857a-e900-4446-ac9a-5f7a29e9b9d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:14.321880 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488857a-e900-4446-ac9a-5f7a29e9b9d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:14.322501 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488857a-e900-4446-ac9a-5f7a29e9b9d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:14.326473 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-f488857a-e900-4446-ac9a-5f7a29e9b9d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:14.340528 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488857a-e900-4446-ac9a-5f7a29e9b9d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:14.342383 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488857a-e900-4446-ac9a-5f7a29e9b9d1 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:14.357104 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1250/2498] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:42:14 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:42:16.515439 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41b067-1bfc-450e-b23e-1d51641f6fda None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:16.515910 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41b067-1bfc-450e-b23e-1d51641f6fda None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:16.515910 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41b067-1bfc-450e-b23e-1d51641f6fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:16.535226 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-7b41b067-1bfc-450e-b23e-1d51641f6fda None None] MFA Rules not processed for user `fb71aef5ce61461b9c92f8bf4869af1d`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:42:16.536454 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-7b41b067-1bfc-450e-b23e-1d51641f6fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:16.544072 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1249/2499] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:42:16 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:42:19.599179 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488857a-e900-4446-ac9a-5f7a29e9b9d1 service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:19.601474 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-f488857a-e900-4446-ac9a-5f7a29e9b9d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:19.620961 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488857a-e900-4446-ac9a-5f7a29e9b9d1 service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:19.628166 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c70f36-a0f4-4f62-919e-fdb5e14d4429 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:19.628927 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c70f36-a0f4-4f62-919e-fdb5e14d4429 service nova] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:19.629271 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c70f36-a0f4-4f62-919e-fdb5e14d4429 service nova] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:19.629609 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c70f36-a0f4-4f62-919e-fdb5e14d4429 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:19.631445 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-b4c70f36-a0f4-4f62-919e-fdb5e14d4429 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:19.645127 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c70f36-a0f4-4f62-919e-fdb5e14d4429 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:19.647094 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c70f36-a0f4-4f62-919e-fdb5e14d4429 service nova] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:19.660872 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1251/2500] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:42:19 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:42:24.680395 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41b067-1bfc-450e-b23e-1d51641f6fda None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:24.695217 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41b067-1bfc-450e-b23e-1d51641f6fda None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:24.701922 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ca866-b45a-4a33-9627-998ec31d7324 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:24.702582 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ca866-b45a-4a33-9627-998ec31d7324 service nova] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:24.703093 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ca866-b45a-4a33-9627-998ec31d7324 service nova] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:24.703374 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ca866-b45a-4a33-9627-998ec31d7324 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:24.705194 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-523ca866-b45a-4a33-9627-998ec31d7324 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:24.726014 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ca866-b45a-4a33-9627-998ec31d7324 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:24.729166 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ca866-b45a-4a33-9627-998ec31d7324 service nova] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:24.742660 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1250/2501] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:42:24 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:42:29.838074 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1b60e-6bc9-40f2-ace3-6a5111fdd01b None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:29.838728 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1b60e-6bc9-40f2-ace3-6a5111fdd01b None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:29.838728 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1b60e-6bc9-40f2-ace3-6a5111fdd01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:29.861776 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-9dc1b60e-6bc9-40f2-ace3-6a5111fdd01b None None] MFA Rules not processed for user `219ac7ecffe642179ea82d847a2b3eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:42:29.863063 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-9dc1b60e-6bc9-40f2-ace3-6a5111fdd01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:29.870293 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1252/2502] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:42:29 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:42:49.853664 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e70a5-b7b9-4586-84f3-0ee51f0c4eaa None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:49.854148 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e70a5-b7b9-4586-84f3-0ee51f0c4eaa None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:49.854253 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e70a5-b7b9-4586-84f3-0ee51f0c4eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:49.882889 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-a45e70a5-b7b9-4586-84f3-0ee51f0c4eaa None None] MFA Rules not processed for user `62cc0165aee14b449c8a49233001f631`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:42:49.884364 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-a45e70a5-b7b9-4586-84f3-0ee51f0c4eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:49.946605 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1251/2503] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Oct 28 14:42:49 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:42:49.999415 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1b60e-6bc9-40f2-ace3-6a5111fdd01b None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:42:50.001204 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-9dc1b60e-6bc9-40f2-ace3-6a5111fdd01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:42:50.082703 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1b60e-6bc9-40f2-ace3-6a5111fdd01b None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:42:50.088702 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b12358-78c8-47dc-b90a-2c7b599702b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889e7be1dcaf47f599af9c9b7ad33042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:42:50.089589 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b12358-78c8-47dc-b90a-2c7b599702b2 service swift] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:42:50.089894 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b12358-78c8-47dc-b90a-2c7b599702b2 service swift] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:42:50.090146 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b12358-78c8-47dc-b90a-2c7b599702b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:42:50.101107 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b12358-78c8-47dc-b90a-2c7b599702b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:42:50.102728 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b12358-78c8-47dc-b90a-2c7b599702b2 service swift] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:42:50.110847 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1253/2504] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Oct 28 14:42:49 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 14:43:06.326993 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e1b96-9cac-4763-a29d-4d0e43b01e32 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:06.327496 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e1b96-9cac-4763-a29d-4d0e43b01e32 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:06.327593 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e1b96-9cac-4763-a29d-4d0e43b01e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:06.353378 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-3c6e1b96-9cac-4763-a29d-4d0e43b01e32 None None] MFA Rules not processed for user `62cc0165aee14b449c8a49233001f631`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:43:06.354573 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-3c6e1b96-9cac-4763-a29d-4d0e43b01e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:43:06.362416 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1252/2505] 10.222.0.79 () {58 vars in 967 bytes} [Thu Oct 28 14:43:06 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:43:06.380397 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b12358-78c8-47dc-b90a-2c7b599702b2 service swift] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:06.391383 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b12358-78c8-47dc-b90a-2c7b599702b2 service swift] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:06.397776 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0bcef-7481-4ab3-b22d-1243123ba52a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889e7be1dcaf47f599af9c9b7ad33042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:06.398418 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0bcef-7481-4ab3-b22d-1243123ba52a service swift] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:06.398704 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0bcef-7481-4ab3-b22d-1243123ba52a service swift] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:06.398998 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0bcef-7481-4ab3-b22d-1243123ba52a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:06.407409 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0bcef-7481-4ab3-b22d-1243123ba52a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:06.409000 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0bcef-7481-4ab3-b22d-1243123ba52a service swift] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:06.417648 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1254/2506] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Oct 28 14:43:06 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 14:43:08.400645 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e1b96-9cac-4763-a29d-4d0e43b01e32 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:08.412559 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e1b96-9cac-4763-a29d-4d0e43b01e32 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:08.417995 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f7381-03e4-4c81-bccd-76243b0ef8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:08.419024 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f7381-03e4-4c81-bccd-76243b0ef8d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:08.419365 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f7381-03e4-4c81-bccd-76243b0ef8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:08.419803 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f7381-03e4-4c81-bccd-76243b0ef8d0 admin admin] PATH_INFO: `/v3/users/219ac7ecffe642179ea82d847a2b3eb1` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:08.421072 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f7381-03e4-4c81-bccd-76243b0ef8d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=219ac7ecffe642179ea82d847a2b3eb1)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:08.423073 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f7381-03e4-4c81-bccd-76243b0ef8d0 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:08.478115 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-c58f7381-03e4-4c81-bccd-76243b0ef8d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '219ac7ecffe642179ea82d847a2b3eb1'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:43:08.478865 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-c58f7381-03e4-4c81-bccd-76243b0ef8d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '219ac7ecffe642179ea82d847a2b3eb1'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:43:08.488143 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-c58f7381-03e4-4c81-bccd-76243b0ef8d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '219ac7ecffe642179ea82d847a2b3eb1'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:43:08.495015 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-c58f7381-03e4-4c81-bccd-76243b0ef8d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '219ac7ecffe642179ea82d847a2b3eb1'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:43:08.506294 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-c58f7381-03e4-4c81-bccd-76243b0ef8d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '219ac7ecffe642179ea82d847a2b3eb1'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:43:08.512678 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1253/2507] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:43:08 2021] DELETE /identity/v3/users/219ac7ecffe642179ea82d847a2b3eb1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:43:08.689461 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0bcef-7481-4ab3-b22d-1243123ba52a service swift] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:08.700192 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0bcef-7481-4ab3-b22d-1243123ba52a service swift] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:08.754535 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e7cf4-6d0a-46d6-9ab1-764a0b7e7969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:08.755417 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e7cf4-6d0a-46d6-9ab1-764a0b7e7969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:08.755713 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e7cf4-6d0a-46d6-9ab1-764a0b7e7969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:08.756037 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e7cf4-6d0a-46d6-9ab1-764a0b7e7969 admin admin] PATH_INFO: `/v3/projects/6a5ee01a79924e0db3458eaeac6bd1d5` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:08.757253 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e7cf4-6d0a-46d6-9ab1-764a0b7e7969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a5ee01a79924e0db3458eaeac6bd1d5)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:08.759195 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e7cf4-6d0a-46d6-9ab1-764a0b7e7969 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:08.808291 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-ac7e7cf4-6d0a-46d6-9ab1-764a0b7e7969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a5ee01a79924e0db3458eaeac6bd1d5', 'request_id': 'req-ac7e7cf4-6d0a-46d6-9ab1-764a0b7e7969'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:43:08.814576 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-ac7e7cf4-6d0a-46d6-9ab1-764a0b7e7969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a5ee01a79924e0db3458eaeac6bd1d5', 'request_id': 'req-ac7e7cf4-6d0a-46d6-9ab1-764a0b7e7969'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:43:08.823812 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-ac7e7cf4-6d0a-46d6-9ab1-764a0b7e7969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a5ee01a79924e0db3458eaeac6bd1d5', 'request_id': 'req-ac7e7cf4-6d0a-46d6-9ab1-764a0b7e7969'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:43:08.838428 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-ac7e7cf4-6d0a-46d6-9ab1-764a0b7e7969 admin admin] The token cache is being invalidate because project 6a5ee01a79924e0db3458eaeac6bd1d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:43:08.838760 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-ac7e7cf4-6d0a-46d6-9ab1-764a0b7e7969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:43:08.839700 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-ac7e7cf4-6d0a-46d6-9ab1-764a0b7e7969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:43:08.841946 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1255/2508] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:43:08 2021] DELETE /identity/v3/projects/6a5ee01a79924e0db3458eaeac6bd1d5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:43:08.848120 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785ba67-a921-4dd5-b91b-1a9c8c4647c3 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:08.848413 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785ba67-a921-4dd5-b91b-1a9c8c4647c3 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:08.848692 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785ba67-a921-4dd5-b91b-1a9c8c4647c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:08.867546 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-1785ba67-a921-4dd5-b91b-1a9c8c4647c3 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:43:08.868779 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-1785ba67-a921-4dd5-b91b-1a9c8c4647c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:43:08.935668 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1254/2509] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:43:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:43:08.943878 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a352a28-c2b1-4d15-9334-3d11291fe9c1 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:08.944165 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a352a28-c2b1-4d15-9334-3d11291fe9c1 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:08.944436 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a352a28-c2b1-4d15-9334-3d11291fe9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:08.963314 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-7a352a28-c2b1-4d15-9334-3d11291fe9c1 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:43:08.964523 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-7a352a28-c2b1-4d15-9334-3d11291fe9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:43:08.973462 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1256/2510] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:43:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:43:08.978347 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785ba67-a921-4dd5-b91b-1a9c8c4647c3 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:08.991517 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785ba67-a921-4dd5-b91b-1a9c8c4647c3 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:08.996816 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76087d1a-22d3-4bdf-a15c-23c59dac9ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:08.997470 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76087d1a-22d3-4bdf-a15c-23c59dac9ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:08.997767 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76087d1a-22d3-4bdf-a15c-23c59dac9ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:08.998045 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76087d1a-22d3-4bdf-a15c-23c59dac9ff5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:08.998803 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76087d1a-22d3-4bdf-a15c-23c59dac9ff5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:43:08.999104 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76087d1a-22d3-4bdf-a15c-23c59dac9ff5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:09.000699 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76087d1a-22d3-4bdf-a15c-23c59dac9ff5 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:09.013355 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1255/2511] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:43:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:43:09.019508 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a352a28-c2b1-4d15-9334-3d11291fe9c1 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:09.029461 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a352a28-c2b1-4d15-9334-3d11291fe9c1 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:09.034620 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18e156-703b-47f7-826f-9a7ee69fc745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:09.035299 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18e156-703b-47f7-826f-9a7ee69fc745 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:09.035574 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18e156-703b-47f7-826f-9a7ee69fc745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:09.035837 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18e156-703b-47f7-826f-9a7ee69fc745 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:09.036538 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18e156-703b-47f7-826f-9a7ee69fc745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:09.038576 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18e156-703b-47f7-826f-9a7ee69fc745 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:09.067702 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1257/2512] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:43:09 2021] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:43:09.068965 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76087d1a-22d3-4bdf-a15c-23c59dac9ff5 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:09.080639 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76087d1a-22d3-4bdf-a15c-23c59dac9ff5 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:09.141650 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d8913-0d35-4710-85db-ec2aba416078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:09.143513 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d8913-0d35-4710-85db-ec2aba416078 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:09.143513 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d8913-0d35-4710-85db-ec2aba416078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:09.143868 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d8913-0d35-4710-85db-ec2aba416078 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:09.145187 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d8913-0d35-4710-85db-ec2aba416078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:09.146531 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d8913-0d35-4710-85db-ec2aba416078 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:09.170790 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1256/2513] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:43:09 2021] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:43:09.172994 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18e156-703b-47f7-826f-9a7ee69fc745 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:09.183361 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18e156-703b-47f7-826f-9a7ee69fc745 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:09.188688 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe19f0-0686-43e5-b15c-09f42c65acc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:09.189397 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe19f0-0686-43e5-b15c-09f42c65acc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:09.189678 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe19f0-0686-43e5-b15c-09f42c65acc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:09.189931 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe19f0-0686-43e5-b15c-09f42c65acc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:09.190853 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe19f0-0686-43e5-b15c-09f42c65acc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:09.192518 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe19f0-0686-43e5-b15c-09f42c65acc1 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:09.204542 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1258/2514] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:43:09 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:43:09.209037 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d8913-0d35-4710-85db-ec2aba416078 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:09.219126 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d8913-0d35-4710-85db-ec2aba416078 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:09.224926 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5d44d-a910-4d2a-a611-189f84dba359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:09.225583 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5d44d-a910-4d2a-a611-189f84dba359 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:09.225845 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5d44d-a910-4d2a-a611-189f84dba359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:09.226109 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5d44d-a910-4d2a-a611-189f84dba359 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:09.226909 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5d44d-a910-4d2a-a611-189f84dba359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:09.228548 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5d44d-a910-4d2a-a611-189f84dba359 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:09.239979 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1257/2515] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:43:09 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:43:09.244204 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe19f0-0686-43e5-b15c-09f42c65acc1 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:09.254551 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe19f0-0686-43e5-b15c-09f42c65acc1 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:09.259922 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bd27d-a00b-455f-a903-3448b4b72338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:09.260805 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bd27d-a00b-455f-a903-3448b4b72338 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:09.261079 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bd27d-a00b-455f-a903-3448b4b72338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:09.261351 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bd27d-a00b-455f-a903-3448b4b72338 admin admin] PATH_INFO: `/v3/projects/3c7c19b77a1a4fac81de8244c2a70247/users/dc0e283e89e34c2f8d20c60695f94f63/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:09.276967 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26bd27d-a00b-455f-a903-3448b4b72338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c7c19b77a1a4fac81de8244c2a70247, user_id=dc0e283e89e34c2f8d20c60695f94f63, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:09.279698 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26bd27d-a00b-455f-a903-3448b4b72338 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:09.298037 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1259/2516] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:43:09 2021] PUT /identity/v3/projects/3c7c19b77a1a4fac81de8244c2a70247/users/dc0e283e89e34c2f8d20c60695f94f63/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:43:09.305617 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f2e5c-1966-48df-b967-960afda3b67b None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:09.305973 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f2e5c-1966-48df-b967-960afda3b67b None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:09.306389 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f2e5c-1966-48df-b967-960afda3b67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:09.327477 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-6a8f2e5c-1966-48df-b967-960afda3b67b None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:43:09.328725 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-6a8f2e5c-1966-48df-b967-960afda3b67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:43:09.394391 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1258/2517] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:43:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:43:09.405267 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bd27d-a00b-455f-a903-3448b4b72338 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:09.408340 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-c26bd27d-a00b-455f-a903-3448b4b72338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:43:09.471013 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bd27d-a00b-455f-a903-3448b4b72338 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:09.475117 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231451d9-7581-4c7e-8747-20b65f068c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:09.475763 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231451d9-7581-4c7e-8747-20b65f068c05 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:09.476037 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231451d9-7581-4c7e-8747-20b65f068c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:09.476303 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231451d9-7581-4c7e-8747-20b65f068c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:09.485478 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231451d9-7581-4c7e-8747-20b65f068c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:09.486920 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231451d9-7581-4c7e-8747-20b65f068c05 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:09.496351 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1260/2518] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:43:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:43:13.566419 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc533d16-24e3-4f7e-984b-9c2d725d50a7 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:13.566942 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc533d16-24e3-4f7e-984b-9c2d725d50a7 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:13.567046 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc533d16-24e3-4f7e-984b-9c2d725d50a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:13.599360 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-fc533d16-24e3-4f7e-984b-9c2d725d50a7 None None] MFA Rules not processed for user `dc0e283e89e34c2f8d20c60695f94f63`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:43:13.600971 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-fc533d16-24e3-4f7e-984b-9c2d725d50a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:43:13.678967 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1259/2519] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:43:13 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:43:13.683628 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231451d9-7581-4c7e-8747-20b65f068c05 service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:13.693989 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231451d9-7581-4c7e-8747-20b65f068c05 service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:13.699824 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276dd11-2f24-4b9b-a406-4971f935117b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:13.700466 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276dd11-2f24-4b9b-a406-4971f935117b admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:13.700772 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276dd11-2f24-4b9b-a406-4971f935117b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:13.701039 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276dd11-2f24-4b9b-a406-4971f935117b admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:13.702329 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276dd11-2f24-4b9b-a406-4971f935117b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:13.704287 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276dd11-2f24-4b9b-a406-4971f935117b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:13.734342 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1261/2520] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:43:13 2021] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:43:13.738401 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc533d16-24e3-4f7e-984b-9c2d725d50a7 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:13.752315 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc533d16-24e3-4f7e-984b-9c2d725d50a7 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:13.836889 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3759123-88de-4063-aa04-b6ad58b966c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:13.837549 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3759123-88de-4063-aa04-b6ad58b966c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:13.837944 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3759123-88de-4063-aa04-b6ad58b966c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:13.838134 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3759123-88de-4063-aa04-b6ad58b966c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:13.840631 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3759123-88de-4063-aa04-b6ad58b966c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:13.843081 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3759123-88de-4063-aa04-b6ad58b966c8 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:13.866974 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1260/2521] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:43:13 2021] POST /identity/v3/users => generated 296 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:43:13.870925 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276dd11-2f24-4b9b-a406-4971f935117b admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:13.884136 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276dd11-2f24-4b9b-a406-4971f935117b admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:13.890093 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb82b7-6b95-4369-b069-31b1f0a15141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:13.891546 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb82b7-6b95-4369-b069-31b1f0a15141 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:13.898434 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb82b7-6b95-4369-b069-31b1f0a15141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:13.898940 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb82b7-6b95-4369-b069-31b1f0a15141 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:13.899917 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb82b7-6b95-4369-b069-31b1f0a15141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:13.901654 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb82b7-6b95-4369-b069-31b1f0a15141 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:13.925201 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1262/2522] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:43:13 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:43:13.928994 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3759123-88de-4063-aa04-b6ad58b966c8 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:13.940755 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3759123-88de-4063-aa04-b6ad58b966c8 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:13.947999 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53d484-6c7c-42a2-88cf-55d541533d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:13.948928 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53d484-6c7c-42a2-88cf-55d541533d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:13.949207 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53d484-6c7c-42a2-88cf-55d541533d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:13.949482 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53d484-6c7c-42a2-88cf-55d541533d6b admin admin] PATH_INFO: `/v3/projects/ce16b7567cea474c9b91b57964095f17/users/fd7c258bf79e4974abb03695fef3b317/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:13.967511 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53d484-6c7c-42a2-88cf-55d541533d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce16b7567cea474c9b91b57964095f17, user_id=fd7c258bf79e4974abb03695fef3b317, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:13.970391 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53d484-6c7c-42a2-88cf-55d541533d6b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:13.985525 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1261/2523] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:43:13 2021] PUT /identity/v3/projects/ce16b7567cea474c9b91b57964095f17/users/fd7c258bf79e4974abb03695fef3b317/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:43:13.989666 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb82b7-6b95-4369-b069-31b1f0a15141 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:14.000435 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb82b7-6b95-4369-b069-31b1f0a15141 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:14.064675 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d37611-177d-49c7-a62c-910ccbdc361b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:14.065432 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d37611-177d-49c7-a62c-910ccbdc361b admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:14.065717 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d37611-177d-49c7-a62c-910ccbdc361b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:14.065991 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d37611-177d-49c7-a62c-910ccbdc361b admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:14.066805 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d37611-177d-49c7-a62c-910ccbdc361b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:14.068427 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d37611-177d-49c7-a62c-910ccbdc361b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:14.078992 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1263/2524] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:43:13 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:43:14.083292 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53d484-6c7c-42a2-88cf-55d541533d6b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:14.094711 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53d484-6c7c-42a2-88cf-55d541533d6b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:14.099786 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3488606-f87e-4f94-89ef-0a62a3afd4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:14.100701 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3488606-f87e-4f94-89ef-0a62a3afd4fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:14.100975 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3488606-f87e-4f94-89ef-0a62a3afd4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:14.101245 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3488606-f87e-4f94-89ef-0a62a3afd4fa admin admin] PATH_INFO: `/v3/projects/ce16b7567cea474c9b91b57964095f17/users/fd7c258bf79e4974abb03695fef3b317/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:14.103308 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3488606-f87e-4f94-89ef-0a62a3afd4fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce16b7567cea474c9b91b57964095f17, user_id=fd7c258bf79e4974abb03695fef3b317, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:14.105991 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3488606-f87e-4f94-89ef-0a62a3afd4fa admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:14.117085 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1262/2525] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:43:14 2021] PUT /identity/v3/projects/ce16b7567cea474c9b91b57964095f17/users/fd7c258bf79e4974abb03695fef3b317/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:43:19.301661 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92830b0-a653-4d02-a798-812f7ade2485 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:19.302177 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92830b0-a653-4d02-a798-812f7ade2485 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:19.302177 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92830b0-a653-4d02-a798-812f7ade2485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:19.332111 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-e92830b0-a653-4d02-a798-812f7ade2485 None None] MFA Rules not processed for user `fd7c258bf79e4974abb03695fef3b317`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:43:19.333489 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-e92830b0-a653-4d02-a798-812f7ade2485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:43:19.415083 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1264/2526] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:43:19 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:43:19.424194 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3488606-f87e-4f94-89ef-0a62a3afd4fa admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:19.427178 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-f3488606-f87e-4f94-89ef-0a62a3afd4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:43:19.511521 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3488606-f87e-4f94-89ef-0a62a3afd4fa admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:19.517117 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa88a9-ce56-4af5-aa96-05668e83e8d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:19.517775 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa88a9-ce56-4af5-aa96-05668e83e8d3 service nova] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:19.518411 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa88a9-ce56-4af5-aa96-05668e83e8d3 service nova] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:19.518717 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa88a9-ce56-4af5-aa96-05668e83e8d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:19.577755 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa88a9-ce56-4af5-aa96-05668e83e8d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:19.581350 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa88a9-ce56-4af5-aa96-05668e83e8d3 service nova] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:19.599914 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1263/2527] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:43:19 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:43:34.517466 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c74f4-9f9b-4092-9661-f03588e359ea None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:34.517960 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c74f4-9f9b-4092-9661-f03588e359ea None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:34.518159 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c74f4-9f9b-4092-9661-f03588e359ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:34.537088 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-8a9c74f4-9f9b-4092-9661-f03588e359ea None None] MFA Rules not processed for user `62cc0165aee14b449c8a49233001f631`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:43:34.538291 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-8a9c74f4-9f9b-4092-9661-f03588e359ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:43:34.601074 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1265/2528] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Oct 28 14:43:34 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:43:34.614108 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa88a9-ce56-4af5-aa96-05668e83e8d3 service nova] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:34.615587 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e2fa88a9-ce56-4af5-aa96-05668e83e8d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:43:34.692249 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa88a9-ce56-4af5-aa96-05668e83e8d3 service nova] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:34.697949 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b5dbe-aee4-4865-b35d-1a9f02e06c96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889e7be1dcaf47f599af9c9b7ad33042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:34.698597 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b5dbe-aee4-4865-b35d-1a9f02e06c96 service swift] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:34.698899 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b5dbe-aee4-4865-b35d-1a9f02e06c96 service swift] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:34.699176 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b5dbe-aee4-4865-b35d-1a9f02e06c96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:34.709144 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b5dbe-aee4-4865-b35d-1a9f02e06c96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:34.711858 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b5dbe-aee4-4865-b35d-1a9f02e06c96 service swift] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:34.724625 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1264/2529] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Oct 28 14:43:34 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 14:43:39.574489 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9800d-f5b9-49ff-b697-bc49b7817f36 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:39.575163 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9800d-f5b9-49ff-b697-bc49b7817f36 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:39.575163 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9800d-f5b9-49ff-b697-bc49b7817f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:39.597053 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-e4e9800d-f5b9-49ff-b697-bc49b7817f36 None None] MFA Rules not processed for user `dc0e283e89e34c2f8d20c60695f94f63`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:43:39.598713 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-e4e9800d-f5b9-49ff-b697-bc49b7817f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:43:39.607079 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1266/2530] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:43:39 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:43:51.004199 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b5dbe-aee4-4865-b35d-1a9f02e06c96 service swift] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:51.006448 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-717b5dbe-aee4-4865-b35d-1a9f02e06c96 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:43:51.068172 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b5dbe-aee4-4865-b35d-1a9f02e06c96 service swift] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:51.071827 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba06eb-b317-4960-b178-efa6257c5197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:51.072496 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba06eb-b317-4960-b178-efa6257c5197 service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:51.072769 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba06eb-b317-4960-b178-efa6257c5197 service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:51.073658 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba06eb-b317-4960-b178-efa6257c5197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:51.075483 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-adba06eb-b317-4960-b178-efa6257c5197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:43:51.136735 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba06eb-b317-4960-b178-efa6257c5197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:51.138912 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba06eb-b317-4960-b178-efa6257c5197 service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:51.149151 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1265/2531] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:43:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:43:52.303488 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abc7a2-e128-49e6-aec0-e5ab95eab2d9 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:52.304008 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abc7a2-e128-49e6-aec0-e5ab95eab2d9 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:52.304105 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abc7a2-e128-49e6-aec0-e5ab95eab2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:52.322078 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-23abc7a2-e128-49e6-aec0-e5ab95eab2d9 None None] MFA Rules not processed for user `62cc0165aee14b449c8a49233001f631`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:43:52.323238 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-23abc7a2-e128-49e6-aec0-e5ab95eab2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:43:52.330536 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1267/2532] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Oct 28 14:43:52 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:43:52.354235 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba06eb-b317-4960-b178-efa6257c5197 service neutron] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:52.369897 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba06eb-b317-4960-b178-efa6257c5197 service neutron] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:52.378228 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24450b-7028-4541-8576-03c2d8c18dbd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889e7be1dcaf47f599af9c9b7ad33042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:52.379296 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24450b-7028-4541-8576-03c2d8c18dbd service swift] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:52.379750 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24450b-7028-4541-8576-03c2d8c18dbd service swift] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:52.380242 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24450b-7028-4541-8576-03c2d8c18dbd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:52.391404 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24450b-7028-4541-8576-03c2d8c18dbd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:52.393551 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24450b-7028-4541-8576-03c2d8c18dbd service swift] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:52.417140 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1266/2533] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Oct 28 14:43:52 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 14:43:55.503052 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abc7a2-e128-49e6-aec0-e5ab95eab2d9 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:55.504514 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-23abc7a2-e128-49e6-aec0-e5ab95eab2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:43:55.524439 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abc7a2-e128-49e6-aec0-e5ab95eab2d9 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:55.541750 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a89e7e-31ba-4d25-9297-eb7b104566ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:55.542670 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a89e7e-31ba-4d25-9297-eb7b104566ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:55.542990 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a89e7e-31ba-4d25-9297-eb7b104566ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:55.543260 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a89e7e-31ba-4d25-9297-eb7b104566ff admin admin] PATH_INFO: `/v3/users/fb71aef5ce61461b9c92f8bf4869af1d` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:55.544689 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a89e7e-31ba-4d25-9297-eb7b104566ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb71aef5ce61461b9c92f8bf4869af1d)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:55.546589 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a89e7e-31ba-4d25-9297-eb7b104566ff admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:55.607240 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-55a89e7e-31ba-4d25-9297-eb7b104566ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb71aef5ce61461b9c92f8bf4869af1d'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:43:55.615919 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-55a89e7e-31ba-4d25-9297-eb7b104566ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb71aef5ce61461b9c92f8bf4869af1d'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:43:55.616648 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-55a89e7e-31ba-4d25-9297-eb7b104566ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb71aef5ce61461b9c92f8bf4869af1d'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:43:55.628477 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-55a89e7e-31ba-4d25-9297-eb7b104566ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb71aef5ce61461b9c92f8bf4869af1d'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:43:55.635561 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-55a89e7e-31ba-4d25-9297-eb7b104566ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb71aef5ce61461b9c92f8bf4869af1d'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:43:55.641623 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1268/2534] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:43:55 2021] DELETE /identity/v3/users/fb71aef5ce61461b9c92f8bf4869af1d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:43:55.843078 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24450b-7028-4541-8576-03c2d8c18dbd service swift] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:55.863327 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24450b-7028-4541-8576-03c2d8c18dbd service swift] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:55.935849 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccf810-e351-4b81-9626-ac29319d633e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:55.937187 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccf810-e351-4b81-9626-ac29319d633e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:55.937611 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccf810-e351-4b81-9626-ac29319d633e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:55.937917 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccf810-e351-4b81-9626-ac29319d633e admin admin] PATH_INFO: `/v3/projects/9e334a6e70ac4c2a882f287ce31d287e` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:55.939317 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccf810-e351-4b81-9626-ac29319d633e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e334a6e70ac4c2a882f287ce31d287e)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:55.941283 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccf810-e351-4b81-9626-ac29319d633e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:55.990851 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-4bccf810-e351-4b81-9626-ac29319d633e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e334a6e70ac4c2a882f287ce31d287e', 'request_id': 'req-4bccf810-e351-4b81-9626-ac29319d633e'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:43:55.998663 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-4bccf810-e351-4b81-9626-ac29319d633e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e334a6e70ac4c2a882f287ce31d287e', 'request_id': 'req-4bccf810-e351-4b81-9626-ac29319d633e'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:43:56.008202 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-4bccf810-e351-4b81-9626-ac29319d633e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e334a6e70ac4c2a882f287ce31d287e', 'request_id': 'req-4bccf810-e351-4b81-9626-ac29319d633e'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:43:56.019222 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-4bccf810-e351-4b81-9626-ac29319d633e admin admin] The token cache is being invalidate because project 9e334a6e70ac4c2a882f287ce31d287e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:43:56.019426 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-4bccf810-e351-4b81-9626-ac29319d633e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:43:56.020075 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-4bccf810-e351-4b81-9626-ac29319d633e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:43:56.022212 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1267/2535] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:43:55 2021] DELETE /identity/v3/projects/9e334a6e70ac4c2a882f287ce31d287e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:43:56.027914 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddab23c-64f5-4d5d-811c-76678a4ecc1f None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:56.028267 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddab23c-64f5-4d5d-811c-76678a4ecc1f None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:56.028630 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddab23c-64f5-4d5d-811c-76678a4ecc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:56.049539 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-fddab23c-64f5-4d5d-811c-76678a4ecc1f None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:43:56.051113 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-fddab23c-64f5-4d5d-811c-76678a4ecc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:43:56.124200 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1269/2536] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:43:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:43:56.133082 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef068be-aa97-4718-9493-cffa3303bd4c None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:56.133389 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef068be-aa97-4718-9493-cffa3303bd4c None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:56.133669 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef068be-aa97-4718-9493-cffa3303bd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:56.154169 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-7ef068be-aa97-4718-9493-cffa3303bd4c None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:43:56.155506 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-7ef068be-aa97-4718-9493-cffa3303bd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:43:56.164602 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1268/2537] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:43:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:43:56.168877 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddab23c-64f5-4d5d-811c-76678a4ecc1f None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:56.181133 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddab23c-64f5-4d5d-811c-76678a4ecc1f None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:56.186756 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e79e3-1290-425f-96d6-9fd83ab65f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:56.187425 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e79e3-1290-425f-96d6-9fd83ab65f02 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:56.187705 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e79e3-1290-425f-96d6-9fd83ab65f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:56.187989 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e79e3-1290-425f-96d6-9fd83ab65f02 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:56.188744 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e79e3-1290-425f-96d6-9fd83ab65f02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:43:56.189048 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e79e3-1290-425f-96d6-9fd83ab65f02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:56.190653 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e79e3-1290-425f-96d6-9fd83ab65f02 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:56.205348 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1270/2538] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:43:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:43:56.209882 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef068be-aa97-4718-9493-cffa3303bd4c None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:56.219687 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef068be-aa97-4718-9493-cffa3303bd4c None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:56.224760 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a4ea5-8401-45ba-a19e-4aec4435f2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:56.225451 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a4ea5-8401-45ba-a19e-4aec4435f2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:56.225828 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a4ea5-8401-45ba-a19e-4aec4435f2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:56.226096 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a4ea5-8401-45ba-a19e-4aec4435f2f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:56.226876 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a4ea5-8401-45ba-a19e-4aec4435f2f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:56.228942 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a4ea5-8401-45ba-a19e-4aec4435f2f4 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:56.268533 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1269/2539] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:43:56 2021] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:43:56.273257 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e79e3-1290-425f-96d6-9fd83ab65f02 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:56.283397 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e79e3-1290-425f-96d6-9fd83ab65f02 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:56.344990 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f9ee9-ce07-41d3-8a5f-3fdbf9afd176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:56.345783 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f9ee9-ce07-41d3-8a5f-3fdbf9afd176 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:56.346092 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f9ee9-ce07-41d3-8a5f-3fdbf9afd176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:56.346360 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f9ee9-ce07-41d3-8a5f-3fdbf9afd176 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:56.347119 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f9ee9-ce07-41d3-8a5f-3fdbf9afd176 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:56.349072 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f9ee9-ce07-41d3-8a5f-3fdbf9afd176 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:56.376516 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1271/2540] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:43:56 2021] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:43:56.377782 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a4ea5-8401-45ba-a19e-4aec4435f2f4 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:56.389085 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a4ea5-8401-45ba-a19e-4aec4435f2f4 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:56.397387 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cac19-b625-4397-b397-55b2e4bdbf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:56.398141 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cac19-b625-4397-b397-55b2e4bdbf37 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:56.399201 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cac19-b625-4397-b397-55b2e4bdbf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:56.399201 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cac19-b625-4397-b397-55b2e4bdbf37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:56.399522 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533cac19-b625-4397-b397-55b2e4bdbf37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:56.401159 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533cac19-b625-4397-b397-55b2e4bdbf37 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:56.415400 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1270/2541] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:43:56 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:43:56.416615 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f9ee9-ce07-41d3-8a5f-3fdbf9afd176 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:56.427620 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f9ee9-ce07-41d3-8a5f-3fdbf9afd176 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:56.432397 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d5847-f597-4d00-81e5-e28c764df72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:56.433093 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d5847-f597-4d00-81e5-e28c764df72a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:56.433358 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d5847-f597-4d00-81e5-e28c764df72a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:56.433660 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d5847-f597-4d00-81e5-e28c764df72a admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:56.434375 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d5847-f597-4d00-81e5-e28c764df72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:56.436079 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d5847-f597-4d00-81e5-e28c764df72a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:56.446843 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1272/2542] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:43:56 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:43:56.451121 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cac19-b625-4397-b397-55b2e4bdbf37 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:56.462569 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cac19-b625-4397-b397-55b2e4bdbf37 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:56.468068 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77960f7-1aff-4b1a-9a25-fb88689acb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:56.468987 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77960f7-1aff-4b1a-9a25-fb88689acb1e admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:56.469269 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77960f7-1aff-4b1a-9a25-fb88689acb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:56.469546 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77960f7-1aff-4b1a-9a25-fb88689acb1e admin admin] PATH_INFO: `/v3/projects/48002e3d35c5470680adadc8bfaa70f0/users/4ce24f6b1f6e46f285c9d0debd7b3369/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:56.487273 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77960f7-1aff-4b1a-9a25-fb88689acb1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=48002e3d35c5470680adadc8bfaa70f0, user_id=4ce24f6b1f6e46f285c9d0debd7b3369, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:56.489979 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77960f7-1aff-4b1a-9a25-fb88689acb1e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:56.505431 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1271/2543] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:43:56 2021] PUT /identity/v3/projects/48002e3d35c5470680adadc8bfaa70f0/users/4ce24f6b1f6e46f285c9d0debd7b3369/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:43:56.516140 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665307b-316b-4cbc-9344-d00d92f4650b None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:56.516687 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665307b-316b-4cbc-9344-d00d92f4650b None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:56.516687 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665307b-316b-4cbc-9344-d00d92f4650b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:56.544724 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-5665307b-316b-4cbc-9344-d00d92f4650b None None] MFA Rules not processed for user `4ce24f6b1f6e46f285c9d0debd7b3369`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:43:56.545890 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-5665307b-316b-4cbc-9344-d00d92f4650b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:43:56.657558 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1273/2544] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:43:56 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:43:56.855935 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77960f7-1aff-4b1a-9a25-fb88689acb1e admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:56.857813 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-a77960f7-1aff-4b1a-9a25-fb88689acb1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:43:56.932973 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77960f7-1aff-4b1a-9a25-fb88689acb1e admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:56.939001 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb629de-7dba-4449-9a59-2db0663f9a0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:56.939778 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb629de-7dba-4449-9a59-2db0663f9a0f service nova] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:56.940059 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb629de-7dba-4449-9a59-2db0663f9a0f service nova] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:56.940347 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb629de-7dba-4449-9a59-2db0663f9a0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:56.949218 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb629de-7dba-4449-9a59-2db0663f9a0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:56.958879 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb629de-7dba-4449-9a59-2db0663f9a0f service nova] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:56.966282 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1272/2545] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:43:56 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:43:59.661801 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665307b-316b-4cbc-9344-d00d92f4650b None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:59.726384 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665307b-316b-4cbc-9344-d00d92f4650b None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:59.731276 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313bbab-4404-426d-a376-afce10c5d888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:59.732161 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313bbab-4404-426d-a376-afce10c5d888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:59.733427 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313bbab-4404-426d-a376-afce10c5d888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:59.733701 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313bbab-4404-426d-a376-afce10c5d888 admin admin] PATH_INFO: `/v3/users/4ce24f6b1f6e46f285c9d0debd7b3369` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:59.735157 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313bbab-4404-426d-a376-afce10c5d888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ce24f6b1f6e46f285c9d0debd7b3369)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:43:59.737110 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313bbab-4404-426d-a376-afce10c5d888 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:43:59.785013 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-3313bbab-4404-426d-a376-afce10c5d888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ce24f6b1f6e46f285c9d0debd7b3369'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:43:59.796094 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-3313bbab-4404-426d-a376-afce10c5d888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ce24f6b1f6e46f285c9d0debd7b3369'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:43:59.796729 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-3313bbab-4404-426d-a376-afce10c5d888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ce24f6b1f6e46f285c9d0debd7b3369'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:43:59.808806 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-3313bbab-4404-426d-a376-afce10c5d888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ce24f6b1f6e46f285c9d0debd7b3369'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:43:59.815579 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-3313bbab-4404-426d-a376-afce10c5d888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ce24f6b1f6e46f285c9d0debd7b3369'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:43:59.822062 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1274/2546] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:43:59 2021] DELETE /identity/v3/users/4ce24f6b1f6e46f285c9d0debd7b3369 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:43:59.826573 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026a099-85df-45c2-ad3b-fcb87e065b20 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:59.827158 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026a099-85df-45c2-ad3b-fcb87e065b20 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:59.827158 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026a099-85df-45c2-ad3b-fcb87e065b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:43:59.844512 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-4026a099-85df-45c2-ad3b-fcb87e065b20 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:43:59.845695 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-4026a099-85df-45c2-ad3b-fcb87e065b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:43:59.916326 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1273/2547] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:43:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:43:59.927979 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313bbab-4404-426d-a376-afce10c5d888 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:43:59.929592 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-3313bbab-4404-426d-a376-afce10c5d888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:43:59.986789 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313bbab-4404-426d-a376-afce10c5d888 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:43:59.990557 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043b433-dc63-4eaa-9527-519198bc9f02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:43:59.991249 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043b433-dc63-4eaa-9527-519198bc9f02 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:43:59.991659 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043b433-dc63-4eaa-9527-519198bc9f02 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:43:59.991934 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043b433-dc63-4eaa-9527-519198bc9f02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:00.002086 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043b433-dc63-4eaa-9527-519198bc9f02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:00.003614 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043b433-dc63-4eaa-9527-519198bc9f02 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:00.013758 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1275/2548] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:43:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:44:00.325374 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026a099-85df-45c2-ad3b-fcb87e065b20 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:00.326917 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-4026a099-85df-45c2-ad3b-fcb87e065b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:00.347399 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026a099-85df-45c2-ad3b-fcb87e065b20 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:00.353709 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81afd7-d916-4998-af91-787b9dbf3cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:00.354670 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81afd7-d916-4998-af91-787b9dbf3cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:00.355039 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81afd7-d916-4998-af91-787b9dbf3cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:00.355401 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81afd7-d916-4998-af91-787b9dbf3cb1 admin admin] PATH_INFO: `/v3/projects/48002e3d35c5470680adadc8bfaa70f0` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:00.356707 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81afd7-d916-4998-af91-787b9dbf3cb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48002e3d35c5470680adadc8bfaa70f0)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:00.359115 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81afd7-d916-4998-af91-787b9dbf3cb1 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:00.433633 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cf81afd7-d916-4998-af91-787b9dbf3cb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48002e3d35c5470680adadc8bfaa70f0', 'request_id': 'req-cf81afd7-d916-4998-af91-787b9dbf3cb1'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:00.440780 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cf81afd7-d916-4998-af91-787b9dbf3cb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48002e3d35c5470680adadc8bfaa70f0', 'request_id': 'req-cf81afd7-d916-4998-af91-787b9dbf3cb1'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:00.450136 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cf81afd7-d916-4998-af91-787b9dbf3cb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48002e3d35c5470680adadc8bfaa70f0', 'request_id': 'req-cf81afd7-d916-4998-af91-787b9dbf3cb1'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:00.461865 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cf81afd7-d916-4998-af91-787b9dbf3cb1 admin admin] The token cache is being invalidate because project 48002e3d35c5470680adadc8bfaa70f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:44:00.462239 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cf81afd7-d916-4998-af91-787b9dbf3cb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:00.462822 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cf81afd7-d916-4998-af91-787b9dbf3cb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:00.464458 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1274/2549] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:44:00 2021] DELETE /identity/v3/projects/48002e3d35c5470680adadc8bfaa70f0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:44:00.470432 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee8ce1-93f3-4dd6-a441-c4a3daf39b44 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:00.470916 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee8ce1-93f3-4dd6-a441-c4a3daf39b44 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:00.471047 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee8ce1-93f3-4dd6-a441-c4a3daf39b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:00.491931 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-47ee8ce1-93f3-4dd6-a441-c4a3daf39b44 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:44:00.493477 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-47ee8ce1-93f3-4dd6-a441-c4a3daf39b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:00.556972 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1276/2550] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:44:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:44:00.565061 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862db6a-f127-428f-af03-0fc3b5536194 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:00.565393 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862db6a-f127-428f-af03-0fc3b5536194 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:00.565617 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862db6a-f127-428f-af03-0fc3b5536194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:00.603686 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-7862db6a-f127-428f-af03-0fc3b5536194 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:44:00.604914 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-7862db6a-f127-428f-af03-0fc3b5536194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:00.626602 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1275/2551] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:44:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:44:00.630954 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee8ce1-93f3-4dd6-a441-c4a3daf39b44 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:00.641055 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee8ce1-93f3-4dd6-a441-c4a3daf39b44 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:00.646198 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01fa36a-3cfa-46e4-bb8a-750c9d198e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:00.647005 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fa36a-3cfa-46e4-bb8a-750c9d198e66 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:00.647282 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fa36a-3cfa-46e4-bb8a-750c9d198e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:00.647553 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fa36a-3cfa-46e4-bb8a-750c9d198e66 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:00.648298 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01fa36a-3cfa-46e4-bb8a-750c9d198e66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:44:00.648606 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01fa36a-3cfa-46e4-bb8a-750c9d198e66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:00.650206 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01fa36a-3cfa-46e4-bb8a-750c9d198e66 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:00.662738 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1277/2552] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:44:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:44:00.667564 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862db6a-f127-428f-af03-0fc3b5536194 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:00.677284 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862db6a-f127-428f-af03-0fc3b5536194 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:00.682309 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73201a1b-1e23-4185-b713-cab9401231aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:00.683019 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73201a1b-1e23-4185-b713-cab9401231aa admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:00.683296 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73201a1b-1e23-4185-b713-cab9401231aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:00.683563 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73201a1b-1e23-4185-b713-cab9401231aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:00.684284 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73201a1b-1e23-4185-b713-cab9401231aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:00.686484 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73201a1b-1e23-4185-b713-cab9401231aa admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:00.714042 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1276/2553] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:44:00 2021] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:44:00.718187 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01fa36a-3cfa-46e4-bb8a-750c9d198e66 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:00.728568 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01fa36a-3cfa-46e4-bb8a-750c9d198e66 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:00.785501 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc691db-16ce-4ad5-b49e-94fa10529885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:00.786192 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc691db-16ce-4ad5-b49e-94fa10529885 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:00.786470 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc691db-16ce-4ad5-b49e-94fa10529885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:00.786771 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc691db-16ce-4ad5-b49e-94fa10529885 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:00.787543 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc691db-16ce-4ad5-b49e-94fa10529885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:00.789777 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc691db-16ce-4ad5-b49e-94fa10529885 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:00.813827 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1278/2554] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:44:00 2021] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:44:00.815266 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73201a1b-1e23-4185-b713-cab9401231aa admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:00.826754 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73201a1b-1e23-4185-b713-cab9401231aa admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:00.831816 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581df0a-5d87-48c7-9ae7-b1ac3b6c8f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:00.832510 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581df0a-5d87-48c7-9ae7-b1ac3b6c8f01 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:00.832786 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581df0a-5d87-48c7-9ae7-b1ac3b6c8f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:00.833077 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581df0a-5d87-48c7-9ae7-b1ac3b6c8f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:00.833820 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581df0a-5d87-48c7-9ae7-b1ac3b6c8f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:00.835460 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581df0a-5d87-48c7-9ae7-b1ac3b6c8f01 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:00.846315 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1277/2555] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:44:00 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:44:00.850303 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc691db-16ce-4ad5-b49e-94fa10529885 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:00.860990 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc691db-16ce-4ad5-b49e-94fa10529885 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:00.866511 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eebbff-93e3-4719-9e78-dbc03fed3272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:00.867223 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eebbff-93e3-4719-9e78-dbc03fed3272 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:00.867496 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eebbff-93e3-4719-9e78-dbc03fed3272 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:00.867760 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eebbff-93e3-4719-9e78-dbc03fed3272 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:00.868499 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eebbff-93e3-4719-9e78-dbc03fed3272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:00.870101 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eebbff-93e3-4719-9e78-dbc03fed3272 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:00.881138 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1279/2556] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:44:00 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:44:00.885266 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581df0a-5d87-48c7-9ae7-b1ac3b6c8f01 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:00.896123 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581df0a-5d87-48c7-9ae7-b1ac3b6c8f01 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:00.901957 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce4e10-6be9-49a3-b154-be2445e3e4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:00.902958 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce4e10-6be9-49a3-b154-be2445e3e4f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:00.903236 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce4e10-6be9-49a3-b154-be2445e3e4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:00.903506 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce4e10-6be9-49a3-b154-be2445e3e4f3 admin admin] PATH_INFO: `/v3/projects/18ed8380b0154c65a757c031d1046956/users/ee62828f880f411eade5873604d5383f/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:00.928073 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce4e10-6be9-49a3-b154-be2445e3e4f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18ed8380b0154c65a757c031d1046956, user_id=ee62828f880f411eade5873604d5383f, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:00.930789 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce4e10-6be9-49a3-b154-be2445e3e4f3 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:00.947312 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1278/2557] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:44:00 2021] PUT /identity/v3/projects/18ed8380b0154c65a757c031d1046956/users/ee62828f880f411eade5873604d5383f/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:44:00.960192 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbb0a2-1c1c-4550-b84c-2840aeb39cc2 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:00.960479 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbb0a2-1c1c-4550-b84c-2840aeb39cc2 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:00.960753 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbb0a2-1c1c-4550-b84c-2840aeb39cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:00.990759 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-a7dbb0a2-1c1c-4550-b84c-2840aeb39cc2 None None] MFA Rules not processed for user `ee62828f880f411eade5873604d5383f`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:44:00.992053 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a7dbb0a2-1c1c-4550-b84c-2840aeb39cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:01.064199 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1280/2558] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:44:00 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:44:01.068958 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce4e10-6be9-49a3-b154-be2445e3e4f3 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:01.135027 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce4e10-6be9-49a3-b154-be2445e3e4f3 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:01.139995 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b2fb0-487b-4244-87a6-ddc3784f84cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:01.140698 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b2fb0-487b-4244-87a6-ddc3784f84cb admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:01.140988 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b2fb0-487b-4244-87a6-ddc3784f84cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:01.141259 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b2fb0-487b-4244-87a6-ddc3784f84cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:01.141998 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b2fb0-487b-4244-87a6-ddc3784f84cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:01.143946 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b2fb0-487b-4244-87a6-ddc3784f84cb admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:01.174816 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1279/2559] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:44:01 2021] POST /identity/v3/projects => generated 363 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:44:01.179052 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbb0a2-1c1c-4550-b84c-2840aeb39cc2 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:01.190627 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbb0a2-1c1c-4550-b84c-2840aeb39cc2 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:01.252797 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910269e-6dba-436e-ac6e-2da422cf68bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:01.253405 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910269e-6dba-436e-ac6e-2da422cf68bd admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:01.253672 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910269e-6dba-436e-ac6e-2da422cf68bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:01.253934 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910269e-6dba-436e-ac6e-2da422cf68bd admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:01.254640 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910269e-6dba-436e-ac6e-2da422cf68bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:01.256583 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910269e-6dba-436e-ac6e-2da422cf68bd admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:01.277985 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1281/2560] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:44:01 2021] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:44:01.281931 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b2fb0-487b-4244-87a6-ddc3784f84cb admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:01.292855 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b2fb0-487b-4244-87a6-ddc3784f84cb admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:01.299781 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870b110-1e35-437d-8b37-a2470a135965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:01.300432 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870b110-1e35-437d-8b37-a2470a135965 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:01.300708 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870b110-1e35-437d-8b37-a2470a135965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:01.301000 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870b110-1e35-437d-8b37-a2470a135965 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:01.301752 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870b110-1e35-437d-8b37-a2470a135965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:01.303403 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870b110-1e35-437d-8b37-a2470a135965 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:01.315242 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1280/2561] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:44:01 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:44:01.319499 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910269e-6dba-436e-ac6e-2da422cf68bd admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:01.329916 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910269e-6dba-436e-ac6e-2da422cf68bd admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:01.334961 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac487e-9c78-4d12-b33d-5701bbc3142d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:01.335912 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac487e-9c78-4d12-b33d-5701bbc3142d admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:01.336126 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac487e-9c78-4d12-b33d-5701bbc3142d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:01.336407 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac487e-9c78-4d12-b33d-5701bbc3142d admin admin] PATH_INFO: `/v3/projects/057e629039c244a39b23e502c7c4f8d6/users/253bdfa8653c42b9b3f981f0a101edd0/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:01.352094 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac487e-9c78-4d12-b33d-5701bbc3142d admin admin] RBAC: Authorizing `identity:create_grant(project_id=057e629039c244a39b23e502c7c4f8d6, user_id=253bdfa8653c42b9b3f981f0a101edd0, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:01.356711 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac487e-9c78-4d12-b33d-5701bbc3142d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:01.370956 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1282/2562] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:44:01 2021] PUT /identity/v3/projects/057e629039c244a39b23e502c7c4f8d6/users/253bdfa8653c42b9b3f981f0a101edd0/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:44:01.375369 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870b110-1e35-437d-8b37-a2470a135965 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:01.385712 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870b110-1e35-437d-8b37-a2470a135965 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:01.445995 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754217d9-5e87-431c-b9bf-52597fdde6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:01.446791 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754217d9-5e87-431c-b9bf-52597fdde6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:01.447138 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754217d9-5e87-431c-b9bf-52597fdde6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:01.447478 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754217d9-5e87-431c-b9bf-52597fdde6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:01.448357 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754217d9-5e87-431c-b9bf-52597fdde6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:01.449972 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754217d9-5e87-431c-b9bf-52597fdde6a0 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:01.460866 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1281/2563] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:44:01 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:44:01.465390 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac487e-9c78-4d12-b33d-5701bbc3142d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:01.476005 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac487e-9c78-4d12-b33d-5701bbc3142d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:01.480945 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f310b2-014f-415b-8356-e533465e1747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:01.481846 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f310b2-014f-415b-8356-e533465e1747 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:01.482125 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f310b2-014f-415b-8356-e533465e1747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:01.482397 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f310b2-014f-415b-8356-e533465e1747 admin admin] PATH_INFO: `/v3/projects/057e629039c244a39b23e502c7c4f8d6/users/253bdfa8653c42b9b3f981f0a101edd0/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:01.484627 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f310b2-014f-415b-8356-e533465e1747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=057e629039c244a39b23e502c7c4f8d6, user_id=253bdfa8653c42b9b3f981f0a101edd0, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:01.487347 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f310b2-014f-415b-8356-e533465e1747 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:01.498608 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1283/2564] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:44:01 2021] PUT /identity/v3/projects/057e629039c244a39b23e502c7c4f8d6/users/253bdfa8653c42b9b3f981f0a101edd0/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:44:01.509443 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9a12b-8a28-4ae7-b7ca-3879577258c4 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:01.509653 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9a12b-8a28-4ae7-b7ca-3879577258c4 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:01.509893 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9a12b-8a28-4ae7-b7ca-3879577258c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:01.538572 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-abf9a12b-8a28-4ae7-b7ca-3879577258c4 None None] MFA Rules not processed for user `253bdfa8653c42b9b3f981f0a101edd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:44:01.539844 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-abf9a12b-8a28-4ae7-b7ca-3879577258c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:01.611699 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1282/2565] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:44:01 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:44:01.621867 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f310b2-014f-415b-8356-e533465e1747 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:01.630935 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-42f310b2-014f-415b-8356-e533465e1747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:01.711691 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f310b2-014f-415b-8356-e533465e1747 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:01.715415 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce6553-e93f-4b29-9868-9493ba2647a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:01.716090 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce6553-e93f-4b29-9868-9493ba2647a9 service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:01.716393 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce6553-e93f-4b29-9868-9493ba2647a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:01.716664 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce6553-e93f-4b29-9868-9493ba2647a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:01.726934 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce6553-e93f-4b29-9868-9493ba2647a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:01.728429 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce6553-e93f-4b29-9868-9493ba2647a9 service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:01.739178 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1284/2566] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:44:01 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:44:01.817224 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9a12b-8a28-4ae7-b7ca-3879577258c4 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:01.829571 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9a12b-8a28-4ae7-b7ca-3879577258c4 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:01.834488 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b058e-932b-4f7b-9b17-6bb4e78b580c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:01.835256 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b058e-932b-4f7b-9b17-6bb4e78b580c service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:01.835807 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b058e-932b-4f7b-9b17-6bb4e78b580c service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:01.836245 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b058e-932b-4f7b-9b17-6bb4e78b580c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:01.901183 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b058e-932b-4f7b-9b17-6bb4e78b580c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:01.902712 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b058e-932b-4f7b-9b17-6bb4e78b580c service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:01.912504 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1283/2567] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:44:01 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:44:04.630926 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce6553-e93f-4b29-9868-9493ba2647a9 service cinder] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:04.693965 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce6553-e93f-4b29-9868-9493ba2647a9 service cinder] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:04.698647 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2892399-0e87-4f18-a11a-dbddee27a9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:04.699540 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2892399-0e87-4f18-a11a-dbddee27a9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:04.699809 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2892399-0e87-4f18-a11a-dbddee27a9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:04.700061 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2892399-0e87-4f18-a11a-dbddee27a9ff admin admin] PATH_INFO: `/v3/users/ee62828f880f411eade5873604d5383f` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:04.701271 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2892399-0e87-4f18-a11a-dbddee27a9ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee62828f880f411eade5873604d5383f)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:04.704315 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2892399-0e87-4f18-a11a-dbddee27a9ff admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:04.753947 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c2892399-0e87-4f18-a11a-dbddee27a9ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee62828f880f411eade5873604d5383f'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:04.763584 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c2892399-0e87-4f18-a11a-dbddee27a9ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee62828f880f411eade5873604d5383f'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:04.764333 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c2892399-0e87-4f18-a11a-dbddee27a9ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee62828f880f411eade5873604d5383f'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:04.776794 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c2892399-0e87-4f18-a11a-dbddee27a9ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee62828f880f411eade5873604d5383f'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:04.783380 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-c2892399-0e87-4f18-a11a-dbddee27a9ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee62828f880f411eade5873604d5383f'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:04.790265 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1285/2568] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:44:04 2021] DELETE /identity/v3/users/ee62828f880f411eade5873604d5383f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:44:04.795967 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead666a-c1f6-4489-82e9-ca2d42634b01 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:04.796537 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead666a-c1f6-4489-82e9-ca2d42634b01 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:04.796648 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead666a-c1f6-4489-82e9-ca2d42634b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:04.815555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-5ead666a-c1f6-4489-82e9-ca2d42634b01 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:44:04.816750 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-5ead666a-c1f6-4489-82e9-ca2d42634b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:04.873483 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1284/2569] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:44:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:44:04.886852 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2892399-0e87-4f18-a11a-dbddee27a9ff admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:04.888502 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-c2892399-0e87-4f18-a11a-dbddee27a9ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:04.949421 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2892399-0e87-4f18-a11a-dbddee27a9ff admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:04.953886 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0200a9b-8c87-4567-8aaa-dcec2bca7367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:04.954548 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0200a9b-8c87-4567-8aaa-dcec2bca7367 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:04.954864 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0200a9b-8c87-4567-8aaa-dcec2bca7367 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:04.955131 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0200a9b-8c87-4567-8aaa-dcec2bca7367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:04.966066 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0200a9b-8c87-4567-8aaa-dcec2bca7367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:04.967574 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0200a9b-8c87-4567-8aaa-dcec2bca7367 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:04.977560 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1286/2570] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:44:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:44:05.259880 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead666a-c1f6-4489-82e9-ca2d42634b01 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:05.261339 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-5ead666a-c1f6-4489-82e9-ca2d42634b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:05.275846 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead666a-c1f6-4489-82e9-ca2d42634b01 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:05.281621 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593db7b-1512-48fa-b25f-bb8286001484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:05.282785 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593db7b-1512-48fa-b25f-bb8286001484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:05.283169 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593db7b-1512-48fa-b25f-bb8286001484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:05.284103 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593db7b-1512-48fa-b25f-bb8286001484 admin admin] PATH_INFO: `/v3/projects/18ed8380b0154c65a757c031d1046956` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:05.285878 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593db7b-1512-48fa-b25f-bb8286001484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18ed8380b0154c65a757c031d1046956)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:05.288851 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593db7b-1512-48fa-b25f-bb8286001484 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:05.349726 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-8593db7b-1512-48fa-b25f-bb8286001484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18ed8380b0154c65a757c031d1046956', 'request_id': 'req-8593db7b-1512-48fa-b25f-bb8286001484'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:05.356112 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-8593db7b-1512-48fa-b25f-bb8286001484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18ed8380b0154c65a757c031d1046956', 'request_id': 'req-8593db7b-1512-48fa-b25f-bb8286001484'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:05.365516 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-8593db7b-1512-48fa-b25f-bb8286001484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18ed8380b0154c65a757c031d1046956', 'request_id': 'req-8593db7b-1512-48fa-b25f-bb8286001484'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:05.379348 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-8593db7b-1512-48fa-b25f-bb8286001484 admin admin] The token cache is being invalidate because project 18ed8380b0154c65a757c031d1046956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:44:05.379694 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-8593db7b-1512-48fa-b25f-bb8286001484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:05.380273 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-8593db7b-1512-48fa-b25f-bb8286001484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:05.382220 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1285/2571] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:44:05 2021] DELETE /identity/v3/projects/18ed8380b0154c65a757c031d1046956 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:44:05.385934 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0200a9b-8c87-4567-8aaa-dcec2bca7367 service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:05.396132 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0200a9b-8c87-4567-8aaa-dcec2bca7367 service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:05.459240 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8771b15-5af2-46ab-9d56-a8de970beb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:05.460663 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8771b15-5af2-46ab-9d56-a8de970beb12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:05.461272 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8771b15-5af2-46ab-9d56-a8de970beb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:05.461723 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8771b15-5af2-46ab-9d56-a8de970beb12 admin admin] PATH_INFO: `/v3/users/253bdfa8653c42b9b3f981f0a101edd0` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:05.463310 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8771b15-5af2-46ab-9d56-a8de970beb12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=253bdfa8653c42b9b3f981f0a101edd0)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:05.465367 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8771b15-5af2-46ab-9d56-a8de970beb12 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:05.530023 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-e8771b15-5af2-46ab-9d56-a8de970beb12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '253bdfa8653c42b9b3f981f0a101edd0'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:05.540093 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-e8771b15-5af2-46ab-9d56-a8de970beb12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '253bdfa8653c42b9b3f981f0a101edd0'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:05.540971 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-e8771b15-5af2-46ab-9d56-a8de970beb12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '253bdfa8653c42b9b3f981f0a101edd0'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:05.554260 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-e8771b15-5af2-46ab-9d56-a8de970beb12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '253bdfa8653c42b9b3f981f0a101edd0'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:05.561273 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-e8771b15-5af2-46ab-9d56-a8de970beb12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '253bdfa8653c42b9b3f981f0a101edd0'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:05.567772 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1287/2572] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:44:05 2021] DELETE /identity/v3/users/253bdfa8653c42b9b3f981f0a101edd0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:44:05.850524 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593db7b-1512-48fa-b25f-bb8286001484 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:05.852022 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-8593db7b-1512-48fa-b25f-bb8286001484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:05.864949 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593db7b-1512-48fa-b25f-bb8286001484 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:05.946501 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1601aec-eff6-4845-ad6a-c28f57d7b868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:05.947336 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1601aec-eff6-4845-ad6a-c28f57d7b868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:05.947613 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1601aec-eff6-4845-ad6a-c28f57d7b868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:05.947885 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1601aec-eff6-4845-ad6a-c28f57d7b868 admin admin] PATH_INFO: `/v3/projects/057e629039c244a39b23e502c7c4f8d6` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:05.949290 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1601aec-eff6-4845-ad6a-c28f57d7b868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=057e629039c244a39b23e502c7c4f8d6)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:05.951579 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1601aec-eff6-4845-ad6a-c28f57d7b868 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:06.000923 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d1601aec-eff6-4845-ad6a-c28f57d7b868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '057e629039c244a39b23e502c7c4f8d6', 'request_id': 'req-d1601aec-eff6-4845-ad6a-c28f57d7b868'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:06.007262 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d1601aec-eff6-4845-ad6a-c28f57d7b868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '057e629039c244a39b23e502c7c4f8d6', 'request_id': 'req-d1601aec-eff6-4845-ad6a-c28f57d7b868'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:06.015285 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d1601aec-eff6-4845-ad6a-c28f57d7b868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '057e629039c244a39b23e502c7c4f8d6', 'request_id': 'req-d1601aec-eff6-4845-ad6a-c28f57d7b868'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:06.025540 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d1601aec-eff6-4845-ad6a-c28f57d7b868 admin admin] The token cache is being invalidate because project 057e629039c244a39b23e502c7c4f8d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:44:06.025825 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d1601aec-eff6-4845-ad6a-c28f57d7b868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:06.026926 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d1601aec-eff6-4845-ad6a-c28f57d7b868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:06.028487 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1286/2573] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:44:05 2021] DELETE /identity/v3/projects/057e629039c244a39b23e502c7c4f8d6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:44:06.034237 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e32a92-fb21-48ab-a937-f3ff713594d7 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:06.034820 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e32a92-fb21-48ab-a937-f3ff713594d7 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:06.034820 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e32a92-fb21-48ab-a937-f3ff713594d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:06.052504 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-d5e32a92-fb21-48ab-a937-f3ff713594d7 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:44:06.053807 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-d5e32a92-fb21-48ab-a937-f3ff713594d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:06.115187 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1288/2574] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:44:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:44:06.124354 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e13b7f-8a89-46ba-9cb2-f0a3b4149060 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:06.124641 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e13b7f-8a89-46ba-9cb2-f0a3b4149060 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:06.124919 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e13b7f-8a89-46ba-9cb2-f0a3b4149060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:06.144411 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-d7e13b7f-8a89-46ba-9cb2-f0a3b4149060 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:44:06.145618 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-d7e13b7f-8a89-46ba-9cb2-f0a3b4149060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:06.155207 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1287/2575] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:44:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:44:06.159673 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e32a92-fb21-48ab-a937-f3ff713594d7 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:06.170293 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e32a92-fb21-48ab-a937-f3ff713594d7 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:06.176307 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c74bc-283e-419e-b5d1-e99fd963e2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:06.176966 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c74bc-283e-419e-b5d1-e99fd963e2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:06.177244 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c74bc-283e-419e-b5d1-e99fd963e2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:06.177513 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c74bc-283e-419e-b5d1-e99fd963e2a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:06.178250 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c74bc-283e-419e-b5d1-e99fd963e2a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:44:06.178555 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c74bc-283e-419e-b5d1-e99fd963e2a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:06.180178 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c74bc-283e-419e-b5d1-e99fd963e2a2 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:06.191912 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1289/2576] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:44:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:44:06.196250 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e13b7f-8a89-46ba-9cb2-f0a3b4149060 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:06.205687 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e13b7f-8a89-46ba-9cb2-f0a3b4149060 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:06.210460 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396ec51-6cf4-40a8-99dc-54fa6166bdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:06.211144 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396ec51-6cf4-40a8-99dc-54fa6166bdb7 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:06.211420 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396ec51-6cf4-40a8-99dc-54fa6166bdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:06.211709 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396ec51-6cf4-40a8-99dc-54fa6166bdb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:06.212413 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396ec51-6cf4-40a8-99dc-54fa6166bdb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:06.214307 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396ec51-6cf4-40a8-99dc-54fa6166bdb7 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:06.241588 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1288/2577] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:44:06 2021] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:44:06.246085 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c74bc-283e-419e-b5d1-e99fd963e2a2 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:06.256542 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c74bc-283e-419e-b5d1-e99fd963e2a2 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:06.315033 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599da8e7-19ca-4671-9513-e4c71fd2bfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:06.315696 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599da8e7-19ca-4671-9513-e4c71fd2bfc9 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:06.315957 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599da8e7-19ca-4671-9513-e4c71fd2bfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:06.316225 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599da8e7-19ca-4671-9513-e4c71fd2bfc9 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:06.316930 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599da8e7-19ca-4671-9513-e4c71fd2bfc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:06.318853 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599da8e7-19ca-4671-9513-e4c71fd2bfc9 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:06.340409 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1290/2578] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:44:06 2021] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:44:06.345626 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396ec51-6cf4-40a8-99dc-54fa6166bdb7 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:06.356469 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396ec51-6cf4-40a8-99dc-54fa6166bdb7 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:06.361638 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b340bd-d544-4423-949b-83cf3a12a716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:06.362292 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b340bd-d544-4423-949b-83cf3a12a716 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:06.362595 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b340bd-d544-4423-949b-83cf3a12a716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:06.362895 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b340bd-d544-4423-949b-83cf3a12a716 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:06.363667 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b340bd-d544-4423-949b-83cf3a12a716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:06.365274 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b340bd-d544-4423-949b-83cf3a12a716 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:06.377000 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1289/2579] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:44:06 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:44:06.382405 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599da8e7-19ca-4671-9513-e4c71fd2bfc9 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:06.392822 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599da8e7-19ca-4671-9513-e4c71fd2bfc9 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:06.399074 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0142cd-5832-407b-8553-f9a62ac0ca2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:06.399797 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0142cd-5832-407b-8553-f9a62ac0ca2b admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:06.400069 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0142cd-5832-407b-8553-f9a62ac0ca2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:06.400332 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0142cd-5832-407b-8553-f9a62ac0ca2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:06.401060 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0142cd-5832-407b-8553-f9a62ac0ca2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:06.402637 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0142cd-5832-407b-8553-f9a62ac0ca2b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:06.413475 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1291/2580] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:44:06 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:44:06.417812 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b340bd-d544-4423-949b-83cf3a12a716 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:06.428435 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b340bd-d544-4423-949b-83cf3a12a716 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:06.433445 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103441c9-052d-412c-b6f3-f7f28ac77541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:06.434332 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103441c9-052d-412c-b6f3-f7f28ac77541 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:06.434604 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103441c9-052d-412c-b6f3-f7f28ac77541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:06.434906 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103441c9-052d-412c-b6f3-f7f28ac77541 admin admin] PATH_INFO: `/v3/projects/e94ef3abd5024826b993e32ec2c92b1e/users/df8f2527127143cda7eac2f51fb6b040/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:06.450954 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103441c9-052d-412c-b6f3-f7f28ac77541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e94ef3abd5024826b993e32ec2c92b1e, user_id=df8f2527127143cda7eac2f51fb6b040, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:06.453622 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103441c9-052d-412c-b6f3-f7f28ac77541 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:06.468729 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1290/2581] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:44:06 2021] PUT /identity/v3/projects/e94ef3abd5024826b993e32ec2c92b1e/users/df8f2527127143cda7eac2f51fb6b040/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:44:06.483647 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2669d8-ddaa-4262-ad69-7320722b1fa8 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:06.483935 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2669d8-ddaa-4262-ad69-7320722b1fa8 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:06.484211 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2669d8-ddaa-4262-ad69-7320722b1fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:06.516365 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-fa2669d8-ddaa-4262-ad69-7320722b1fa8 None None] MFA Rules not processed for user `df8f2527127143cda7eac2f51fb6b040`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:44:06.517591 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-fa2669d8-ddaa-4262-ad69-7320722b1fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:06.590822 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1292/2582] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:44:06 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:44:06.592487 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103441c9-052d-412c-b6f3-f7f28ac77541 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:06.657588 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103441c9-052d-412c-b6f3-f7f28ac77541 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:06.663379 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6c5b1-403e-49ad-b56a-c951543997f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:06.664053 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6c5b1-403e-49ad-b56a-c951543997f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:06.664337 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6c5b1-403e-49ad-b56a-c951543997f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:06.664596 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6c5b1-403e-49ad-b56a-c951543997f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:06.665325 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6c5b1-403e-49ad-b56a-c951543997f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:06.667280 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6c5b1-403e-49ad-b56a-c951543997f3 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:06.694709 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1291/2583] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:44:06 2021] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:44:06.698656 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2669d8-ddaa-4262-ad69-7320722b1fa8 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:06.710360 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2669d8-ddaa-4262-ad69-7320722b1fa8 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:06.776566 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c8a22-0214-4457-9621-65e68494d7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:06.777256 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c8a22-0214-4457-9621-65e68494d7b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:06.777529 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c8a22-0214-4457-9621-65e68494d7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:06.777793 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c8a22-0214-4457-9621-65e68494d7b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:06.778532 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c8a22-0214-4457-9621-65e68494d7b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:06.780651 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c8a22-0214-4457-9621-65e68494d7b5 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:06.806607 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1293/2584] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:44:06 2021] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:44:06.810567 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6c5b1-403e-49ad-b56a-c951543997f3 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:06.822888 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6c5b1-403e-49ad-b56a-c951543997f3 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:06.827704 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e7a58-b47a-4e32-8dc5-357a0edd2bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:06.828311 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e7a58-b47a-4e32-8dc5-357a0edd2bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:06.828592 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e7a58-b47a-4e32-8dc5-357a0edd2bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:06.828865 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e7a58-b47a-4e32-8dc5-357a0edd2bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:06.829620 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e7a58-b47a-4e32-8dc5-357a0edd2bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:06.831254 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e7a58-b47a-4e32-8dc5-357a0edd2bf4 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:06.842083 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1292/2585] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:44:06 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:44:06.846434 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c8a22-0214-4457-9621-65e68494d7b5 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:06.856909 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c8a22-0214-4457-9621-65e68494d7b5 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:06.862494 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac1ae1-e3fb-4e0d-9f77-5dfdb21ae0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:06.863488 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac1ae1-e3fb-4e0d-9f77-5dfdb21ae0b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:06.863811 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac1ae1-e3fb-4e0d-9f77-5dfdb21ae0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:06.864084 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac1ae1-e3fb-4e0d-9f77-5dfdb21ae0b4 admin admin] PATH_INFO: `/v3/projects/3f5878a46bf04ba3b6d7cfd9a0c88497/users/7dfe860d8f7845feac0650c5381bd5f6/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:06.879732 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac1ae1-e3fb-4e0d-9f77-5dfdb21ae0b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f5878a46bf04ba3b6d7cfd9a0c88497, user_id=7dfe860d8f7845feac0650c5381bd5f6, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:06.882460 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac1ae1-e3fb-4e0d-9f77-5dfdb21ae0b4 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:06.903269 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1294/2586] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:44:06 2021] PUT /identity/v3/projects/3f5878a46bf04ba3b6d7cfd9a0c88497/users/7dfe860d8f7845feac0650c5381bd5f6/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:44:06.907259 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e7a58-b47a-4e32-8dc5-357a0edd2bf4 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:06.918125 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e7a58-b47a-4e32-8dc5-357a0edd2bf4 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:06.932984 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac1ae1-e3fb-4e0d-9f77-5dfdb21ae0b4 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:06.935106 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-37ac1ae1-e3fb-4e0d-9f77-5dfdb21ae0b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:06.975462 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5e8c2-1540-4e78-87e1-ae3f189792e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:06.976138 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5e8c2-1540-4e78-87e1-ae3f189792e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:06.976418 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5e8c2-1540-4e78-87e1-ae3f189792e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:06.976687 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5e8c2-1540-4e78-87e1-ae3f189792e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:06.977427 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5e8c2-1540-4e78-87e1-ae3f189792e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:06.979086 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5e8c2-1540-4e78-87e1-ae3f189792e6 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:06.990800 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1293/2587] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:44:06 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:44:06.992827 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5e8c2-1540-4e78-87e1-ae3f189792e6 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:06.994263 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac1ae1-e3fb-4e0d-9f77-5dfdb21ae0b4 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:06.997925 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e07a7-e928-47cc-92e4-18c27cac6cfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:06.998575 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e07a7-e928-47cc-92e4-18c27cac6cfa service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:06.998913 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e07a7-e928-47cc-92e4-18c27cac6cfa service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:06.999183 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e07a7-e928-47cc-92e4-18c27cac6cfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:07.000945 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-394e07a7-e928-47cc-92e4-18c27cac6cfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:07.002311 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5e8c2-1540-4e78-87e1-ae3f189792e6 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:07.007023 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2d3c0-15e2-4912-903c-f867c870a459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:07.007897 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2d3c0-15e2-4912-903c-f867c870a459 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:07.008175 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2d3c0-15e2-4912-903c-f867c870a459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:07.008450 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2d3c0-15e2-4912-903c-f867c870a459 admin admin] PATH_INFO: `/v3/projects/3f5878a46bf04ba3b6d7cfd9a0c88497/users/7dfe860d8f7845feac0650c5381bd5f6/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:07.010430 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2d3c0-15e2-4912-903c-f867c870a459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f5878a46bf04ba3b6d7cfd9a0c88497, user_id=7dfe860d8f7845feac0650c5381bd5f6, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:07.013078 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2d3c0-15e2-4912-903c-f867c870a459 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:07.023323 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1294/2588] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:44:06 2021] PUT /identity/v3/projects/3f5878a46bf04ba3b6d7cfd9a0c88497/users/7dfe860d8f7845feac0650c5381bd5f6/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:44:07.033688 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c8786-0a92-4c9e-bb6a-da646ca232ba None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:07.033972 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c8786-0a92-4c9e-bb6a-da646ca232ba None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:07.034248 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c8786-0a92-4c9e-bb6a-da646ca232ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:07.060456 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-d18c8786-0a92-4c9e-bb6a-da646ca232ba None None] MFA Rules not processed for user `7dfe860d8f7845feac0650c5381bd5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:44:07.061605 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e07a7-e928-47cc-92e4-18c27cac6cfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:07.062099 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-d18c8786-0a92-4c9e-bb6a-da646ca232ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:07.063093 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e07a7-e928-47cc-92e4-18c27cac6cfa service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:07.072694 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1295/2589] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:44:06 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:44:07.142065 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1295/2590] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:44:07 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:44:07.152320 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e07a7-e928-47cc-92e4-18c27cac6cfa service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:07.153984 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-394e07a7-e928-47cc-92e4-18c27cac6cfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:07.214095 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e07a7-e928-47cc-92e4-18c27cac6cfa service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:07.262845 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9613277-62a9-41db-b735-a6138f569b86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:07.263506 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9613277-62a9-41db-b735-a6138f569b86 service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:07.263780 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9613277-62a9-41db-b735-a6138f569b86 service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:07.264046 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9613277-62a9-41db-b735-a6138f569b86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:07.326647 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9613277-62a9-41db-b735-a6138f569b86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:07.328249 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9613277-62a9-41db-b735-a6138f569b86 service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:07.337647 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1296/2591] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:44:07 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:44:11.015963 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f5aba-beec-4f6b-a999-3bd17cc29a20 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:11.016477 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f5aba-beec-4f6b-a999-3bd17cc29a20 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:11.016587 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f5aba-beec-4f6b-a999-3bd17cc29a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:11.035411 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-543f5aba-beec-4f6b-a999-3bd17cc29a20 None None] MFA Rules not processed for user `62cc0165aee14b449c8a49233001f631`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:44:11.036636 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-543f5aba-beec-4f6b-a999-3bd17cc29a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:11.096954 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1296/2592] 10.222.0.79 () {58 vars in 967 bytes} [Thu Oct 28 14:44:11 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:44:11.112976 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9613277-62a9-41db-b735-a6138f569b86 service cinder] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:11.115241 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-d9613277-62a9-41db-b735-a6138f569b86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:11.193848 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9613277-62a9-41db-b735-a6138f569b86 service cinder] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:11.199444 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b99677-5f20-48ce-8acf-effa167160ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889e7be1dcaf47f599af9c9b7ad33042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:11.200096 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b99677-5f20-48ce-8acf-effa167160ad service swift] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:11.200373 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b99677-5f20-48ce-8acf-effa167160ad service swift] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:11.200643 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b99677-5f20-48ce-8acf-effa167160ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:11.209487 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b99677-5f20-48ce-8acf-effa167160ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:11.211139 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b99677-5f20-48ce-8acf-effa167160ad service swift] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:11.219392 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1297/2593] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Oct 28 14:44:11 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 14:44:11.586711 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f5aba-beec-4f6b-a999-3bd17cc29a20 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:11.588213 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-543f5aba-beec-4f6b-a999-3bd17cc29a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:11.600529 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f5aba-beec-4f6b-a999-3bd17cc29a20 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:11.604866 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fe220-ea74-4879-a002-a84e58fb42d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:11.605512 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fe220-ea74-4879-a002-a84e58fb42d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:11.605787 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fe220-ea74-4879-a002-a84e58fb42d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:11.606057 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fe220-ea74-4879-a002-a84e58fb42d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:11.615923 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fe220-ea74-4879-a002-a84e58fb42d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:11.617303 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fe220-ea74-4879-a002-a84e58fb42d3 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:11.627442 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1297/2594] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:44:11 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:44:16.499831 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b99677-5f20-48ce-8acf-effa167160ad service swift] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:16.576790 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b99677-5f20-48ce-8acf-effa167160ad service swift] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:16.582719 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27f23f-830e-48e8-bac9-c31620261b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:16.583594 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27f23f-830e-48e8-bac9-c31620261b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:16.583868 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27f23f-830e-48e8-bac9-c31620261b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:16.584134 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27f23f-830e-48e8-bac9-c31620261b78 admin admin] PATH_INFO: `/v3/users/df8f2527127143cda7eac2f51fb6b040` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:16.585451 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27f23f-830e-48e8-bac9-c31620261b78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df8f2527127143cda7eac2f51fb6b040)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:16.587483 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27f23f-830e-48e8-bac9-c31620261b78 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:16.636886 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-7d27f23f-830e-48e8-bac9-c31620261b78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df8f2527127143cda7eac2f51fb6b040'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:16.645167 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-7d27f23f-830e-48e8-bac9-c31620261b78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df8f2527127143cda7eac2f51fb6b040'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:16.645998 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-7d27f23f-830e-48e8-bac9-c31620261b78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df8f2527127143cda7eac2f51fb6b040'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:16.658301 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-7d27f23f-830e-48e8-bac9-c31620261b78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df8f2527127143cda7eac2f51fb6b040'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:16.665798 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-7d27f23f-830e-48e8-bac9-c31620261b78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df8f2527127143cda7eac2f51fb6b040'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:16.671935 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1298/2595] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:44:16 2021] DELETE /identity/v3/users/df8f2527127143cda7eac2f51fb6b040 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:44:16.676635 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab7cfb-c76e-4f15-946b-d0d9ba990ea9 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:16.677132 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab7cfb-c76e-4f15-946b-d0d9ba990ea9 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:16.677132 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab7cfb-c76e-4f15-946b-d0d9ba990ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:16.695277 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-10ab7cfb-c76e-4f15-946b-d0d9ba990ea9 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:44:16.696459 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-10ab7cfb-c76e-4f15-946b-d0d9ba990ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:16.765849 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1298/2596] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:44:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:44:16.777590 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27f23f-830e-48e8-bac9-c31620261b78 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:16.779326 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-7d27f23f-830e-48e8-bac9-c31620261b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:16.841272 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27f23f-830e-48e8-bac9-c31620261b78 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:16.846545 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69affc20-7662-4d41-a91a-6ac78983bd2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:16.847258 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69affc20-7662-4d41-a91a-6ac78983bd2c service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:16.847533 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69affc20-7662-4d41-a91a-6ac78983bd2c service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:16.847824 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69affc20-7662-4d41-a91a-6ac78983bd2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:16.857515 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69affc20-7662-4d41-a91a-6ac78983bd2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:16.859171 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69affc20-7662-4d41-a91a-6ac78983bd2c service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:16.869271 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1299/2597] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:44:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:44:17.147135 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab7cfb-c76e-4f15-946b-d0d9ba990ea9 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:17.148670 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-10ab7cfb-c76e-4f15-946b-d0d9ba990ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:17.160993 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab7cfb-c76e-4f15-946b-d0d9ba990ea9 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:17.166848 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffb4cf-d6d5-43f6-a398-35e5a7a6cf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:17.167721 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffb4cf-d6d5-43f6-a398-35e5a7a6cf51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:17.167995 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffb4cf-d6d5-43f6-a398-35e5a7a6cf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:17.168411 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffb4cf-d6d5-43f6-a398-35e5a7a6cf51 admin admin] PATH_INFO: `/v3/projects/e94ef3abd5024826b993e32ec2c92b1e` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:17.169567 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffb4cf-d6d5-43f6-a398-35e5a7a6cf51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e94ef3abd5024826b993e32ec2c92b1e)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:17.171591 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffb4cf-d6d5-43f6-a398-35e5a7a6cf51 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:17.225590 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-68ffb4cf-d6d5-43f6-a398-35e5a7a6cf51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e94ef3abd5024826b993e32ec2c92b1e', 'request_id': 'req-68ffb4cf-d6d5-43f6-a398-35e5a7a6cf51'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:17.231687 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-68ffb4cf-d6d5-43f6-a398-35e5a7a6cf51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e94ef3abd5024826b993e32ec2c92b1e', 'request_id': 'req-68ffb4cf-d6d5-43f6-a398-35e5a7a6cf51'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:17.240597 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-68ffb4cf-d6d5-43f6-a398-35e5a7a6cf51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e94ef3abd5024826b993e32ec2c92b1e', 'request_id': 'req-68ffb4cf-d6d5-43f6-a398-35e5a7a6cf51'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:17.252086 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-68ffb4cf-d6d5-43f6-a398-35e5a7a6cf51 admin admin] The token cache is being invalidate because project e94ef3abd5024826b993e32ec2c92b1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:44:17.252391 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-68ffb4cf-d6d5-43f6-a398-35e5a7a6cf51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:17.253231 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-68ffb4cf-d6d5-43f6-a398-35e5a7a6cf51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:17.254981 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1299/2598] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:44:17 2021] DELETE /identity/v3/projects/e94ef3abd5024826b993e32ec2c92b1e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:44:17.259040 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69affc20-7662-4d41-a91a-6ac78983bd2c service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:17.269314 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69affc20-7662-4d41-a91a-6ac78983bd2c service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:17.330473 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c207b3-15c3-4bbe-8a5b-74ea1f39c334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:17.331401 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c207b3-15c3-4bbe-8a5b-74ea1f39c334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:17.331680 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c207b3-15c3-4bbe-8a5b-74ea1f39c334 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:17.331950 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c207b3-15c3-4bbe-8a5b-74ea1f39c334 admin admin] PATH_INFO: `/v3/users/7dfe860d8f7845feac0650c5381bd5f6` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:17.333195 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c207b3-15c3-4bbe-8a5b-74ea1f39c334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dfe860d8f7845feac0650c5381bd5f6)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:17.335267 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c207b3-15c3-4bbe-8a5b-74ea1f39c334 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:17.385517 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-d3c207b3-15c3-4bbe-8a5b-74ea1f39c334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dfe860d8f7845feac0650c5381bd5f6'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:17.394205 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-d3c207b3-15c3-4bbe-8a5b-74ea1f39c334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dfe860d8f7845feac0650c5381bd5f6'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:17.394913 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-d3c207b3-15c3-4bbe-8a5b-74ea1f39c334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dfe860d8f7845feac0650c5381bd5f6'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:17.406513 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-d3c207b3-15c3-4bbe-8a5b-74ea1f39c334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dfe860d8f7845feac0650c5381bd5f6'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:17.414090 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-d3c207b3-15c3-4bbe-8a5b-74ea1f39c334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dfe860d8f7845feac0650c5381bd5f6'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:17.420071 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1300/2599] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:44:17 2021] DELETE /identity/v3/users/7dfe860d8f7845feac0650c5381bd5f6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:44:17.702418 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffb4cf-d6d5-43f6-a398-35e5a7a6cf51 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:17.704067 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-68ffb4cf-d6d5-43f6-a398-35e5a7a6cf51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:17.717980 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffb4cf-d6d5-43f6-a398-35e5a7a6cf51 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:17.783408 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec739371-07dc-4c14-a1b3-798c1f0b1722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:17.784277 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec739371-07dc-4c14-a1b3-798c1f0b1722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:17.784557 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec739371-07dc-4c14-a1b3-798c1f0b1722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:17.784826 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec739371-07dc-4c14-a1b3-798c1f0b1722 admin admin] PATH_INFO: `/v3/projects/3f5878a46bf04ba3b6d7cfd9a0c88497` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:17.786162 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec739371-07dc-4c14-a1b3-798c1f0b1722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f5878a46bf04ba3b6d7cfd9a0c88497)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:17.788588 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec739371-07dc-4c14-a1b3-798c1f0b1722 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:17.843211 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ec739371-07dc-4c14-a1b3-798c1f0b1722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f5878a46bf04ba3b6d7cfd9a0c88497', 'request_id': 'req-ec739371-07dc-4c14-a1b3-798c1f0b1722'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:17.849607 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ec739371-07dc-4c14-a1b3-798c1f0b1722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f5878a46bf04ba3b6d7cfd9a0c88497', 'request_id': 'req-ec739371-07dc-4c14-a1b3-798c1f0b1722'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:17.858880 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ec739371-07dc-4c14-a1b3-798c1f0b1722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f5878a46bf04ba3b6d7cfd9a0c88497', 'request_id': 'req-ec739371-07dc-4c14-a1b3-798c1f0b1722'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:17.869407 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ec739371-07dc-4c14-a1b3-798c1f0b1722 admin admin] The token cache is being invalidate because project 3f5878a46bf04ba3b6d7cfd9a0c88497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:44:17.869696 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ec739371-07dc-4c14-a1b3-798c1f0b1722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:17.870320 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ec739371-07dc-4c14-a1b3-798c1f0b1722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:17.871920 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1300/2600] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:44:17 2021] DELETE /identity/v3/projects/3f5878a46bf04ba3b6d7cfd9a0c88497 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:44:17.878932 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f922b60-140e-4be9-886f-2fcd7b3f4523 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:17.879410 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f922b60-140e-4be9-886f-2fcd7b3f4523 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:17.879503 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f922b60-140e-4be9-886f-2fcd7b3f4523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:17.897494 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-9f922b60-140e-4be9-886f-2fcd7b3f4523 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:44:17.898820 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-9f922b60-140e-4be9-886f-2fcd7b3f4523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:17.960802 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1301/2601] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:44:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:44:17.973134 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006636ee-442a-477e-910f-7d81c3701742 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:17.973463 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006636ee-442a-477e-910f-7d81c3701742 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:17.973772 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006636ee-442a-477e-910f-7d81c3701742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:18.000368 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-006636ee-442a-477e-910f-7d81c3701742 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:44:18.001586 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-006636ee-442a-477e-910f-7d81c3701742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:18.011245 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1301/2602] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:44:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:44:18.016710 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f922b60-140e-4be9-886f-2fcd7b3f4523 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:18.033741 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f922b60-140e-4be9-886f-2fcd7b3f4523 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:18.043200 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b4249-e3f5-4c00-ba56-db700b032c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:18.044250 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b4249-e3f5-4c00-ba56-db700b032c82 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:18.044560 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b4249-e3f5-4c00-ba56-db700b032c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:18.044943 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b4249-e3f5-4c00-ba56-db700b032c82 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:18.045976 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b4249-e3f5-4c00-ba56-db700b032c82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:44:18.046274 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b4249-e3f5-4c00-ba56-db700b032c82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:18.047902 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b4249-e3f5-4c00-ba56-db700b032c82 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:18.061681 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1302/2603] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:44:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:44:18.069042 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006636ee-442a-477e-910f-7d81c3701742 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:18.081865 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006636ee-442a-477e-910f-7d81c3701742 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:18.087869 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707ed1d-c78c-4274-8997-e7d8461a3994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:18.088522 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707ed1d-c78c-4274-8997-e7d8461a3994 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:18.088801 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707ed1d-c78c-4274-8997-e7d8461a3994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:18.089062 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707ed1d-c78c-4274-8997-e7d8461a3994 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:18.089762 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707ed1d-c78c-4274-8997-e7d8461a3994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:18.091809 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707ed1d-c78c-4274-8997-e7d8461a3994 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:18.119572 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1302/2604] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:44:18 2021] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:44:18.123855 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b4249-e3f5-4c00-ba56-db700b032c82 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:18.136736 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b4249-e3f5-4c00-ba56-db700b032c82 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:18.200141 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3734d6e-b791-4326-b299-131cd47dcfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:18.200803 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3734d6e-b791-4326-b299-131cd47dcfa3 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:18.201090 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3734d6e-b791-4326-b299-131cd47dcfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:18.201366 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3734d6e-b791-4326-b299-131cd47dcfa3 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:18.202140 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3734d6e-b791-4326-b299-131cd47dcfa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:18.204074 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3734d6e-b791-4326-b299-131cd47dcfa3 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:18.228467 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1303/2605] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:44:18 2021] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:44:18.233744 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707ed1d-c78c-4274-8997-e7d8461a3994 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:18.244440 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707ed1d-c78c-4274-8997-e7d8461a3994 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:18.249577 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb186e2-e172-4c17-bbf2-a71183b06737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:18.250244 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb186e2-e172-4c17-bbf2-a71183b06737 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:18.250517 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb186e2-e172-4c17-bbf2-a71183b06737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:18.250829 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb186e2-e172-4c17-bbf2-a71183b06737 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:18.251579 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb186e2-e172-4c17-bbf2-a71183b06737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:18.253168 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb186e2-e172-4c17-bbf2-a71183b06737 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:18.263712 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1303/2606] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:44:18 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:44:18.269070 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3734d6e-b791-4326-b299-131cd47dcfa3 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:18.282401 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3734d6e-b791-4326-b299-131cd47dcfa3 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:18.288224 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2046854-a157-4660-b824-4d1b7931210b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:18.288886 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2046854-a157-4660-b824-4d1b7931210b admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:18.289156 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2046854-a157-4660-b824-4d1b7931210b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:18.289428 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2046854-a157-4660-b824-4d1b7931210b admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:18.290172 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2046854-a157-4660-b824-4d1b7931210b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:18.291797 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2046854-a157-4660-b824-4d1b7931210b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:18.302154 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1304/2607] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:44:18 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:44:18.306377 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb186e2-e172-4c17-bbf2-a71183b06737 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:18.317181 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb186e2-e172-4c17-bbf2-a71183b06737 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:18.322492 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f5eef-35b4-4a82-80d5-019d1e26ce54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:18.323426 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f5eef-35b4-4a82-80d5-019d1e26ce54 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:18.323712 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f5eef-35b4-4a82-80d5-019d1e26ce54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:18.323985 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f5eef-35b4-4a82-80d5-019d1e26ce54 admin admin] PATH_INFO: `/v3/projects/4125ce6a5a60459599c33d233e171872/users/9e607e05854b44c4b5b6919e8c21f4b2/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:18.340472 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f5eef-35b4-4a82-80d5-019d1e26ce54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4125ce6a5a60459599c33d233e171872, user_id=9e607e05854b44c4b5b6919e8c21f4b2, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:18.343308 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f5eef-35b4-4a82-80d5-019d1e26ce54 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:18.359402 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1304/2608] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:44:18 2021] PUT /identity/v3/projects/4125ce6a5a60459599c33d233e171872/users/9e607e05854b44c4b5b6919e8c21f4b2/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:44:18.371511 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbe54f-66a6-42a6-9be7-d3b2393b8b14 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:18.371785 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbe54f-66a6-42a6-9be7-d3b2393b8b14 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:18.372155 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbe54f-66a6-42a6-9be7-d3b2393b8b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:18.400400 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-cebbe54f-66a6-42a6-9be7-d3b2393b8b14 None None] MFA Rules not processed for user `9e607e05854b44c4b5b6919e8c21f4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:44:18.401605 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-cebbe54f-66a6-42a6-9be7-d3b2393b8b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:18.476702 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1305/2609] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:44:18 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:44:18.488825 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f5eef-35b4-4a82-80d5-019d1e26ce54 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:18.491023 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-de7f5eef-35b4-4a82-80d5-019d1e26ce54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:18.574084 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f5eef-35b4-4a82-80d5-019d1e26ce54 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:18.578394 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea76be3-2b20-47ff-959f-54121d9185cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a98d6cf23e4710bfbf71b960f81a9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:18.579095 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea76be3-2b20-47ff-959f-54121d9185cd service glance] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:18.579381 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea76be3-2b20-47ff-959f-54121d9185cd service glance] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:18.579654 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea76be3-2b20-47ff-959f-54121d9185cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:18.589300 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea76be3-2b20-47ff-959f-54121d9185cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:18.590815 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea76be3-2b20-47ff-959f-54121d9185cd service glance] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:18.600248 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1305/2610] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:44:18 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:44:37.244467 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebbe54f-66a6-42a6-9be7-d3b2393b8b14 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:37.315825 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebbe54f-66a6-42a6-9be7-d3b2393b8b14 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:37.320773 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0d16d-6fea-4abc-9b23-4b5afc4d7557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:37.321636 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0d16d-6fea-4abc-9b23-4b5afc4d7557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:37.321910 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0d16d-6fea-4abc-9b23-4b5afc4d7557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:37.322173 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0d16d-6fea-4abc-9b23-4b5afc4d7557 admin admin] PATH_INFO: `/v3/users/9e607e05854b44c4b5b6919e8c21f4b2` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:37.323461 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0d16d-6fea-4abc-9b23-4b5afc4d7557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e607e05854b44c4b5b6919e8c21f4b2)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:37.325383 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0d16d-6fea-4abc-9b23-4b5afc4d7557 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:37.396197 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a7d0d16d-6fea-4abc-9b23-4b5afc4d7557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e607e05854b44c4b5b6919e8c21f4b2'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:37.408872 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a7d0d16d-6fea-4abc-9b23-4b5afc4d7557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e607e05854b44c4b5b6919e8c21f4b2'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:37.409635 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a7d0d16d-6fea-4abc-9b23-4b5afc4d7557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e607e05854b44c4b5b6919e8c21f4b2'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:37.425706 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a7d0d16d-6fea-4abc-9b23-4b5afc4d7557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e607e05854b44c4b5b6919e8c21f4b2'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:37.433101 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-a7d0d16d-6fea-4abc-9b23-4b5afc4d7557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e607e05854b44c4b5b6919e8c21f4b2'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:37.440817 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1306/2611] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:44:37 2021] DELETE /identity/v3/users/9e607e05854b44c4b5b6919e8c21f4b2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:44:37.445455 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b9bf2-5b26-404f-9481-eea65bb724d3 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:37.446004 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b9bf2-5b26-404f-9481-eea65bb724d3 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:37.446114 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b9bf2-5b26-404f-9481-eea65bb724d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:37.470962 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-a29b9bf2-5b26-404f-9481-eea65bb724d3 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:44:37.472171 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-a29b9bf2-5b26-404f-9481-eea65bb724d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:37.530123 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1306/2612] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:44:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:44:37.541006 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0d16d-6fea-4abc-9b23-4b5afc4d7557 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:37.542658 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a7d0d16d-6fea-4abc-9b23-4b5afc4d7557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:37.599943 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0d16d-6fea-4abc-9b23-4b5afc4d7557 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:37.604049 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ad2f5-f9e2-4d3b-8e13-e1ccd2160b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:37.604695 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ad2f5-f9e2-4d3b-8e13-e1ccd2160b42 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:37.604973 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ad2f5-f9e2-4d3b-8e13-e1ccd2160b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:37.605241 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ad2f5-f9e2-4d3b-8e13-e1ccd2160b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:37.619880 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ad2f5-f9e2-4d3b-8e13-e1ccd2160b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:37.622101 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ad2f5-f9e2-4d3b-8e13-e1ccd2160b42 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:37.632290 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1307/2613] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:44:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:44:37.908413 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b9bf2-5b26-404f-9481-eea65bb724d3 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:37.910111 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-a29b9bf2-5b26-404f-9481-eea65bb724d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:37.922940 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b9bf2-5b26-404f-9481-eea65bb724d3 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:37.929043 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7548a-6b36-4b70-a36c-2c92f0e2a9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:37.929924 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7548a-6b36-4b70-a36c-2c92f0e2a9bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:37.930175 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7548a-6b36-4b70-a36c-2c92f0e2a9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:37.930448 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7548a-6b36-4b70-a36c-2c92f0e2a9bf admin admin] PATH_INFO: `/v3/projects/4125ce6a5a60459599c33d233e171872` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:37.931859 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7548a-6b36-4b70-a36c-2c92f0e2a9bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4125ce6a5a60459599c33d233e171872)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:37.933787 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7548a-6b36-4b70-a36c-2c92f0e2a9bf admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:37.979944 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a6e7548a-6b36-4b70-a36c-2c92f0e2a9bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4125ce6a5a60459599c33d233e171872', 'request_id': 'req-a6e7548a-6b36-4b70-a36c-2c92f0e2a9bf'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:37.986206 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a6e7548a-6b36-4b70-a36c-2c92f0e2a9bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4125ce6a5a60459599c33d233e171872', 'request_id': 'req-a6e7548a-6b36-4b70-a36c-2c92f0e2a9bf'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:37.995814 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a6e7548a-6b36-4b70-a36c-2c92f0e2a9bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4125ce6a5a60459599c33d233e171872', 'request_id': 'req-a6e7548a-6b36-4b70-a36c-2c92f0e2a9bf'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:38.006544 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a6e7548a-6b36-4b70-a36c-2c92f0e2a9bf admin admin] The token cache is being invalidate because project 4125ce6a5a60459599c33d233e171872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:44:38.006860 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a6e7548a-6b36-4b70-a36c-2c92f0e2a9bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:38.007499 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a6e7548a-6b36-4b70-a36c-2c92f0e2a9bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:38.009072 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1307/2614] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:44:37 2021] DELETE /identity/v3/projects/4125ce6a5a60459599c33d233e171872 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:44:38.015098 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d537980-3062-47f5-a61a-d97a7c7360a3 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:38.015406 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d537980-3062-47f5-a61a-d97a7c7360a3 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:38.015672 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d537980-3062-47f5-a61a-d97a7c7360a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:38.034559 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-0d537980-3062-47f5-a61a-d97a7c7360a3 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:44:38.035683 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-0d537980-3062-47f5-a61a-d97a7c7360a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:38.096228 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1308/2615] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:44:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:44:38.105229 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5601d7-588f-4f43-a1bc-01ef6de26393 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:38.105517 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5601d7-588f-4f43-a1bc-01ef6de26393 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:38.105786 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5601d7-588f-4f43-a1bc-01ef6de26393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:38.125622 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-6f5601d7-588f-4f43-a1bc-01ef6de26393 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:44:38.126868 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-6f5601d7-588f-4f43-a1bc-01ef6de26393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:38.136314 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1308/2616] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:44:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:44:38.140721 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d537980-3062-47f5-a61a-d97a7c7360a3 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:38.151024 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d537980-3062-47f5-a61a-d97a7c7360a3 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:38.157138 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225c8e1-4fbb-4af7-ab4a-e960e929d437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:38.158042 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225c8e1-4fbb-4af7-ab4a-e960e929d437 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:38.158343 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225c8e1-4fbb-4af7-ab4a-e960e929d437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:38.158763 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225c8e1-4fbb-4af7-ab4a-e960e929d437 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:38.159840 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225c8e1-4fbb-4af7-ab4a-e960e929d437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:44:38.160274 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225c8e1-4fbb-4af7-ab4a-e960e929d437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:38.163102 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225c8e1-4fbb-4af7-ab4a-e960e929d437 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:38.176571 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1309/2617] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:44:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:44:38.180981 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5601d7-588f-4f43-a1bc-01ef6de26393 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:38.190814 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5601d7-588f-4f43-a1bc-01ef6de26393 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:38.196712 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59d8fb-1ca3-4db0-b181-7258935e9fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:38.197374 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59d8fb-1ca3-4db0-b181-7258935e9fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:38.197673 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59d8fb-1ca3-4db0-b181-7258935e9fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:38.197914 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59d8fb-1ca3-4db0-b181-7258935e9fa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:38.198629 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59d8fb-1ca3-4db0-b181-7258935e9fa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:38.200605 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59d8fb-1ca3-4db0-b181-7258935e9fa8 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:38.231524 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1309/2618] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:44:38 2021] POST /identity/v3/projects => generated 359 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:44:38.238151 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225c8e1-4fbb-4af7-ab4a-e960e929d437 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:38.248777 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225c8e1-4fbb-4af7-ab4a-e960e929d437 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:38.305894 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002f698-9046-4fac-82da-5b9453f1c0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:38.306471 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002f698-9046-4fac-82da-5b9453f1c0ae admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:38.306777 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002f698-9046-4fac-82da-5b9453f1c0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:38.307049 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002f698-9046-4fac-82da-5b9453f1c0ae admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:38.307753 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002f698-9046-4fac-82da-5b9453f1c0ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:38.309650 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002f698-9046-4fac-82da-5b9453f1c0ae admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:38.331699 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1310/2619] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:44:38 2021] POST /identity/v3/users => generated 280 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:44:38.336036 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59d8fb-1ca3-4db0-b181-7258935e9fa8 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:38.346837 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59d8fb-1ca3-4db0-b181-7258935e9fa8 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:38.352214 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478013a1-aaf6-4307-9057-f060b51382a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:38.352882 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478013a1-aaf6-4307-9057-f060b51382a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:38.353161 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478013a1-aaf6-4307-9057-f060b51382a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:38.353431 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478013a1-aaf6-4307-9057-f060b51382a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:38.354179 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478013a1-aaf6-4307-9057-f060b51382a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:38.355819 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478013a1-aaf6-4307-9057-f060b51382a8 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:38.366463 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1310/2620] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:44:38 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:44:38.370801 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002f698-9046-4fac-82da-5b9453f1c0ae admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:38.380980 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002f698-9046-4fac-82da-5b9453f1c0ae admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:38.386033 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205abd7a-6d68-43bd-a0c7-c971913e5146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:38.386712 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205abd7a-6d68-43bd-a0c7-c971913e5146 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:38.386963 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205abd7a-6d68-43bd-a0c7-c971913e5146 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:38.387278 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205abd7a-6d68-43bd-a0c7-c971913e5146 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:38.387994 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205abd7a-6d68-43bd-a0c7-c971913e5146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:38.389635 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205abd7a-6d68-43bd-a0c7-c971913e5146 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:38.399648 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1311/2621] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:44:38 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:44:38.403877 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478013a1-aaf6-4307-9057-f060b51382a8 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:38.414412 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478013a1-aaf6-4307-9057-f060b51382a8 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:38.420443 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c1836-c6a9-4802-bc30-9668e1b0e22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:38.421326 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c1836-c6a9-4802-bc30-9668e1b0e22e admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:38.421606 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c1836-c6a9-4802-bc30-9668e1b0e22e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:38.421876 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c1836-c6a9-4802-bc30-9668e1b0e22e admin admin] PATH_INFO: `/v3/projects/d004e2fb7cd44b00a1a01194ca1740d4/users/23ea7fc632f74008997a69e4cf88e650/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:38.437606 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c1836-c6a9-4802-bc30-9668e1b0e22e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d004e2fb7cd44b00a1a01194ca1740d4, user_id=23ea7fc632f74008997a69e4cf88e650, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:38.440290 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c1836-c6a9-4802-bc30-9668e1b0e22e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:38.456388 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1311/2622] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:44:38 2021] PUT /identity/v3/projects/d004e2fb7cd44b00a1a01194ca1740d4/users/23ea7fc632f74008997a69e4cf88e650/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:44:38.466961 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf24ae-9885-49cf-9d6d-a06685ee53b0 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:38.467179 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf24ae-9885-49cf-9d6d-a06685ee53b0 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:38.467461 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf24ae-9885-49cf-9d6d-a06685ee53b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:38.493860 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-35cf24ae-9885-49cf-9d6d-a06685ee53b0 None None] MFA Rules not processed for user `23ea7fc632f74008997a69e4cf88e650`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:44:38.495104 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-35cf24ae-9885-49cf-9d6d-a06685ee53b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:38.565014 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1312/2623] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:44:38 2021] POST /identity/v3/auth/tokens => generated 3379 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:44:38.594273 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c1836-c6a9-4802-bc30-9668e1b0e22e admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:38.596058 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-601c1836-c6a9-4802-bc30-9668e1b0e22e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:38.650403 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c1836-c6a9-4802-bc30-9668e1b0e22e admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:38.654285 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064dedb-1953-4fce-bb52-18d9968b72a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:38.654965 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064dedb-1953-4fce-bb52-18d9968b72a7 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:38.655244 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064dedb-1953-4fce-bb52-18d9968b72a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:38.655512 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064dedb-1953-4fce-bb52-18d9968b72a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:38.664436 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064dedb-1953-4fce-bb52-18d9968b72a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:38.665871 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064dedb-1953-4fce-bb52-18d9968b72a7 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:38.674861 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1312/2624] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:44:38 2021] GET /identity/v3/auth/tokens => generated 3379 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:44:38.692581 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf24ae-9885-49cf-9d6d-a06685ee53b0 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:38.761872 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf24ae-9885-49cf-9d6d-a06685ee53b0 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:38.767029 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31173046-bb7f-40de-8e6a-42a91b99b62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:38.767925 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31173046-bb7f-40de-8e6a-42a91b99b62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:38.768200 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31173046-bb7f-40de-8e6a-42a91b99b62d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:38.768484 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31173046-bb7f-40de-8e6a-42a91b99b62d admin admin] PATH_INFO: `/v3/users/23ea7fc632f74008997a69e4cf88e650` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:38.769752 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31173046-bb7f-40de-8e6a-42a91b99b62d admin admin] RBAC: Authorizing `identity:delete_user(user_id=23ea7fc632f74008997a69e4cf88e650)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:38.771695 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31173046-bb7f-40de-8e6a-42a91b99b62d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:38.824443 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-31173046-bb7f-40de-8e6a-42a91b99b62d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23ea7fc632f74008997a69e4cf88e650'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:38.831705 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-31173046-bb7f-40de-8e6a-42a91b99b62d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23ea7fc632f74008997a69e4cf88e650'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:38.832416 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-31173046-bb7f-40de-8e6a-42a91b99b62d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23ea7fc632f74008997a69e4cf88e650'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:38.844151 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-31173046-bb7f-40de-8e6a-42a91b99b62d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23ea7fc632f74008997a69e4cf88e650'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:38.852430 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-31173046-bb7f-40de-8e6a-42a91b99b62d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23ea7fc632f74008997a69e4cf88e650'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:38.860551 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1313/2625] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:44:38 2021] DELETE /identity/v3/users/23ea7fc632f74008997a69e4cf88e650 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:44:38.866357 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562dc0a-989d-42f6-af93-cc6adaa76ef7 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:38.866757 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562dc0a-989d-42f6-af93-cc6adaa76ef7 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:38.867188 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562dc0a-989d-42f6-af93-cc6adaa76ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:38.886895 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-b562dc0a-989d-42f6-af93-cc6adaa76ef7 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:44:38.888113 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-b562dc0a-989d-42f6-af93-cc6adaa76ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:38.953426 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1313/2626] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:44:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:44:38.964584 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31173046-bb7f-40de-8e6a-42a91b99b62d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:38.966103 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-31173046-bb7f-40de-8e6a-42a91b99b62d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:39.025332 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31173046-bb7f-40de-8e6a-42a91b99b62d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:39.031768 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb29728-010f-4b72-b720-512bf3b6a37d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:39.032421 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb29728-010f-4b72-b720-512bf3b6a37d service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:39.032696 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb29728-010f-4b72-b720-512bf3b6a37d service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:39.032963 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb29728-010f-4b72-b720-512bf3b6a37d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:39.043629 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb29728-010f-4b72-b720-512bf3b6a37d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:39.045148 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb29728-010f-4b72-b720-512bf3b6a37d service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:39.071028 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1314/2627] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:44:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:44:39.342150 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562dc0a-989d-42f6-af93-cc6adaa76ef7 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:39.343939 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-b562dc0a-989d-42f6-af93-cc6adaa76ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:39.356817 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562dc0a-989d-42f6-af93-cc6adaa76ef7 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:39.362329 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c449c08-3623-47c6-9be6-a0032502b081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:39.363405 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c449c08-3623-47c6-9be6-a0032502b081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:39.363682 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c449c08-3623-47c6-9be6-a0032502b081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:39.363925 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c449c08-3623-47c6-9be6-a0032502b081 admin admin] PATH_INFO: `/v3/projects/d004e2fb7cd44b00a1a01194ca1740d4` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:39.365268 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c449c08-3623-47c6-9be6-a0032502b081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d004e2fb7cd44b00a1a01194ca1740d4)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:39.367191 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c449c08-3623-47c6-9be6-a0032502b081 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:39.422020 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-7c449c08-3623-47c6-9be6-a0032502b081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd004e2fb7cd44b00a1a01194ca1740d4', 'request_id': 'req-7c449c08-3623-47c6-9be6-a0032502b081'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:39.431544 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-7c449c08-3623-47c6-9be6-a0032502b081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd004e2fb7cd44b00a1a01194ca1740d4', 'request_id': 'req-7c449c08-3623-47c6-9be6-a0032502b081'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:39.442322 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-7c449c08-3623-47c6-9be6-a0032502b081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd004e2fb7cd44b00a1a01194ca1740d4', 'request_id': 'req-7c449c08-3623-47c6-9be6-a0032502b081'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:39.453403 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-7c449c08-3623-47c6-9be6-a0032502b081 admin admin] The token cache is being invalidate because project d004e2fb7cd44b00a1a01194ca1740d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:44:39.453698 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-7c449c08-3623-47c6-9be6-a0032502b081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:39.454502 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-7c449c08-3623-47c6-9be6-a0032502b081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:44:39.456143 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1314/2628] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:44:39 2021] DELETE /identity/v3/projects/d004e2fb7cd44b00a1a01194ca1740d4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:44:39.462796 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c6162-f2a8-46ca-8580-49ed7f77c3fe None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:39.463337 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c6162-f2a8-46ca-8580-49ed7f77c3fe None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:39.463452 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c6162-f2a8-46ca-8580-49ed7f77c3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:39.482044 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-7f3c6162-f2a8-46ca-8580-49ed7f77c3fe None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:44:39.483262 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-7f3c6162-f2a8-46ca-8580-49ed7f77c3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:39.552068 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1315/2629] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:44:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:44:39.560352 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029adc9a-e299-4536-80d6-6ef44046ebb8 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:39.560871 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029adc9a-e299-4536-80d6-6ef44046ebb8 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:39.560871 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029adc9a-e299-4536-80d6-6ef44046ebb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:39.580626 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-029adc9a-e299-4536-80d6-6ef44046ebb8 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:44:39.581826 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-029adc9a-e299-4536-80d6-6ef44046ebb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:39.591107 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1315/2630] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:44:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:44:39.595670 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c6162-f2a8-46ca-8580-49ed7f77c3fe None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:39.605765 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c6162-f2a8-46ca-8580-49ed7f77c3fe None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:39.611521 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968a77b-73b5-44ed-a4a7-0d809e0e4173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:39.612176 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968a77b-73b5-44ed-a4a7-0d809e0e4173 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:39.612452 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968a77b-73b5-44ed-a4a7-0d809e0e4173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:39.612724 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968a77b-73b5-44ed-a4a7-0d809e0e4173 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:39.613458 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968a77b-73b5-44ed-a4a7-0d809e0e4173 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:44:39.613759 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968a77b-73b5-44ed-a4a7-0d809e0e4173 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:39.615386 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968a77b-73b5-44ed-a4a7-0d809e0e4173 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:39.627386 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1316/2631] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:44:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:44:39.632235 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029adc9a-e299-4536-80d6-6ef44046ebb8 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:39.645706 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029adc9a-e299-4536-80d6-6ef44046ebb8 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:39.652515 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9b335-0544-448f-a294-abf7abab5d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:39.653258 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9b335-0544-448f-a294-abf7abab5d84 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:39.653691 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9b335-0544-448f-a294-abf7abab5d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:39.653983 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9b335-0544-448f-a294-abf7abab5d84 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:39.654614 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9b335-0544-448f-a294-abf7abab5d84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:39.656523 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9b335-0544-448f-a294-abf7abab5d84 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:39.685567 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1316/2632] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:44:39 2021] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:44:39.689967 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968a77b-73b5-44ed-a4a7-0d809e0e4173 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:39.700046 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968a77b-73b5-44ed-a4a7-0d809e0e4173 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:39.766494 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cb298-f6c8-4267-aa34-3c9abf2cdc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:39.767202 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cb298-f6c8-4267-aa34-3c9abf2cdc20 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:39.767484 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cb298-f6c8-4267-aa34-3c9abf2cdc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:39.767757 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cb298-f6c8-4267-aa34-3c9abf2cdc20 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:39.768458 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460cb298-f6c8-4267-aa34-3c9abf2cdc20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:39.770368 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460cb298-f6c8-4267-aa34-3c9abf2cdc20 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:39.792123 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1317/2633] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:44:39 2021] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:44:39.796582 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9b335-0544-448f-a294-abf7abab5d84 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:39.806986 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9b335-0544-448f-a294-abf7abab5d84 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:39.812422 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93e3ef-aee9-498f-bd78-19ff474899c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:39.813082 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93e3ef-aee9-498f-bd78-19ff474899c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:39.813506 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93e3ef-aee9-498f-bd78-19ff474899c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:39.813786 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93e3ef-aee9-498f-bd78-19ff474899c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:39.814542 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93e3ef-aee9-498f-bd78-19ff474899c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:39.816185 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93e3ef-aee9-498f-bd78-19ff474899c2 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:39.827204 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1317/2634] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:44:39 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:44:39.831344 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cb298-f6c8-4267-aa34-3c9abf2cdc20 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:39.841790 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cb298-f6c8-4267-aa34-3c9abf2cdc20 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:39.847242 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d683b0e-d614-450a-a915-83d09d58fc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:39.847905 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d683b0e-d614-450a-a915-83d09d58fc07 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:39.848186 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d683b0e-d614-450a-a915-83d09d58fc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:39.848463 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d683b0e-d614-450a-a915-83d09d58fc07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:39.849205 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d683b0e-d614-450a-a915-83d09d58fc07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:39.850918 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d683b0e-d614-450a-a915-83d09d58fc07 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:39.860949 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1318/2635] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:44:39 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:44:39.865275 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93e3ef-aee9-498f-bd78-19ff474899c2 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:39.879571 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93e3ef-aee9-498f-bd78-19ff474899c2 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:39.885865 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104efa6-5cf7-4cea-bf40-0ff200b0da4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:39.886731 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104efa6-5cf7-4cea-bf40-0ff200b0da4e admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:39.887012 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104efa6-5cf7-4cea-bf40-0ff200b0da4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:39.887305 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104efa6-5cf7-4cea-bf40-0ff200b0da4e admin admin] PATH_INFO: `/v3/projects/454069e2a3a8470b8988cd44e4ec6956/users/770672427f484086b8095a955edde9df/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:39.902356 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104efa6-5cf7-4cea-bf40-0ff200b0da4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=454069e2a3a8470b8988cd44e4ec6956, user_id=770672427f484086b8095a955edde9df, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:39.905065 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104efa6-5cf7-4cea-bf40-0ff200b0da4e admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:39.919405 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1318/2636] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:44:39 2021] PUT /identity/v3/projects/454069e2a3a8470b8988cd44e4ec6956/users/770672427f484086b8095a955edde9df/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:44:39.932946 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99537017-ec20-4ac3-bb94-38fe99e570b5 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:39.933236 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99537017-ec20-4ac3-bb94-38fe99e570b5 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:39.933509 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99537017-ec20-4ac3-bb94-38fe99e570b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:39.961593 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-99537017-ec20-4ac3-bb94-38fe99e570b5 None None] MFA Rules not processed for user `770672427f484086b8095a955edde9df`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:44:39.962831 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-99537017-ec20-4ac3-bb94-38fe99e570b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:40.029060 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1319/2637] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:44:39 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:44:40.043018 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104efa6-5cf7-4cea-bf40-0ff200b0da4e admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:40.044926 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-2104efa6-5cf7-4cea-bf40-0ff200b0da4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:40.101506 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104efa6-5cf7-4cea-bf40-0ff200b0da4e admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:40.105676 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76104c-eb90-4e51-a0e0-a2db53483ada service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:40.106309 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76104c-eb90-4e51-a0e0-a2db53483ada service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:40.106586 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76104c-eb90-4e51-a0e0-a2db53483ada service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:40.106884 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76104c-eb90-4e51-a0e0-a2db53483ada service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:40.115639 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76104c-eb90-4e51-a0e0-a2db53483ada service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:40.117066 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76104c-eb90-4e51-a0e0-a2db53483ada service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:40.125925 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1319/2638] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:44:40 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:44:56.638625 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99537017-ec20-4ac3-bb94-38fe99e570b5 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:56.640292 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-99537017-ec20-4ac3-bb94-38fe99e570b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:56.702968 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99537017-ec20-4ac3-bb94-38fe99e570b5 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:56.709755 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fb109-8343-4508-8932-8805dfbea590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:56.710749 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fb109-8343-4508-8932-8805dfbea590 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:56.711025 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fb109-8343-4508-8932-8805dfbea590 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:56.711279 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fb109-8343-4508-8932-8805dfbea590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:56.714161 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-3b0fb109-8343-4508-8932-8805dfbea590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:56.777337 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fb109-8343-4508-8932-8805dfbea590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:56.778804 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fb109-8343-4508-8932-8805dfbea590 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:56.788845 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1320/2639] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:44:56 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:44:57.697496 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76104c-eb90-4e51-a0e0-a2db53483ada service cinder] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:44:57.699056 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-8b76104c-eb90-4e51-a0e0-a2db53483ada service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:57.777618 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76104c-eb90-4e51-a0e0-a2db53483ada service cinder] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:44:57.784336 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4c9ce-3e5a-49e8-9e42-ec894f0b241a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:44:57.785049 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4c9ce-3e5a-49e8-9e42-ec894f0b241a service nova] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:44:57.785333 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4c9ce-3e5a-49e8-9e42-ec894f0b241a service nova] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:44:57.785636 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4c9ce-3e5a-49e8-9e42-ec894f0b241a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:44:57.787992 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-9fa4c9ce-3e5a-49e8-9e42-ec894f0b241a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:44:57.803323 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4c9ce-3e5a-49e8-9e42-ec894f0b241a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:44:57.805073 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4c9ce-3e5a-49e8-9e42-ec894f0b241a service nova] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:44:57.818750 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1320/2640] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:44:57 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:45:00.758099 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fb109-8343-4508-8932-8805dfbea590 service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:00.835390 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fb109-8343-4508-8932-8805dfbea590 service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:00.840571 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e84709-34e1-4f7d-a840-5f71ad3f680d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:00.841479 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e84709-34e1-4f7d-a840-5f71ad3f680d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:00.841753 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e84709-34e1-4f7d-a840-5f71ad3f680d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:00.842020 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e84709-34e1-4f7d-a840-5f71ad3f680d admin admin] PATH_INFO: `/v3/users/770672427f484086b8095a955edde9df` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:00.843333 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e84709-34e1-4f7d-a840-5f71ad3f680d admin admin] RBAC: Authorizing `identity:delete_user(user_id=770672427f484086b8095a955edde9df)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:00.845268 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e84709-34e1-4f7d-a840-5f71ad3f680d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:00.893237 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-80e84709-34e1-4f7d-a840-5f71ad3f680d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '770672427f484086b8095a955edde9df'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:00.903609 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-80e84709-34e1-4f7d-a840-5f71ad3f680d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '770672427f484086b8095a955edde9df'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:00.904553 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-80e84709-34e1-4f7d-a840-5f71ad3f680d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '770672427f484086b8095a955edde9df'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:00.919614 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-80e84709-34e1-4f7d-a840-5f71ad3f680d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '770672427f484086b8095a955edde9df'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:00.927271 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-80e84709-34e1-4f7d-a840-5f71ad3f680d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '770672427f484086b8095a955edde9df'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:00.934283 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1321/2641] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:45:00 2021] DELETE /identity/v3/users/770672427f484086b8095a955edde9df => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:45:00.939139 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de3872-b62c-4a56-8fb5-6119b35d04fe None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:00.939676 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de3872-b62c-4a56-8fb5-6119b35d04fe None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:00.939908 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de3872-b62c-4a56-8fb5-6119b35d04fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:00.959607 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-c1de3872-b62c-4a56-8fb5-6119b35d04fe None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:00.961092 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-c1de3872-b62c-4a56-8fb5-6119b35d04fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:01.031642 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1321/2642] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:45:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:45:01.042927 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e84709-34e1-4f7d-a840-5f71ad3f680d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:01.045074 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-80e84709-34e1-4f7d-a840-5f71ad3f680d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:01.108033 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e84709-34e1-4f7d-a840-5f71ad3f680d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:01.111784 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779e637-e2ff-4a7b-a519-9fbf13a07588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:01.112431 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779e637-e2ff-4a7b-a519-9fbf13a07588 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:01.112713 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779e637-e2ff-4a7b-a519-9fbf13a07588 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:01.112981 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779e637-e2ff-4a7b-a519-9fbf13a07588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:01.121897 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779e637-e2ff-4a7b-a519-9fbf13a07588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:01.123394 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779e637-e2ff-4a7b-a519-9fbf13a07588 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:01.133184 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1322/2643] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:45:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:45:01.437935 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de3872-b62c-4a56-8fb5-6119b35d04fe None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:01.444739 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-c1de3872-b62c-4a56-8fb5-6119b35d04fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:01.460080 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de3872-b62c-4a56-8fb5-6119b35d04fe None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:01.465937 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1325c3-6a33-4970-a065-90a41ed44340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:01.466730 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1325c3-6a33-4970-a065-90a41ed44340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:01.467013 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1325c3-6a33-4970-a065-90a41ed44340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:01.467424 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1325c3-6a33-4970-a065-90a41ed44340 admin admin] PATH_INFO: `/v3/projects/454069e2a3a8470b8988cd44e4ec6956` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:01.468809 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1325c3-6a33-4970-a065-90a41ed44340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=454069e2a3a8470b8988cd44e4ec6956)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:01.471086 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1325c3-6a33-4970-a065-90a41ed44340 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:01.520475 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-df1325c3-6a33-4970-a065-90a41ed44340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '454069e2a3a8470b8988cd44e4ec6956', 'request_id': 'req-df1325c3-6a33-4970-a065-90a41ed44340'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:01.527050 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-df1325c3-6a33-4970-a065-90a41ed44340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '454069e2a3a8470b8988cd44e4ec6956', 'request_id': 'req-df1325c3-6a33-4970-a065-90a41ed44340'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:01.535190 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-df1325c3-6a33-4970-a065-90a41ed44340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '454069e2a3a8470b8988cd44e4ec6956', 'request_id': 'req-df1325c3-6a33-4970-a065-90a41ed44340'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:01.546111 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-df1325c3-6a33-4970-a065-90a41ed44340 admin admin] The token cache is being invalidate because project 454069e2a3a8470b8988cd44e4ec6956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:45:01.546405 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-df1325c3-6a33-4970-a065-90a41ed44340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:01.547036 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-df1325c3-6a33-4970-a065-90a41ed44340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:01.548620 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1322/2644] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:45:01 2021] DELETE /identity/v3/projects/454069e2a3a8470b8988cd44e4ec6956 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:45:01.554511 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5579c7-5994-4aeb-8533-d65cff6eb9da None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:01.554846 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5579c7-5994-4aeb-8533-d65cff6eb9da None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:01.555120 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5579c7-5994-4aeb-8533-d65cff6eb9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:01.572212 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-be5579c7-5994-4aeb-8533-d65cff6eb9da None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:01.573430 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-be5579c7-5994-4aeb-8533-d65cff6eb9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:01.634453 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1323/2645] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:45:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:45:01.642713 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb533e-7e8f-403a-a209-9a75d28517d9 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:01.643032 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb533e-7e8f-403a-a209-9a75d28517d9 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:01.643309 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb533e-7e8f-403a-a209-9a75d28517d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:01.662956 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-0dfb533e-7e8f-403a-a209-9a75d28517d9 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:01.664221 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-0dfb533e-7e8f-403a-a209-9a75d28517d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:01.674447 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1323/2646] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:45:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:45:01.678990 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5579c7-5994-4aeb-8533-d65cff6eb9da None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:01.689257 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5579c7-5994-4aeb-8533-d65cff6eb9da None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:01.695588 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d79aa-43ff-430f-9223-1fbff17e06c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:01.696250 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d79aa-43ff-430f-9223-1fbff17e06c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:01.696534 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d79aa-43ff-430f-9223-1fbff17e06c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:01.696803 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d79aa-43ff-430f-9223-1fbff17e06c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:01.697546 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d79aa-43ff-430f-9223-1fbff17e06c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:45:01.697843 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d79aa-43ff-430f-9223-1fbff17e06c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:01.699483 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d79aa-43ff-430f-9223-1fbff17e06c0 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:01.711804 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1324/2647] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:45:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:45:01.716629 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb533e-7e8f-403a-a209-9a75d28517d9 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:01.729627 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb533e-7e8f-403a-a209-9a75d28517d9 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:01.735693 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fba49-c542-439d-9fe8-067302c01b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:01.736344 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fba49-c542-439d-9fe8-067302c01b4f admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:01.736614 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fba49-c542-439d-9fe8-067302c01b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:01.736883 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fba49-c542-439d-9fe8-067302c01b4f admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:01.737580 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fba49-c542-439d-9fe8-067302c01b4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:01.739512 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fba49-c542-439d-9fe8-067302c01b4f admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:01.768034 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1324/2648] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:45:01 2021] POST /identity/v3/projects => generated 397 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:45:01.772285 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d79aa-43ff-430f-9223-1fbff17e06c0 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:01.783136 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d79aa-43ff-430f-9223-1fbff17e06c0 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:01.845962 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf91b8e-f223-46be-b78e-249be56ce74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:01.846843 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf91b8e-f223-46be-b78e-249be56ce74a admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:01.847122 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf91b8e-f223-46be-b78e-249be56ce74a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:01.847451 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf91b8e-f223-46be-b78e-249be56ce74a admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:01.848448 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf91b8e-f223-46be-b78e-249be56ce74a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:01.850918 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf91b8e-f223-46be-b78e-249be56ce74a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:01.873385 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1325/2649] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:45:01 2021] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:45:01.878086 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fba49-c542-439d-9fe8-067302c01b4f admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:01.888934 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fba49-c542-439d-9fe8-067302c01b4f admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:01.894053 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae58d55-e806-4e3a-aebe-afa0ce45ee83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:01.894727 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae58d55-e806-4e3a-aebe-afa0ce45ee83 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:01.895034 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae58d55-e806-4e3a-aebe-afa0ce45ee83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:01.895306 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae58d55-e806-4e3a-aebe-afa0ce45ee83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:01.896082 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae58d55-e806-4e3a-aebe-afa0ce45ee83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:01.897712 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae58d55-e806-4e3a-aebe-afa0ce45ee83 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:01.908907 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1325/2650] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:45:01 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:45:01.913358 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf91b8e-f223-46be-b78e-249be56ce74a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:01.923465 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf91b8e-f223-46be-b78e-249be56ce74a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:01.928341 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f27140-2e07-4afe-b601-1d6c7968347c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:01.929013 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f27140-2e07-4afe-b601-1d6c7968347c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:01.929288 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f27140-2e07-4afe-b601-1d6c7968347c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:01.929612 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f27140-2e07-4afe-b601-1d6c7968347c admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:01.930351 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f27140-2e07-4afe-b601-1d6c7968347c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:01.931990 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f27140-2e07-4afe-b601-1d6c7968347c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:01.941894 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1326/2651] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:45:01 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:45:01.946492 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae58d55-e806-4e3a-aebe-afa0ce45ee83 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:01.957236 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae58d55-e806-4e3a-aebe-afa0ce45ee83 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:01.962419 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0b9c4-fe41-49e5-acf3-8ff98ddb1679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:01.963355 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0b9c4-fe41-49e5-acf3-8ff98ddb1679 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:01.963631 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0b9c4-fe41-49e5-acf3-8ff98ddb1679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:01.963897 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0b9c4-fe41-49e5-acf3-8ff98ddb1679 admin admin] PATH_INFO: `/v3/projects/f5394161c23a4640b2dd70acce3d06fa/users/1f040da3d73a4c14adc0c11a3b9a1362/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:01.978922 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0b9c4-fe41-49e5-acf3-8ff98ddb1679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5394161c23a4640b2dd70acce3d06fa, user_id=1f040da3d73a4c14adc0c11a3b9a1362, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:01.981638 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0b9c4-fe41-49e5-acf3-8ff98ddb1679 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:01.996819 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1326/2652] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:45:01 2021] PUT /identity/v3/projects/f5394161c23a4640b2dd70acce3d06fa/users/1f040da3d73a4c14adc0c11a3b9a1362/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:45:02.007365 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2189956-d49c-47e5-ad11-c59da3458525 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:02.007652 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2189956-d49c-47e5-ad11-c59da3458525 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:02.007919 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2189956-d49c-47e5-ad11-c59da3458525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:02.035165 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-b2189956-d49c-47e5-ad11-c59da3458525 None None] MFA Rules not processed for user `1f040da3d73a4c14adc0c11a3b9a1362`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:02.036365 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-b2189956-d49c-47e5-ad11-c59da3458525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:02.103239 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1327/2653] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:45:02 2021] POST /identity/v3/auth/tokens => generated 3417 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:45:02.114181 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0b9c4-fe41-49e5-acf3-8ff98ddb1679 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:02.116196 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e6a0b9c4-fe41-49e5-acf3-8ff98ddb1679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:02.175259 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0b9c4-fe41-49e5-acf3-8ff98ddb1679 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:02.181157 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545eb93-45bd-4530-9f7c-a7ed2b875be7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:02.182061 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545eb93-45bd-4530-9f7c-a7ed2b875be7 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:02.182451 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545eb93-45bd-4530-9f7c-a7ed2b875be7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:02.182845 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545eb93-45bd-4530-9f7c-a7ed2b875be7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:02.196290 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545eb93-45bd-4530-9f7c-a7ed2b875be7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:02.198357 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545eb93-45bd-4530-9f7c-a7ed2b875be7 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:02.211247 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1327/2654] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:45:02 2021] GET /identity/v3/auth/tokens => generated 3417 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:45:02.746805 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2189956-d49c-47e5-ad11-c59da3458525 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:02.748439 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-b2189956-d49c-47e5-ad11-c59da3458525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:02.811392 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2189956-d49c-47e5-ad11-c59da3458525 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:02.815285 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec6bcb-9602-46c9-96ba-48406d5cb67a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:02.815949 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec6bcb-9602-46c9-96ba-48406d5cb67a service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:02.816217 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec6bcb-9602-46c9-96ba-48406d5cb67a service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:02.816485 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec6bcb-9602-46c9-96ba-48406d5cb67a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:02.819063 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-0dec6bcb-9602-46c9-96ba-48406d5cb67a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:02.888295 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec6bcb-9602-46c9-96ba-48406d5cb67a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:02.889727 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec6bcb-9602-46c9-96ba-48406d5cb67a service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:02.899534 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1328/2655] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:45:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:45:08.979281 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545eb93-45bd-4530-9f7c-a7ed2b875be7 service cinder] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:08.981434 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-a545eb93-45bd-4530-9f7c-a7ed2b875be7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:09.074008 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545eb93-45bd-4530-9f7c-a7ed2b875be7 service cinder] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:09.079936 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd531576-6229-4cbe-ae6a-6fc9eb84234b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bf32a6fafb7458788a47e4774cb7bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:09.080704 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd531576-6229-4cbe-ae6a-6fc9eb84234b service placement] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:09.081079 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd531576-6229-4cbe-ae6a-6fc9eb84234b service placement] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:09.081415 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd531576-6229-4cbe-ae6a-6fc9eb84234b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:09.083288 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-bd531576-6229-4cbe-ae6a-6fc9eb84234b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:09.095744 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd531576-6229-4cbe-ae6a-6fc9eb84234b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:09.097326 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd531576-6229-4cbe-ae6a-6fc9eb84234b service placement] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:09.112324 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1328/2656] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:45:08 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:45:09.245202 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec6bcb-9602-46c9-96ba-48406d5cb67a service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:09.263028 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec6bcb-9602-46c9-96ba-48406d5cb67a service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:09.269940 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e8822-3b86-40cd-a36b-0c05ba99e0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:09.270987 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e8822-3b86-40cd-a36b-0c05ba99e0aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:09.271318 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e8822-3b86-40cd-a36b-0c05ba99e0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:09.271568 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e8822-3b86-40cd-a36b-0c05ba99e0aa admin admin] PATH_INFO: `/v3/users/1f040da3d73a4c14adc0c11a3b9a1362` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:09.272803 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e8822-3b86-40cd-a36b-0c05ba99e0aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f040da3d73a4c14adc0c11a3b9a1362)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:09.275659 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e8822-3b86-40cd-a36b-0c05ba99e0aa admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:09.342324 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-f51e8822-3b86-40cd-a36b-0c05ba99e0aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f040da3d73a4c14adc0c11a3b9a1362'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:09.352053 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-f51e8822-3b86-40cd-a36b-0c05ba99e0aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f040da3d73a4c14adc0c11a3b9a1362'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:09.353118 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-f51e8822-3b86-40cd-a36b-0c05ba99e0aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f040da3d73a4c14adc0c11a3b9a1362'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:09.367458 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-f51e8822-3b86-40cd-a36b-0c05ba99e0aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f040da3d73a4c14adc0c11a3b9a1362'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:09.374607 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-f51e8822-3b86-40cd-a36b-0c05ba99e0aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f040da3d73a4c14adc0c11a3b9a1362'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:09.392337 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1329/2657] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:45:09 2021] DELETE /identity/v3/users/1f040da3d73a4c14adc0c11a3b9a1362 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:45:09.393262 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909e57d-19c6-49d5-b1c3-36188f2d57cb None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:09.393786 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909e57d-19c6-49d5-b1c3-36188f2d57cb None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:09.394647 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909e57d-19c6-49d5-b1c3-36188f2d57cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:09.423815 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-6909e57d-19c6-49d5-b1c3-36188f2d57cb None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:09.425887 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-6909e57d-19c6-49d5-b1c3-36188f2d57cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:09.542807 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1329/2658] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:45:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:45:09.566460 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e8822-3b86-40cd-a36b-0c05ba99e0aa admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:09.568177 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-f51e8822-3b86-40cd-a36b-0c05ba99e0aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:09.692037 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e8822-3b86-40cd-a36b-0c05ba99e0aa admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:09.697235 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f15c0-d580-4b5b-87b8-473c3519ccd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:09.697937 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f15c0-d580-4b5b-87b8-473c3519ccd0 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:09.698188 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f15c0-d580-4b5b-87b8-473c3519ccd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:09.698462 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f15c0-d580-4b5b-87b8-473c3519ccd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:09.718331 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f15c0-d580-4b5b-87b8-473c3519ccd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:09.721670 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f15c0-d580-4b5b-87b8-473c3519ccd0 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:09.744151 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1330/2659] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:45:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:45:10.158822 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909e57d-19c6-49d5-b1c3-36188f2d57cb None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:10.160635 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-6909e57d-19c6-49d5-b1c3-36188f2d57cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:10.180010 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909e57d-19c6-49d5-b1c3-36188f2d57cb None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:10.186528 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68202e-f66d-46e4-8a7a-1171037679af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:10.187552 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68202e-f66d-46e4-8a7a-1171037679af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:10.187904 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68202e-f66d-46e4-8a7a-1171037679af admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:10.188244 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68202e-f66d-46e4-8a7a-1171037679af admin admin] PATH_INFO: `/v3/projects/f5394161c23a4640b2dd70acce3d06fa` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:10.189642 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68202e-f66d-46e4-8a7a-1171037679af admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5394161c23a4640b2dd70acce3d06fa)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:10.203932 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68202e-f66d-46e4-8a7a-1171037679af admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:10.264884 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-3d68202e-f66d-46e4-8a7a-1171037679af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5394161c23a4640b2dd70acce3d06fa', 'request_id': 'req-3d68202e-f66d-46e4-8a7a-1171037679af'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:10.269748 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-3d68202e-f66d-46e4-8a7a-1171037679af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5394161c23a4640b2dd70acce3d06fa', 'request_id': 'req-3d68202e-f66d-46e4-8a7a-1171037679af'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:10.281558 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-3d68202e-f66d-46e4-8a7a-1171037679af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5394161c23a4640b2dd70acce3d06fa', 'request_id': 'req-3d68202e-f66d-46e4-8a7a-1171037679af'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:10.299451 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-3d68202e-f66d-46e4-8a7a-1171037679af admin admin] The token cache is being invalidate because project f5394161c23a4640b2dd70acce3d06fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:45:10.299730 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-3d68202e-f66d-46e4-8a7a-1171037679af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:10.300621 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-3d68202e-f66d-46e4-8a7a-1171037679af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:10.307654 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1330/2660] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:45:10 2021] DELETE /identity/v3/projects/f5394161c23a4640b2dd70acce3d06fa => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:45:10.309631 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec467e8-9a2b-4c9f-a7d5-8b87ce6d79de None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:10.309631 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec467e8-9a2b-4c9f-a7d5-8b87ce6d79de None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:10.310214 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec467e8-9a2b-4c9f-a7d5-8b87ce6d79de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:10.326981 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68202e-f66d-46e4-8a7a-1171037679af admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:10.334504 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-eec467e8-9a2b-4c9f-a7d5-8b87ce6d79de None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:10.335743 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-3d68202e-f66d-46e4-8a7a-1171037679af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:10.336348 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-eec467e8-9a2b-4c9f-a7d5-8b87ce6d79de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:10.407899 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68202e-f66d-46e4-8a7a-1171037679af admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:10.412953 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc016652-4218-4fe3-b047-be251610cbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:10.413847 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc016652-4218-4fe3-b047-be251610cbf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:10.414123 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc016652-4218-4fe3-b047-be251610cbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:10.414562 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc016652-4218-4fe3-b047-be251610cbf7 admin admin] PATH_INFO: `/v3/users/50c574405738412ab7acbbf1ac687864` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:10.415847 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc016652-4218-4fe3-b047-be251610cbf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c574405738412ab7acbbf1ac687864)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:10.417035 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1331/2661] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:45:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:45:10.423445 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc016652-4218-4fe3-b047-be251610cbf7 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:10.424736 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86875755-cac2-4a54-97d0-79162a8e5b25 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:10.425020 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86875755-cac2-4a54-97d0-79162a8e5b25 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:10.425289 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86875755-cac2-4a54-97d0-79162a8e5b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:10.451390 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-86875755-cac2-4a54-97d0-79162a8e5b25 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:10.452372 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-86875755-cac2-4a54-97d0-79162a8e5b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:10.463444 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1332/2662] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:45:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:45:10.467858 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86875755-cac2-4a54-97d0-79162a8e5b25 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:10.482274 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86875755-cac2-4a54-97d0-79162a8e5b25 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:10.488043 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cc016652-4218-4fe3-b047-be251610cbf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c574405738412ab7acbbf1ac687864'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:10.489054 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cc016652-4218-4fe3-b047-be251610cbf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c574405738412ab7acbbf1ac687864'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:10.490628 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b7339-87ae-4bf8-a430-2060a7fa6b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:10.492370 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b7339-87ae-4bf8-a430-2060a7fa6b53 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:10.492958 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b7339-87ae-4bf8-a430-2060a7fa6b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:10.493424 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b7339-87ae-4bf8-a430-2060a7fa6b53 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:10.501670 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cc016652-4218-4fe3-b047-be251610cbf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c574405738412ab7acbbf1ac687864'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:10.506219 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b7339-87ae-4bf8-a430-2060a7fa6b53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:45:10.506971 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b7339-87ae-4bf8-a430-2060a7fa6b53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:10.509957 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b7339-87ae-4bf8-a430-2060a7fa6b53 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:10.512995 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cc016652-4218-4fe3-b047-be251610cbf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c574405738412ab7acbbf1ac687864'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:10.527216 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-cc016652-4218-4fe3-b047-be251610cbf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c574405738412ab7acbbf1ac687864'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:10.529158 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1333/2663] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:45:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:45:10.533539 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b7339-87ae-4bf8-a430-2060a7fa6b53 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:10.538167 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-6c0b7339-87ae-4bf8-a430-2060a7fa6b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:10.544401 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1331/2664] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:45:10 2021] DELETE /identity/v3/users/50c574405738412ab7acbbf1ac687864 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:45:10.553534 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b7339-87ae-4bf8-a430-2060a7fa6b53 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:10.634238 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fe6b4-0391-4029-883f-810764ca8fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:10.634876 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fe6b4-0391-4029-883f-810764ca8fcc admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:10.635328 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fe6b4-0391-4029-883f-810764ca8fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:10.635598 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fe6b4-0391-4029-883f-810764ca8fcc admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:10.636571 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87fe6b4-0391-4029-883f-810764ca8fcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:10.638776 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87fe6b4-0391-4029-883f-810764ca8fcc admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:10.691673 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1334/2665] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:45:10 2021] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:45:10.692797 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc016652-4218-4fe3-b047-be251610cbf7 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:10.709879 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc016652-4218-4fe3-b047-be251610cbf7 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:10.777586 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335fea0-8e25-46cf-8480-b4339a09a427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:10.778405 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335fea0-8e25-46cf-8480-b4339a09a427 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:10.778762 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335fea0-8e25-46cf-8480-b4339a09a427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:10.779146 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335fea0-8e25-46cf-8480-b4339a09a427 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:10.780119 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335fea0-8e25-46cf-8480-b4339a09a427 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:10.782340 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335fea0-8e25-46cf-8480-b4339a09a427 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:10.817413 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1332/2666] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:45:10 2021] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:45:10.821601 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fe6b4-0391-4029-883f-810764ca8fcc admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:10.832404 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fe6b4-0391-4029-883f-810764ca8fcc admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:10.837245 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3e1e6-8f9f-42b2-ac29-4d8aba6fab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:10.837947 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3e1e6-8f9f-42b2-ac29-4d8aba6fab9d admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:10.838725 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3e1e6-8f9f-42b2-ac29-4d8aba6fab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:10.838725 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3e1e6-8f9f-42b2-ac29-4d8aba6fab9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:10.839255 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3e1e6-8f9f-42b2-ac29-4d8aba6fab9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:10.840880 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3e1e6-8f9f-42b2-ac29-4d8aba6fab9d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:10.853278 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1335/2667] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:45:10 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:45:10.857046 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335fea0-8e25-46cf-8480-b4339a09a427 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:10.867397 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335fea0-8e25-46cf-8480-b4339a09a427 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:10.872300 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e68ee-72be-4add-8030-00d75b64a3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:10.872998 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e68ee-72be-4add-8030-00d75b64a3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:10.873280 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e68ee-72be-4add-8030-00d75b64a3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:10.873555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e68ee-72be-4add-8030-00d75b64a3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:10.874321 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e68ee-72be-4add-8030-00d75b64a3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:10.876012 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e68ee-72be-4add-8030-00d75b64a3e2 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:10.887172 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1333/2668] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:45:10 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:45:10.891557 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3e1e6-8f9f-42b2-ac29-4d8aba6fab9d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:10.908136 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3e1e6-8f9f-42b2-ac29-4d8aba6fab9d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:10.913686 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a998b-0b27-4b05-b0d8-ef00653b65ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:10.914639 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a998b-0b27-4b05-b0d8-ef00653b65ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:10.914963 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a998b-0b27-4b05-b0d8-ef00653b65ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:10.915230 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a998b-0b27-4b05-b0d8-ef00653b65ea admin admin] PATH_INFO: `/v3/projects/5ed02b182e3f46e99a390b62c69040b0/users/efb3930f2a614e66944c99814a426a75/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:10.934352 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a998b-0b27-4b05-b0d8-ef00653b65ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed02b182e3f46e99a390b62c69040b0, user_id=efb3930f2a614e66944c99814a426a75, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:10.937095 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a998b-0b27-4b05-b0d8-ef00653b65ea admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:10.953409 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1336/2669] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:45:10 2021] PUT /identity/v3/projects/5ed02b182e3f46e99a390b62c69040b0/users/efb3930f2a614e66944c99814a426a75/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:45:10.959524 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bb6b2-e541-41c9-978e-cff8b42b1ba3 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:10.959733 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bb6b2-e541-41c9-978e-cff8b42b1ba3 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:10.960011 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bb6b2-e541-41c9-978e-cff8b42b1ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:10.980330 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-a72bb6b2-e541-41c9-978e-cff8b42b1ba3 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:10.981586 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-a72bb6b2-e541-41c9-978e-cff8b42b1ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:10.999612 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a998b-0b27-4b05-b0d8-ef00653b65ea admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:11.001577 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-d09a998b-0b27-4b05-b0d8-ef00653b65ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:11.064224 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1334/2670] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:45:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:45:11.072064 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a998b-0b27-4b05-b0d8-ef00653b65ea admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:11.074636 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bb6b2-e541-41c9-978e-cff8b42b1ba3 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:11.076018 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-a72bb6b2-e541-41c9-978e-cff8b42b1ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:11.077078 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e4e0f-b142-4f73-a8f5-710e07daaa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:11.077946 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e4e0f-b142-4f73-a8f5-710e07daaa8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:11.078220 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e4e0f-b142-4f73-a8f5-710e07daaa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:11.078479 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e4e0f-b142-4f73-a8f5-710e07daaa8e admin admin] PATH_INFO: `/v3/projects/fac19c389c954392bd090a3a76ba291b` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:11.079758 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e4e0f-b142-4f73-a8f5-710e07daaa8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fac19c389c954392bd090a3a76ba291b)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:11.081636 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e4e0f-b142-4f73-a8f5-710e07daaa8e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:11.137222 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bb6b2-e541-41c9-978e-cff8b42b1ba3 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:11.138967 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-2e7e4e0f-b142-4f73-a8f5-710e07daaa8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fac19c389c954392bd090a3a76ba291b', 'request_id': 'req-2e7e4e0f-b142-4f73-a8f5-710e07daaa8e'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:11.145778 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-2e7e4e0f-b142-4f73-a8f5-710e07daaa8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fac19c389c954392bd090a3a76ba291b', 'request_id': 'req-2e7e4e0f-b142-4f73-a8f5-710e07daaa8e'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:11.156232 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-2e7e4e0f-b142-4f73-a8f5-710e07daaa8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fac19c389c954392bd090a3a76ba291b', 'request_id': 'req-2e7e4e0f-b142-4f73-a8f5-710e07daaa8e'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:11.170976 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-2e7e4e0f-b142-4f73-a8f5-710e07daaa8e admin admin] The token cache is being invalidate because project fac19c389c954392bd090a3a76ba291b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:45:11.171146 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-2e7e4e0f-b142-4f73-a8f5-710e07daaa8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:11.171876 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-2e7e4e0f-b142-4f73-a8f5-710e07daaa8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:11.180941 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1337/2671] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:45:10 2021] DELETE /identity/v3/projects/fac19c389c954392bd090a3a76ba291b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:45:11.186391 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e4e0f-b142-4f73-a8f5-710e07daaa8e admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:11.187879 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-2e7e4e0f-b142-4f73-a8f5-710e07daaa8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:11.210224 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a66448-9933-4f58-891e-359abbef1cb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:11.210955 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a66448-9933-4f58-891e-359abbef1cb0 service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:11.211236 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a66448-9933-4f58-891e-359abbef1cb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:11.211513 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a66448-9933-4f58-891e-359abbef1cb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:11.214562 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-43a66448-9933-4f58-891e-359abbef1cb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:11.258661 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e4e0f-b142-4f73-a8f5-710e07daaa8e admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:11.264237 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10f875-dd7a-4268-a062-df1ae0be6ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:11.265213 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10f875-dd7a-4268-a062-df1ae0be6ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:11.265487 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10f875-dd7a-4268-a062-df1ae0be6ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:11.265751 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10f875-dd7a-4268-a062-df1ae0be6ccf admin admin] PATH_INFO: `/v3/users/0c875bb93eb14a60a97dd4a36044611e` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:11.267131 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10f875-dd7a-4268-a062-df1ae0be6ccf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c875bb93eb14a60a97dd4a36044611e)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:11.269896 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10f875-dd7a-4268-a062-df1ae0be6ccf admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:11.283798 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a66448-9933-4f58-891e-359abbef1cb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:11.285338 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a66448-9933-4f58-891e-359abbef1cb0 service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:11.295670 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1335/2672] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:45:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:45:11.323794 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-0e10f875-dd7a-4268-a062-df1ae0be6ccf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c875bb93eb14a60a97dd4a36044611e'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:11.331854 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-0e10f875-dd7a-4268-a062-df1ae0be6ccf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c875bb93eb14a60a97dd4a36044611e'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:11.332462 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-0e10f875-dd7a-4268-a062-df1ae0be6ccf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c875bb93eb14a60a97dd4a36044611e'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:11.344943 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-0e10f875-dd7a-4268-a062-df1ae0be6ccf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c875bb93eb14a60a97dd4a36044611e'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:11.352210 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-0e10f875-dd7a-4268-a062-df1ae0be6ccf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c875bb93eb14a60a97dd4a36044611e'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:11.359168 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1338/2673] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:45:11 2021] DELETE /identity/v3/users/0c875bb93eb14a60a97dd4a36044611e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:45:11.533025 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a66448-9933-4f58-891e-359abbef1cb0 service neutron] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:11.544606 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a66448-9933-4f58-891e-359abbef1cb0 service neutron] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:11.604277 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e1230-6eb8-4966-a1a0-c8492a44ef95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:11.605160 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e1230-6eb8-4966-a1a0-c8492a44ef95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:11.605438 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e1230-6eb8-4966-a1a0-c8492a44ef95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:11.605732 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e1230-6eb8-4966-a1a0-c8492a44ef95 admin admin] PATH_INFO: `/v3/projects/e3042a7154394fd1ab02dda0f29aa720` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:11.606941 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e1230-6eb8-4966-a1a0-c8492a44ef95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3042a7154394fd1ab02dda0f29aa720)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:11.608905 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e1230-6eb8-4966-a1a0-c8492a44ef95 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:11.657904 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a48e1230-6eb8-4966-a1a0-c8492a44ef95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3042a7154394fd1ab02dda0f29aa720', 'request_id': 'req-a48e1230-6eb8-4966-a1a0-c8492a44ef95'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:11.664919 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a48e1230-6eb8-4966-a1a0-c8492a44ef95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3042a7154394fd1ab02dda0f29aa720', 'request_id': 'req-a48e1230-6eb8-4966-a1a0-c8492a44ef95'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:11.674170 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a48e1230-6eb8-4966-a1a0-c8492a44ef95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3042a7154394fd1ab02dda0f29aa720', 'request_id': 'req-a48e1230-6eb8-4966-a1a0-c8492a44ef95'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:11.685827 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a48e1230-6eb8-4966-a1a0-c8492a44ef95 admin admin] The token cache is being invalidate because project e3042a7154394fd1ab02dda0f29aa720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:45:11.686120 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a48e1230-6eb8-4966-a1a0-c8492a44ef95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:11.686969 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-a48e1230-6eb8-4966-a1a0-c8492a44ef95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:11.688966 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1336/2674] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:45:11 2021] DELETE /identity/v3/projects/e3042a7154394fd1ab02dda0f29aa720 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:45:13.611724 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10f875-dd7a-4268-a062-df1ae0be6ccf admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:13.613453 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-0e10f875-dd7a-4268-a062-df1ae0be6ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:13.694190 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10f875-dd7a-4268-a062-df1ae0be6ccf admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:13.803154 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63f1c5-ace0-4b45-9d6a-41c55f79acf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:13.803868 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63f1c5-ace0-4b45-9d6a-41c55f79acf0 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:13.804133 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63f1c5-ace0-4b45-9d6a-41c55f79acf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:13.804446 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63f1c5-ace0-4b45-9d6a-41c55f79acf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:13.810117 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-fb63f1c5-ace0-4b45-9d6a-41c55f79acf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:13.928350 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63f1c5-ace0-4b45-9d6a-41c55f79acf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:13.931157 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63f1c5-ace0-4b45-9d6a-41c55f79acf0 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:13.956347 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1339/2675] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:45:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:45:15.658488 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34341eb7-25f1-4c79-a125-18688d23f554 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:15.659004 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34341eb7-25f1-4c79-a125-18688d23f554 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:15.659284 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34341eb7-25f1-4c79-a125-18688d23f554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:15.702550 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-34341eb7-25f1-4c79-a125-18688d23f554 None None] MFA Rules not processed for user `efb3930f2a614e66944c99814a426a75`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:15.703819 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-34341eb7-25f1-4c79-a125-18688d23f554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:15.786589 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1337/2676] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:45:15 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:45:15.788429 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63f1c5-ace0-4b45-9d6a-41c55f79acf0 service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:15.789953 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-fb63f1c5-ace0-4b45-9d6a-41c55f79acf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:15.807431 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63f1c5-ace0-4b45-9d6a-41c55f79acf0 service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:15.813525 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd19fa2-222c-42a2-9d69-78dfec04a640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:15.814278 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd19fa2-222c-42a2-9d69-78dfec04a640 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:15.814638 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd19fa2-222c-42a2-9d69-78dfec04a640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:15.815004 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd19fa2-222c-42a2-9d69-78dfec04a640 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:15.815788 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd19fa2-222c-42a2-9d69-78dfec04a640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:15.819004 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd19fa2-222c-42a2-9d69-78dfec04a640 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:15.848393 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1340/2677] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:45:15 2021] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:45:15.852091 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34341eb7-25f1-4c79-a125-18688d23f554 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:15.865352 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34341eb7-25f1-4c79-a125-18688d23f554 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:15.929534 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9dcecd-4ca4-4a38-9f09-0b27e344aa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:15.930372 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9dcecd-4ca4-4a38-9f09-0b27e344aa35 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:15.930792 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9dcecd-4ca4-4a38-9f09-0b27e344aa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:15.931169 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9dcecd-4ca4-4a38-9f09-0b27e344aa35 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:15.931985 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9dcecd-4ca4-4a38-9f09-0b27e344aa35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:15.934094 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9dcecd-4ca4-4a38-9f09-0b27e344aa35 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:15.958127 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1338/2678] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:45:15 2021] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:45:15.962239 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd19fa2-222c-42a2-9d69-78dfec04a640 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:15.972862 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd19fa2-222c-42a2-9d69-78dfec04a640 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:15.978854 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f6007-f25d-4839-96cd-c212384efc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:15.979537 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f6007-f25d-4839-96cd-c212384efc6c admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:15.979813 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f6007-f25d-4839-96cd-c212384efc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:15.980082 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f6007-f25d-4839-96cd-c212384efc6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:15.980823 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f6007-f25d-4839-96cd-c212384efc6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:15.982579 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f6007-f25d-4839-96cd-c212384efc6c admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:15.996683 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1341/2679] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:45:15 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:45:15.999984 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9dcecd-4ca4-4a38-9f09-0b27e344aa35 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:16.010781 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9dcecd-4ca4-4a38-9f09-0b27e344aa35 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:16.016095 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbfd4e-c8f7-4381-86d0-7d798d923914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:16.017031 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbfd4e-c8f7-4381-86d0-7d798d923914 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:16.017329 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbfd4e-c8f7-4381-86d0-7d798d923914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:16.017606 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbfd4e-c8f7-4381-86d0-7d798d923914 admin admin] PATH_INFO: `/v3/projects/f409a869e2344604b5ac3ae7f026e3fd/users/e44b7f1a1e50499997cd7a4182d2d6c5/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:16.037477 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbfd4e-c8f7-4381-86d0-7d798d923914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f409a869e2344604b5ac3ae7f026e3fd, user_id=e44b7f1a1e50499997cd7a4182d2d6c5, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:16.040317 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbfd4e-c8f7-4381-86d0-7d798d923914 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:16.056114 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1339/2680] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:45:15 2021] PUT /identity/v3/projects/f409a869e2344604b5ac3ae7f026e3fd/users/e44b7f1a1e50499997cd7a4182d2d6c5/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:45:16.060519 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f6007-f25d-4839-96cd-c212384efc6c admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:16.071637 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f6007-f25d-4839-96cd-c212384efc6c admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:16.134126 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986228b-3b1c-46a7-b3a8-dd71f8aaf32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:16.134867 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986228b-3b1c-46a7-b3a8-dd71f8aaf32f admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:16.135145 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986228b-3b1c-46a7-b3a8-dd71f8aaf32f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:16.135413 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986228b-3b1c-46a7-b3a8-dd71f8aaf32f admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:16.136199 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986228b-3b1c-46a7-b3a8-dd71f8aaf32f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:16.137783 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986228b-3b1c-46a7-b3a8-dd71f8aaf32f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:16.156231 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1342/2681] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:45:16 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:45:16.157220 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbfd4e-c8f7-4381-86d0-7d798d923914 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:16.168595 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbfd4e-c8f7-4381-86d0-7d798d923914 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:16.173607 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa8e3b-d7f6-4c68-ad83-593dc335329d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:16.174600 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa8e3b-d7f6-4c68-ad83-593dc335329d admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:16.174970 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa8e3b-d7f6-4c68-ad83-593dc335329d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:16.175333 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa8e3b-d7f6-4c68-ad83-593dc335329d admin admin] PATH_INFO: `/v3/projects/f409a869e2344604b5ac3ae7f026e3fd/users/e44b7f1a1e50499997cd7a4182d2d6c5/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:16.177446 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa8e3b-d7f6-4c68-ad83-593dc335329d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f409a869e2344604b5ac3ae7f026e3fd, user_id=e44b7f1a1e50499997cd7a4182d2d6c5, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:16.180217 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa8e3b-d7f6-4c68-ad83-593dc335329d admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:16.191272 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1340/2682] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:45:16 2021] PUT /identity/v3/projects/f409a869e2344604b5ac3ae7f026e3fd/users/e44b7f1a1e50499997cd7a4182d2d6c5/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:45:18.125880 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986228b-3b1c-46a7-b3a8-dd71f8aaf32f admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:18.129326 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-1986228b-3b1c-46a7-b3a8-dd71f8aaf32f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:18.163116 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986228b-3b1c-46a7-b3a8-dd71f8aaf32f admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:18.247941 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be2c53-ed34-4a73-9994-a1436c5ba11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:18.248852 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be2c53-ed34-4a73-9994-a1436c5ba11d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:18.249132 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be2c53-ed34-4a73-9994-a1436c5ba11d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:18.249402 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be2c53-ed34-4a73-9994-a1436c5ba11d admin admin] PATH_INFO: `/v3/users/8b1e077f454b471ba851db9431f1011d` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:18.250878 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be2c53-ed34-4a73-9994-a1436c5ba11d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b1e077f454b471ba851db9431f1011d)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:18.253223 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be2c53-ed34-4a73-9994-a1436c5ba11d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:18.319011 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-03be2c53-ed34-4a73-9994-a1436c5ba11d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b1e077f454b471ba851db9431f1011d'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:18.329920 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-03be2c53-ed34-4a73-9994-a1436c5ba11d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b1e077f454b471ba851db9431f1011d'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:18.331626 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-03be2c53-ed34-4a73-9994-a1436c5ba11d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b1e077f454b471ba851db9431f1011d'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:18.349888 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-03be2c53-ed34-4a73-9994-a1436c5ba11d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b1e077f454b471ba851db9431f1011d'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:18.358457 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-03be2c53-ed34-4a73-9994-a1436c5ba11d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b1e077f454b471ba851db9431f1011d'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:18.369791 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1343/2683] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:45:18 2021] DELETE /identity/v3/users/8b1e077f454b471ba851db9431f1011d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:45:18.684795 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa8e3b-d7f6-4c68-ad83-593dc335329d admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:18.688669 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-87aa8e3b-d7f6-4c68-ad83-593dc335329d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:18.720066 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa8e3b-d7f6-4c68-ad83-593dc335329d admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:18.876396 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0097dc-f4ec-40a8-b3e6-ee63dda4a821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:18.878401 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0097dc-f4ec-40a8-b3e6-ee63dda4a821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:18.878876 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0097dc-f4ec-40a8-b3e6-ee63dda4a821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:18.879497 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0097dc-f4ec-40a8-b3e6-ee63dda4a821 admin admin] PATH_INFO: `/v3/projects/89fb273f901845daa8cf52ed4beefe1d` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:18.881259 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0097dc-f4ec-40a8-b3e6-ee63dda4a821 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89fb273f901845daa8cf52ed4beefe1d)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:18.883994 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0097dc-f4ec-40a8-b3e6-ee63dda4a821 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:18.976395 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ba0097dc-f4ec-40a8-b3e6-ee63dda4a821 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89fb273f901845daa8cf52ed4beefe1d', 'request_id': 'req-ba0097dc-f4ec-40a8-b3e6-ee63dda4a821'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:18.983863 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ba0097dc-f4ec-40a8-b3e6-ee63dda4a821 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89fb273f901845daa8cf52ed4beefe1d', 'request_id': 'req-ba0097dc-f4ec-40a8-b3e6-ee63dda4a821'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:18.996504 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ba0097dc-f4ec-40a8-b3e6-ee63dda4a821 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89fb273f901845daa8cf52ed4beefe1d', 'request_id': 'req-ba0097dc-f4ec-40a8-b3e6-ee63dda4a821'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:19.012537 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ba0097dc-f4ec-40a8-b3e6-ee63dda4a821 admin admin] The token cache is being invalidate because project 89fb273f901845daa8cf52ed4beefe1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:45:19.013150 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ba0097dc-f4ec-40a8-b3e6-ee63dda4a821 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:19.014462 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ba0097dc-f4ec-40a8-b3e6-ee63dda4a821 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:19.016589 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1341/2684] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:45:18 2021] DELETE /identity/v3/projects/89fb273f901845daa8cf52ed4beefe1d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:45:19.022729 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d5fdc-7a00-4cf2-b7e5-9c36d65024b1 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:19.023210 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d5fdc-7a00-4cf2-b7e5-9c36d65024b1 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:19.023330 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d5fdc-7a00-4cf2-b7e5-9c36d65024b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:19.049563 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-e30d5fdc-7a00-4cf2-b7e5-9c36d65024b1 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:19.050858 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-e30d5fdc-7a00-4cf2-b7e5-9c36d65024b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:19.139025 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1344/2685] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:45:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:45:19.146976 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e65d57-0139-4b95-9786-1f9048fb2b20 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:19.147511 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e65d57-0139-4b95-9786-1f9048fb2b20 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:19.147951 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e65d57-0139-4b95-9786-1f9048fb2b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:19.173052 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-75e65d57-0139-4b95-9786-1f9048fb2b20 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:19.174342 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-75e65d57-0139-4b95-9786-1f9048fb2b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:19.186770 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1342/2686] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:45:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:45:19.189908 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d5fdc-7a00-4cf2-b7e5-9c36d65024b1 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:19.202057 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d5fdc-7a00-4cf2-b7e5-9c36d65024b1 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:19.210227 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028b6c6-a7e9-4c7b-ba93-ac3461c3b8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:19.211163 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028b6c6-a7e9-4c7b-ba93-ac3461c3b8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:19.211454 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028b6c6-a7e9-4c7b-ba93-ac3461c3b8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:19.211804 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028b6c6-a7e9-4c7b-ba93-ac3461c3b8c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:19.212572 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028b6c6-a7e9-4c7b-ba93-ac3461c3b8c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:45:19.212879 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028b6c6-a7e9-4c7b-ba93-ac3461c3b8c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:19.214507 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028b6c6-a7e9-4c7b-ba93-ac3461c3b8c0 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:19.238289 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1345/2687] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:45:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:45:19.243737 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e65d57-0139-4b95-9786-1f9048fb2b20 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:19.266046 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e65d57-0139-4b95-9786-1f9048fb2b20 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:19.279427 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56904f2b-f8bc-479c-aa24-c0c280b4c687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:19.280130 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56904f2b-f8bc-479c-aa24-c0c280b4c687 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:19.280405 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56904f2b-f8bc-479c-aa24-c0c280b4c687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:19.280692 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56904f2b-f8bc-479c-aa24-c0c280b4c687 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:19.281396 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56904f2b-f8bc-479c-aa24-c0c280b4c687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:19.285735 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56904f2b-f8bc-479c-aa24-c0c280b4c687 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:19.359610 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1343/2688] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:45:19 2021] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:45:19.363642 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028b6c6-a7e9-4c7b-ba93-ac3461c3b8c0 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:19.375457 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028b6c6-a7e9-4c7b-ba93-ac3461c3b8c0 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:19.476272 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e210db5-0370-48a2-8fe9-ffc2aa9ab8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:19.476994 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e210db5-0370-48a2-8fe9-ffc2aa9ab8dd admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:19.477272 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e210db5-0370-48a2-8fe9-ffc2aa9ab8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:19.477545 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e210db5-0370-48a2-8fe9-ffc2aa9ab8dd admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:19.478379 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e210db5-0370-48a2-8fe9-ffc2aa9ab8dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:19.480596 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e210db5-0370-48a2-8fe9-ffc2aa9ab8dd admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:19.529442 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1346/2689] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:45:19 2021] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:45:19.531323 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56904f2b-f8bc-479c-aa24-c0c280b4c687 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:19.546722 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56904f2b-f8bc-479c-aa24-c0c280b4c687 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:19.559811 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f8cf1-a5ed-4ef3-ae87-e92d9bf1b133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:19.565886 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f8cf1-a5ed-4ef3-ae87-e92d9bf1b133 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:19.566455 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f8cf1-a5ed-4ef3-ae87-e92d9bf1b133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:19.566978 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f8cf1-a5ed-4ef3-ae87-e92d9bf1b133 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:19.567994 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f8cf1-a5ed-4ef3-ae87-e92d9bf1b133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:19.569884 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f8cf1-a5ed-4ef3-ae87-e92d9bf1b133 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:19.586448 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1344/2690] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:45:19 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:45:19.588243 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e210db5-0370-48a2-8fe9-ffc2aa9ab8dd admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:19.601226 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e210db5-0370-48a2-8fe9-ffc2aa9ab8dd admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:19.609771 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22322f44-fc6d-4cc8-a41e-e5838314077a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:19.610474 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22322f44-fc6d-4cc8-a41e-e5838314077a admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:19.610789 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22322f44-fc6d-4cc8-a41e-e5838314077a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:19.611065 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22322f44-fc6d-4cc8-a41e-e5838314077a admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:19.614174 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22322f44-fc6d-4cc8-a41e-e5838314077a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:19.617259 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22322f44-fc6d-4cc8-a41e-e5838314077a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:19.644763 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f8cf1-a5ed-4ef3-ae87-e92d9bf1b133 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:19.650212 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1347/2691] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:45:19 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:45:19.659791 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f8cf1-a5ed-4ef3-ae87-e92d9bf1b133 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:19.683638 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0804503-bbea-4f5d-8918-99d45cd2e2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:19.685121 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0804503-bbea-4f5d-8918-99d45cd2e2b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:19.685121 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0804503-bbea-4f5d-8918-99d45cd2e2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:19.685121 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0804503-bbea-4f5d-8918-99d45cd2e2b5 admin admin] PATH_INFO: `/v3/projects/c8f6e4cbd3514eddb0e5a62544ffbc5d/users/3cdfd970da034381aad0358472a9dcf0/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:19.709928 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0804503-bbea-4f5d-8918-99d45cd2e2b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8f6e4cbd3514eddb0e5a62544ffbc5d, user_id=3cdfd970da034381aad0358472a9dcf0, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:19.712869 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0804503-bbea-4f5d-8918-99d45cd2e2b5 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:19.730628 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1345/2692] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:45:19 2021] PUT /identity/v3/projects/c8f6e4cbd3514eddb0e5a62544ffbc5d/users/3cdfd970da034381aad0358472a9dcf0/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:45:19.742500 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e0591-1793-4ef1-93e6-abf3809a41f9 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:19.742851 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e0591-1793-4ef1-93e6-abf3809a41f9 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:19.743186 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e0591-1793-4ef1-93e6-abf3809a41f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:19.792085 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-149e0591-1793-4ef1-93e6-abf3809a41f9 None None] MFA Rules not processed for user `3cdfd970da034381aad0358472a9dcf0`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:19.795176 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-149e0591-1793-4ef1-93e6-abf3809a41f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:19.877071 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1348/2693] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:45:19 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:45:19.881777 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0804503-bbea-4f5d-8918-99d45cd2e2b5 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:19.983216 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0804503-bbea-4f5d-8918-99d45cd2e2b5 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:19.989858 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63101b74-6cfe-4e52-a79b-d37b00f857ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:19.990787 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63101b74-6cfe-4e52-a79b-d37b00f857ab admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:19.991365 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63101b74-6cfe-4e52-a79b-d37b00f857ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:19.991930 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63101b74-6cfe-4e52-a79b-d37b00f857ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:19.992807 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63101b74-6cfe-4e52-a79b-d37b00f857ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:19.995177 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63101b74-6cfe-4e52-a79b-d37b00f857ab admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:20.035750 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1346/2694] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:45:19 2021] POST /identity/v3/projects => generated 387 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:45:20.040635 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e0591-1793-4ef1-93e6-abf3809a41f9 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:20.054807 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e0591-1793-4ef1-93e6-abf3809a41f9 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:20.128661 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35a8a2-6a9f-455d-9963-59c2063c5445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:20.129364 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35a8a2-6a9f-455d-9963-59c2063c5445 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:20.129646 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35a8a2-6a9f-455d-9963-59c2063c5445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:20.129954 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35a8a2-6a9f-455d-9963-59c2063c5445 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:20.130698 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35a8a2-6a9f-455d-9963-59c2063c5445 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:20.132875 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35a8a2-6a9f-455d-9963-59c2063c5445 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:20.169130 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1349/2695] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:45:20 2021] POST /identity/v3/users => generated 300 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:45:20.172681 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63101b74-6cfe-4e52-a79b-d37b00f857ab admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:20.190547 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63101b74-6cfe-4e52-a79b-d37b00f857ab admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:20.196897 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c52df-4914-4d79-907a-99a52d23702d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:20.197588 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c52df-4914-4d79-907a-99a52d23702d admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:20.197878 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c52df-4914-4d79-907a-99a52d23702d admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:20.198151 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c52df-4914-4d79-907a-99a52d23702d admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:20.198984 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c52df-4914-4d79-907a-99a52d23702d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:20.201086 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c52df-4914-4d79-907a-99a52d23702d admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:20.218731 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1347/2696] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:45:20 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:45:20.221187 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35a8a2-6a9f-455d-9963-59c2063c5445 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:20.234880 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35a8a2-6a9f-455d-9963-59c2063c5445 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:20.241504 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ecab4-8f2b-4a12-ba89-1a646874041a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:20.243086 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ecab4-8f2b-4a12-ba89-1a646874041a admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:20.243374 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ecab4-8f2b-4a12-ba89-1a646874041a admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:20.243976 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ecab4-8f2b-4a12-ba89-1a646874041a admin admin] PATH_INFO: `/v3/projects/283c23d777ed430091c27ef78708ae96/users/14e2f23628d44b93b68a8a976bde923a/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:20.259908 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ecab4-8f2b-4a12-ba89-1a646874041a admin admin] RBAC: Authorizing `identity:create_grant(project_id=283c23d777ed430091c27ef78708ae96, user_id=14e2f23628d44b93b68a8a976bde923a, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:20.262440 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ecab4-8f2b-4a12-ba89-1a646874041a admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:20.282446 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1350/2697] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:45:20 2021] PUT /identity/v3/projects/283c23d777ed430091c27ef78708ae96/users/14e2f23628d44b93b68a8a976bde923a/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:45:20.283702 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c52df-4914-4d79-907a-99a52d23702d admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:20.294340 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c52df-4914-4d79-907a-99a52d23702d admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:20.364238 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df5c6f-5d22-4754-b5a2-10c58e44c8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:20.365167 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df5c6f-5d22-4754-b5a2-10c58e44c8df admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:20.365718 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df5c6f-5d22-4754-b5a2-10c58e44c8df admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:20.366095 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df5c6f-5d22-4754-b5a2-10c58e44c8df admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:20.367849 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df5c6f-5d22-4754-b5a2-10c58e44c8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:20.369985 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df5c6f-5d22-4754-b5a2-10c58e44c8df admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:20.391048 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1348/2698] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:45:20 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:45:20.392291 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ecab4-8f2b-4a12-ba89-1a646874041a admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:20.404834 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ecab4-8f2b-4a12-ba89-1a646874041a admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:20.414242 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd8cd0-87c1-4b9b-8f68-63b79721c980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:20.415941 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd8cd0-87c1-4b9b-8f68-63b79721c980 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:20.416596 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd8cd0-87c1-4b9b-8f68-63b79721c980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:20.416596 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd8cd0-87c1-4b9b-8f68-63b79721c980 admin admin] PATH_INFO: `/v3/projects/283c23d777ed430091c27ef78708ae96/users/14e2f23628d44b93b68a8a976bde923a/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:20.419048 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd8cd0-87c1-4b9b-8f68-63b79721c980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=283c23d777ed430091c27ef78708ae96, user_id=14e2f23628d44b93b68a8a976bde923a, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:20.422264 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd8cd0-87c1-4b9b-8f68-63b79721c980 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:20.443922 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1351/2699] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:45:20 2021] PUT /identity/v3/projects/283c23d777ed430091c27ef78708ae96/users/14e2f23628d44b93b68a8a976bde923a/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:45:20.453419 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c962c-4711-4339-ba11-a03dfbc84eda None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:20.454165 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c962c-4711-4339-ba11-a03dfbc84eda None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:20.454165 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c962c-4711-4339-ba11-a03dfbc84eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:20.498075 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-5a9c962c-4711-4339-ba11-a03dfbc84eda None None] MFA Rules not processed for user `14e2f23628d44b93b68a8a976bde923a`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:20.499914 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-5a9c962c-4711-4339-ba11-a03dfbc84eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:20.619022 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1349/2700] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:45:20 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:45:20.633642 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd8cd0-87c1-4b9b-8f68-63b79721c980 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:20.635541 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-68bd8cd0-87c1-4b9b-8f68-63b79721c980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:20.756957 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd8cd0-87c1-4b9b-8f68-63b79721c980 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:20.761752 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577d945-0fa0-4813-9b61-d31a320b00cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:20.762489 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577d945-0fa0-4813-9b61-d31a320b00cb service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:20.762882 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577d945-0fa0-4813-9b61-d31a320b00cb service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:20.763276 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577d945-0fa0-4813-9b61-d31a320b00cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:20.776303 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577d945-0fa0-4813-9b61-d31a320b00cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:20.777983 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577d945-0fa0-4813-9b61-d31a320b00cb service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:20.792811 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1352/2701] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:45:20 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:45:21.320848 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e7a0b-4878-4e9c-9d5c-377e3ae340f9 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:21.321430 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e7a0b-4878-4e9c-9d5c-377e3ae340f9 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:21.321587 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e7a0b-4878-4e9c-9d5c-377e3ae340f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:21.350761 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-fe9e7a0b-4878-4e9c-9d5c-377e3ae340f9 None None] MFA Rules not processed for user `e44b7f1a1e50499997cd7a4182d2d6c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:21.352013 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-fe9e7a0b-4878-4e9c-9d5c-377e3ae340f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:21.430486 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1350/2702] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:45:21 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:45:21.443842 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577d945-0fa0-4813-9b61-d31a320b00cb service cinder] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:21.446104 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-6577d945-0fa0-4813-9b61-d31a320b00cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:21.513065 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577d945-0fa0-4813-9b61-d31a320b00cb service cinder] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:21.516891 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5f8de-e181-422b-a1b9-6762c916c128 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a98d6cf23e4710bfbf71b960f81a9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:21.517554 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5f8de-e181-422b-a1b9-6762c916c128 service glance] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:21.518280 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5f8de-e181-422b-a1b9-6762c916c128 service glance] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:21.518583 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5f8de-e181-422b-a1b9-6762c916c128 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:21.520708 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-3ba5f8de-e181-422b-a1b9-6762c916c128 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:21.585217 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5f8de-e181-422b-a1b9-6762c916c128 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:21.586705 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5f8de-e181-422b-a1b9-6762c916c128 service glance] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:21.606865 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1353/2703] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:45:21 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:45:21.642571 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e7a0b-4878-4e9c-9d5c-377e3ae340f9 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:21.711591 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e7a0b-4878-4e9c-9d5c-377e3ae340f9 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:21.716232 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cc074-96f0-49b6-8c77-12831322df08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:21.716393 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e43ff-bae7-46ee-8a21-1571ca44cf95 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:21.716741 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e43ff-bae7-46ee-8a21-1571ca44cf95 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:21.717105 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e43ff-bae7-46ee-8a21-1571ca44cf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:21.717205 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cc074-96f0-49b6-8c77-12831322df08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:21.717383 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cc074-96f0-49b6-8c77-12831322df08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:21.717656 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cc074-96f0-49b6-8c77-12831322df08 admin admin] PATH_INFO: `/v3/users/3cdfd970da034381aad0358472a9dcf0` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:21.718988 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1cc074-96f0-49b6-8c77-12831322df08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cdfd970da034381aad0358472a9dcf0)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:21.720942 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1cc074-96f0-49b6-8c77-12831322df08 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:21.738839 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-bd1e43ff-bae7-46ee-8a21-1571ca44cf95 None None] MFA Rules not processed for user `62cc0165aee14b449c8a49233001f631`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:21.740072 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-bd1e43ff-bae7-46ee-8a21-1571ca44cf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:21.773724 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-bc1cc074-96f0-49b6-8c77-12831322df08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cdfd970da034381aad0358472a9dcf0'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:21.776775 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-bc1cc074-96f0-49b6-8c77-12831322df08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cdfd970da034381aad0358472a9dcf0'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:21.797899 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-bc1cc074-96f0-49b6-8c77-12831322df08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cdfd970da034381aad0358472a9dcf0'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:21.821231 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-bc1cc074-96f0-49b6-8c77-12831322df08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cdfd970da034381aad0358472a9dcf0'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:21.828929 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1354/2704] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Oct 28 14:45:21 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:45:21.833214 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-bc1cc074-96f0-49b6-8c77-12831322df08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cdfd970da034381aad0358472a9dcf0'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:21.846853 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1351/2705] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:45:21 2021] DELETE /identity/v3/users/3cdfd970da034381aad0358472a9dcf0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:45:21.851441 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f5d79-bd8a-4cc4-967c-b74cb61c45d2 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:21.851972 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f5d79-bd8a-4cc4-967c-b74cb61c45d2 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:21.853165 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f5d79-bd8a-4cc4-967c-b74cb61c45d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:21.877689 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-b05f5d79-bd8a-4cc4-967c-b74cb61c45d2 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:21.879053 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-b05f5d79-bd8a-4cc4-967c-b74cb61c45d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:21.891086 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cc074-96f0-49b6-8c77-12831322df08 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:21.892656 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-bc1cc074-96f0-49b6-8c77-12831322df08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:21.951315 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1355/2706] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:45:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:45:21.961724 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f5d79-bd8a-4cc4-967c-b74cb61c45d2 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:21.963272 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-b05f5d79-bd8a-4cc4-967c-b74cb61c45d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:21.980311 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cc074-96f0-49b6-8c77-12831322df08 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:21.985546 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee045c2-c426-458d-8254-f0c57c0f188d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889e7be1dcaf47f599af9c9b7ad33042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:21.986218 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee045c2-c426-458d-8254-f0c57c0f188d service swift] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:21.986500 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee045c2-c426-458d-8254-f0c57c0f188d service swift] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:21.986803 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee045c2-c426-458d-8254-f0c57c0f188d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:22.024453 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f5d79-bd8a-4cc4-967c-b74cb61c45d2 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:22.028542 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088ae93-2c1c-4346-bb2d-eda0b707aa9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:22.029299 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088ae93-2c1c-4346-bb2d-eda0b707aa9e service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:22.029638 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088ae93-2c1c-4346-bb2d-eda0b707aa9e service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:22.029973 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088ae93-2c1c-4346-bb2d-eda0b707aa9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:22.040664 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088ae93-2c1c-4346-bb2d-eda0b707aa9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:22.042216 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088ae93-2c1c-4346-bb2d-eda0b707aa9e service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:22.052746 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee045c2-c426-458d-8254-f0c57c0f188d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:22.052951 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1356/2707] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:45:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:45:22.054193 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee045c2-c426-458d-8254-f0c57c0f188d service swift] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:22.064243 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1352/2708] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Oct 28 14:45:21 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 14:45:22.449384 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088ae93-2c1c-4346-bb2d-eda0b707aa9e service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:22.450925 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-3088ae93-2c1c-4346-bb2d-eda0b707aa9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:22.468475 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088ae93-2c1c-4346-bb2d-eda0b707aa9e service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:22.474069 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80250b-f2ab-4adc-a0dd-c1b1b14392a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:22.475243 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80250b-f2ab-4adc-a0dd-c1b1b14392a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:22.475716 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80250b-f2ab-4adc-a0dd-c1b1b14392a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:22.475985 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80250b-f2ab-4adc-a0dd-c1b1b14392a7 admin admin] PATH_INFO: `/v3/projects/c8f6e4cbd3514eddb0e5a62544ffbc5d` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:22.477214 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80250b-f2ab-4adc-a0dd-c1b1b14392a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8f6e4cbd3514eddb0e5a62544ffbc5d)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:22.480177 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80250b-f2ab-4adc-a0dd-c1b1b14392a7 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:22.550118 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-3b80250b-f2ab-4adc-a0dd-c1b1b14392a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8f6e4cbd3514eddb0e5a62544ffbc5d', 'request_id': 'req-3b80250b-f2ab-4adc-a0dd-c1b1b14392a7'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:22.559118 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-3b80250b-f2ab-4adc-a0dd-c1b1b14392a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8f6e4cbd3514eddb0e5a62544ffbc5d', 'request_id': 'req-3b80250b-f2ab-4adc-a0dd-c1b1b14392a7'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:22.572093 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-3b80250b-f2ab-4adc-a0dd-c1b1b14392a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8f6e4cbd3514eddb0e5a62544ffbc5d', 'request_id': 'req-3b80250b-f2ab-4adc-a0dd-c1b1b14392a7'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:22.585294 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-3b80250b-f2ab-4adc-a0dd-c1b1b14392a7 admin admin] The token cache is being invalidate because project c8f6e4cbd3514eddb0e5a62544ffbc5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:45:22.585765 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-3b80250b-f2ab-4adc-a0dd-c1b1b14392a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:22.586422 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-3b80250b-f2ab-4adc-a0dd-c1b1b14392a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:22.590295 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1357/2709] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:45:22 2021] DELETE /identity/v3/projects/c8f6e4cbd3514eddb0e5a62544ffbc5d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:45:22.594436 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee045c2-c426-458d-8254-f0c57c0f188d service swift] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:22.608864 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee045c2-c426-458d-8254-f0c57c0f188d service swift] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:22.705777 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacd9f5-40dc-4a42-bb6c-96ee433bc4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:22.706848 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacd9f5-40dc-4a42-bb6c-96ee433bc4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:22.707254 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacd9f5-40dc-4a42-bb6c-96ee433bc4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:22.707596 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacd9f5-40dc-4a42-bb6c-96ee433bc4b8 admin admin] PATH_INFO: `/v3/users/14e2f23628d44b93b68a8a976bde923a` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:22.708955 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dacd9f5-40dc-4a42-bb6c-96ee433bc4b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14e2f23628d44b93b68a8a976bde923a)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:22.711988 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dacd9f5-40dc-4a42-bb6c-96ee433bc4b8 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:22.798503 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-2dacd9f5-40dc-4a42-bb6c-96ee433bc4b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14e2f23628d44b93b68a8a976bde923a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:22.799830 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-2dacd9f5-40dc-4a42-bb6c-96ee433bc4b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14e2f23628d44b93b68a8a976bde923a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:22.816663 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-2dacd9f5-40dc-4a42-bb6c-96ee433bc4b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14e2f23628d44b93b68a8a976bde923a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:22.827937 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-2dacd9f5-40dc-4a42-bb6c-96ee433bc4b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14e2f23628d44b93b68a8a976bde923a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:22.847083 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-2dacd9f5-40dc-4a42-bb6c-96ee433bc4b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14e2f23628d44b93b68a8a976bde923a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:22.860314 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1353/2710] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:45:22 2021] DELETE /identity/v3/users/14e2f23628d44b93b68a8a976bde923a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:45:23.235219 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80250b-f2ab-4adc-a0dd-c1b1b14392a7 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:23.236809 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-3b80250b-f2ab-4adc-a0dd-c1b1b14392a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:23.261656 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80250b-f2ab-4adc-a0dd-c1b1b14392a7 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:23.353612 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219407f-aa28-4656-a429-385a91f12521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:23.354520 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219407f-aa28-4656-a429-385a91f12521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:23.354885 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219407f-aa28-4656-a429-385a91f12521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:23.355221 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219407f-aa28-4656-a429-385a91f12521 admin admin] PATH_INFO: `/v3/projects/283c23d777ed430091c27ef78708ae96` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:23.356433 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219407f-aa28-4656-a429-385a91f12521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=283c23d777ed430091c27ef78708ae96)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:23.358509 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219407f-aa28-4656-a429-385a91f12521 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:23.412804 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-7219407f-aa28-4656-a429-385a91f12521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '283c23d777ed430091c27ef78708ae96', 'request_id': 'req-7219407f-aa28-4656-a429-385a91f12521'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:23.422552 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-7219407f-aa28-4656-a429-385a91f12521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '283c23d777ed430091c27ef78708ae96', 'request_id': 'req-7219407f-aa28-4656-a429-385a91f12521'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:23.431862 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-7219407f-aa28-4656-a429-385a91f12521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '283c23d777ed430091c27ef78708ae96', 'request_id': 'req-7219407f-aa28-4656-a429-385a91f12521'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:23.447012 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-7219407f-aa28-4656-a429-385a91f12521 admin admin] The token cache is being invalidate because project 283c23d777ed430091c27ef78708ae96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:45:23.447398 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-7219407f-aa28-4656-a429-385a91f12521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:23.448107 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-7219407f-aa28-4656-a429-385a91f12521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:23.450118 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1358/2711] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:45:23 2021] DELETE /identity/v3/projects/283c23d777ed430091c27ef78708ae96 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:45:23.455732 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b57613-c922-4e2c-bb31-aa80b0496375 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:23.456028 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b57613-c922-4e2c-bb31-aa80b0496375 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:23.456310 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b57613-c922-4e2c-bb31-aa80b0496375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:23.480875 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-62b57613-c922-4e2c-bb31-aa80b0496375 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:23.482365 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-62b57613-c922-4e2c-bb31-aa80b0496375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:23.562875 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1354/2712] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:45:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:45:23.563827 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e947e35-dba3-4d46-8db0-f6c1b16f73c1 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:23.564919 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e947e35-dba3-4d46-8db0-f6c1b16f73c1 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:23.565376 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e947e35-dba3-4d46-8db0-f6c1b16f73c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:23.586933 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-6e947e35-dba3-4d46-8db0-f6c1b16f73c1 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:23.588420 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-6e947e35-dba3-4d46-8db0-f6c1b16f73c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:23.596644 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1359/2713] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:45:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:45:23.601183 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b57613-c922-4e2c-bb31-aa80b0496375 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:23.611655 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b57613-c922-4e2c-bb31-aa80b0496375 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:23.616497 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505b3b7-ce4e-4371-a152-97c5f4dab451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:23.617275 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505b3b7-ce4e-4371-a152-97c5f4dab451 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:23.617794 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505b3b7-ce4e-4371-a152-97c5f4dab451 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:23.618312 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505b3b7-ce4e-4371-a152-97c5f4dab451 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:23.619207 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505b3b7-ce4e-4371-a152-97c5f4dab451 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:45:23.619737 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505b3b7-ce4e-4371-a152-97c5f4dab451 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:23.621491 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505b3b7-ce4e-4371-a152-97c5f4dab451 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:23.637515 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1355/2714] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:45:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:45:23.638762 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e947e35-dba3-4d46-8db0-f6c1b16f73c1 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:23.651493 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e947e35-dba3-4d46-8db0-f6c1b16f73c1 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:23.656804 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01051be3-7fb6-49a6-a41c-b37c2f8339b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:23.657484 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01051be3-7fb6-49a6-a41c-b37c2f8339b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:23.657939 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01051be3-7fb6-49a6-a41c-b37c2f8339b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:23.658250 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01051be3-7fb6-49a6-a41c-b37c2f8339b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:23.659516 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01051be3-7fb6-49a6-a41c-b37c2f8339b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:23.662028 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01051be3-7fb6-49a6-a41c-b37c2f8339b0 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:23.704155 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1360/2715] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:45:23 2021] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:45:23.705730 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505b3b7-ce4e-4371-a152-97c5f4dab451 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:23.718636 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505b3b7-ce4e-4371-a152-97c5f4dab451 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:23.804316 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058d6d3-5ec2-4842-835d-79dbef84dc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:23.805062 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058d6d3-5ec2-4842-835d-79dbef84dc93 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:23.805338 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058d6d3-5ec2-4842-835d-79dbef84dc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:23.805611 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058d6d3-5ec2-4842-835d-79dbef84dc93 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:23.806326 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058d6d3-5ec2-4842-835d-79dbef84dc93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:23.812063 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058d6d3-5ec2-4842-835d-79dbef84dc93 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:23.846019 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1356/2716] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:45:23 2021] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:45:23.847330 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01051be3-7fb6-49a6-a41c-b37c2f8339b0 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:23.858242 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01051be3-7fb6-49a6-a41c-b37c2f8339b0 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:23.863567 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add7658-b6d4-495f-86bd-d1b754323508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:23.864981 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add7658-b6d4-495f-86bd-d1b754323508 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:23.865688 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add7658-b6d4-495f-86bd-d1b754323508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:23.865688 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add7658-b6d4-495f-86bd-d1b754323508 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:23.866296 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add7658-b6d4-495f-86bd-d1b754323508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:23.868042 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add7658-b6d4-495f-86bd-d1b754323508 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:23.882605 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1361/2717] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:45:23 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:45:23.885267 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058d6d3-5ec2-4842-835d-79dbef84dc93 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:23.896521 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058d6d3-5ec2-4842-835d-79dbef84dc93 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:23.910445 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cb3ec-b0e8-48c0-ab4f-654eba856252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:23.911694 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cb3ec-b0e8-48c0-ab4f-654eba856252 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:23.912054 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cb3ec-b0e8-48c0-ab4f-654eba856252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:23.912521 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cb3ec-b0e8-48c0-ab4f-654eba856252 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:23.913281 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2cb3ec-b0e8-48c0-ab4f-654eba856252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:23.915058 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2cb3ec-b0e8-48c0-ab4f-654eba856252 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:23.929506 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1357/2718] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:45:23 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:45:23.934071 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add7658-b6d4-495f-86bd-d1b754323508 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:23.946372 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add7658-b6d4-495f-86bd-d1b754323508 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:23.951420 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021dce6-5a7c-4ff1-b388-d8f450cc84be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:23.952528 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021dce6-5a7c-4ff1-b388-d8f450cc84be admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:23.952828 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021dce6-5a7c-4ff1-b388-d8f450cc84be admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:23.953184 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021dce6-5a7c-4ff1-b388-d8f450cc84be admin admin] PATH_INFO: `/v3/projects/b1821358d003489598030771b9561f58/users/491f9392dd394108bb4b7e1c56e4e01d/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:23.971457 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021dce6-5a7c-4ff1-b388-d8f450cc84be admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1821358d003489598030771b9561f58, user_id=491f9392dd394108bb4b7e1c56e4e01d, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:23.974560 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021dce6-5a7c-4ff1-b388-d8f450cc84be admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:23.992573 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1362/2719] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:45:23 2021] PUT /identity/v3/projects/b1821358d003489598030771b9561f58/users/491f9392dd394108bb4b7e1c56e4e01d/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:45:24.004728 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feecc6c-0d2a-496d-ba53-05cc2bd85390 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:24.005068 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feecc6c-0d2a-496d-ba53-05cc2bd85390 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:24.005289 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feecc6c-0d2a-496d-ba53-05cc2bd85390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:24.041825 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-7feecc6c-0d2a-496d-ba53-05cc2bd85390 None None] MFA Rules not processed for user `491f9392dd394108bb4b7e1c56e4e01d`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:24.043200 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-7feecc6c-0d2a-496d-ba53-05cc2bd85390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:24.127266 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1358/2720] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:45:24 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:45:24.131636 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021dce6-5a7c-4ff1-b388-d8f450cc84be admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:24.196155 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021dce6-5a7c-4ff1-b388-d8f450cc84be admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:24.201008 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03fe45-69c5-4ced-aed9-ccc86017b587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:24.201672 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03fe45-69c5-4ced-aed9-ccc86017b587 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:24.201975 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03fe45-69c5-4ced-aed9-ccc86017b587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:24.202461 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03fe45-69c5-4ced-aed9-ccc86017b587 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:24.203246 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03fe45-69c5-4ced-aed9-ccc86017b587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:24.205129 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03fe45-69c5-4ced-aed9-ccc86017b587 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:24.237688 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1363/2721] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:45:24 2021] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:45:24.242663 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feecc6c-0d2a-496d-ba53-05cc2bd85390 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:24.255774 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feecc6c-0d2a-496d-ba53-05cc2bd85390 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:24.333392 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277246a1-8be2-4828-8ebd-f22eb99cefbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:24.334440 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277246a1-8be2-4828-8ebd-f22eb99cefbd admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:24.334905 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277246a1-8be2-4828-8ebd-f22eb99cefbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:24.335215 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277246a1-8be2-4828-8ebd-f22eb99cefbd admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:24.336312 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277246a1-8be2-4828-8ebd-f22eb99cefbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:24.341229 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277246a1-8be2-4828-8ebd-f22eb99cefbd admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:24.367817 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1359/2722] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:45:24 2021] POST /identity/v3/users => generated 297 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:45:24.371885 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03fe45-69c5-4ced-aed9-ccc86017b587 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:24.385359 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03fe45-69c5-4ced-aed9-ccc86017b587 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:24.390972 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390932c-2355-40fb-a0a9-3bc4151f984d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:24.391946 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390932c-2355-40fb-a0a9-3bc4151f984d admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:24.392447 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390932c-2355-40fb-a0a9-3bc4151f984d admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:24.392816 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390932c-2355-40fb-a0a9-3bc4151f984d admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:24.393849 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390932c-2355-40fb-a0a9-3bc4151f984d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:24.395656 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390932c-2355-40fb-a0a9-3bc4151f984d admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:24.410736 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1364/2723] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:45:24 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:45:24.412775 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277246a1-8be2-4828-8ebd-f22eb99cefbd admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:24.425172 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277246a1-8be2-4828-8ebd-f22eb99cefbd admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:24.432287 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da4319-605c-4621-b298-ce50e787f37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:24.433318 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da4319-605c-4621-b298-ce50e787f37c admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:24.433754 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da4319-605c-4621-b298-ce50e787f37c admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:24.434036 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da4319-605c-4621-b298-ce50e787f37c admin admin] PATH_INFO: `/v3/projects/248c190f94b346c4b9c41fcbe4398f6d/users/332e6ab89d69474d83fdb89624fba689/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:24.452230 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da4319-605c-4621-b298-ce50e787f37c admin admin] RBAC: Authorizing `identity:create_grant(project_id=248c190f94b346c4b9c41fcbe4398f6d, user_id=332e6ab89d69474d83fdb89624fba689, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:24.457321 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da4319-605c-4621-b298-ce50e787f37c admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:24.475464 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1360/2724] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:45:24 2021] PUT /identity/v3/projects/248c190f94b346c4b9c41fcbe4398f6d/users/332e6ab89d69474d83fdb89624fba689/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:45:24.479580 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390932c-2355-40fb-a0a9-3bc4151f984d admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:24.493447 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390932c-2355-40fb-a0a9-3bc4151f984d admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:24.557747 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abb877-d931-49ad-afa8-d312e1c4004b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:24.558462 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abb877-d931-49ad-afa8-d312e1c4004b admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:24.558789 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abb877-d931-49ad-afa8-d312e1c4004b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:24.559063 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abb877-d931-49ad-afa8-d312e1c4004b admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:24.559819 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abb877-d931-49ad-afa8-d312e1c4004b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:24.561421 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abb877-d931-49ad-afa8-d312e1c4004b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:24.575265 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1365/2725] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:45:24 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:45:24.576498 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da4319-605c-4621-b298-ce50e787f37c admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:24.587779 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da4319-605c-4621-b298-ce50e787f37c admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:24.594620 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb572d2-79eb-47a3-bd0e-1f2d79cddb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:24.595632 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb572d2-79eb-47a3-bd0e-1f2d79cddb0b admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:24.595992 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb572d2-79eb-47a3-bd0e-1f2d79cddb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:24.596330 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb572d2-79eb-47a3-bd0e-1f2d79cddb0b admin admin] PATH_INFO: `/v3/projects/248c190f94b346c4b9c41fcbe4398f6d/users/332e6ab89d69474d83fdb89624fba689/roles/f7b8954a0fe64dc2b6146c7174498ddb` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:24.598408 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb572d2-79eb-47a3-bd0e-1f2d79cddb0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=248c190f94b346c4b9c41fcbe4398f6d, user_id=332e6ab89d69474d83fdb89624fba689, role_id=f7b8954a0fe64dc2b6146c7174498ddb)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:24.601305 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb572d2-79eb-47a3-bd0e-1f2d79cddb0b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:24.612714 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1361/2726] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:45:24 2021] PUT /identity/v3/projects/248c190f94b346c4b9c41fcbe4398f6d/users/332e6ab89d69474d83fdb89624fba689/roles/f7b8954a0fe64dc2b6146c7174498ddb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:45:24.623237 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74e2e8-fac5-4f49-99a4-2453ebbd8797 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:24.625659 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74e2e8-fac5-4f49-99a4-2453ebbd8797 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:24.626131 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74e2e8-fac5-4f49-99a4-2453ebbd8797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:24.657538 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-5d74e2e8-fac5-4f49-99a4-2453ebbd8797 None None] MFA Rules not processed for user `332e6ab89d69474d83fdb89624fba689`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:24.659279 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-5d74e2e8-fac5-4f49-99a4-2453ebbd8797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:24.768519 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1366/2727] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:45:24 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:45:24.779288 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb572d2-79eb-47a3-bd0e-1f2d79cddb0b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:24.781580 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-3cb572d2-79eb-47a3-bd0e-1f2d79cddb0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:24.851027 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb572d2-79eb-47a3-bd0e-1f2d79cddb0b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:24.854989 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b31b6-f3c6-4e56-adc1-b1885b371eef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:24.855659 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b31b6-f3c6-4e56-adc1-b1885b371eef service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:24.855939 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b31b6-f3c6-4e56-adc1-b1885b371eef service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:24.856215 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b31b6-f3c6-4e56-adc1-b1885b371eef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:24.868064 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b31b6-f3c6-4e56-adc1-b1885b371eef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:24.869536 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b31b6-f3c6-4e56-adc1-b1885b371eef service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:24.885763 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1362/2728] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:45:24 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:45:25.310065 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74e2e8-fac5-4f49-99a4-2453ebbd8797 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:25.393339 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74e2e8-fac5-4f49-99a4-2453ebbd8797 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:25.400341 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cc4fb-f8cc-453f-b206-a0e753420b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:25.401441 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cc4fb-f8cc-453f-b206-a0e753420b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:25.401874 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cc4fb-f8cc-453f-b206-a0e753420b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:25.402731 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cc4fb-f8cc-453f-b206-a0e753420b42 admin admin] PATH_INFO: `/v3/users/491f9392dd394108bb4b7e1c56e4e01d` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:25.404076 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cc4fb-f8cc-453f-b206-a0e753420b42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=491f9392dd394108bb4b7e1c56e4e01d)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:25.406132 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cc4fb-f8cc-453f-b206-a0e753420b42 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:25.472921 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-174cc4fb-f8cc-453f-b206-a0e753420b42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '491f9392dd394108bb4b7e1c56e4e01d'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:25.483173 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-174cc4fb-f8cc-453f-b206-a0e753420b42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '491f9392dd394108bb4b7e1c56e4e01d'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:25.484111 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-174cc4fb-f8cc-453f-b206-a0e753420b42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '491f9392dd394108bb4b7e1c56e4e01d'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:25.504400 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-174cc4fb-f8cc-453f-b206-a0e753420b42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '491f9392dd394108bb4b7e1c56e4e01d'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:25.512577 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-174cc4fb-f8cc-453f-b206-a0e753420b42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '491f9392dd394108bb4b7e1c56e4e01d'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:25.519381 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1367/2729] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:45:25 2021] DELETE /identity/v3/users/491f9392dd394108bb4b7e1c56e4e01d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:45:25.523901 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7717b22-1f89-4cf2-9b7b-d00d77804879 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:25.524340 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7717b22-1f89-4cf2-9b7b-d00d77804879 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:25.524820 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7717b22-1f89-4cf2-9b7b-d00d77804879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:25.544402 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-b7717b22-1f89-4cf2-9b7b-d00d77804879 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:25.546202 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-b7717b22-1f89-4cf2-9b7b-d00d77804879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:25.622938 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1363/2730] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:45:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:45:25.635030 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cc4fb-f8cc-453f-b206-a0e753420b42 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:25.636628 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-174cc4fb-f8cc-453f-b206-a0e753420b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:25.711295 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cc4fb-f8cc-453f-b206-a0e753420b42 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:25.715212 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb441b17-53f3-4b03-a008-1a8282dae4bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:25.715981 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb441b17-53f3-4b03-a008-1a8282dae4bd service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:25.716310 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb441b17-53f3-4b03-a008-1a8282dae4bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:25.716626 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb441b17-53f3-4b03-a008-1a8282dae4bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:25.739368 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb441b17-53f3-4b03-a008-1a8282dae4bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:25.740802 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb441b17-53f3-4b03-a008-1a8282dae4bd service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:25.752302 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1368/2731] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:45:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:45:26.090673 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7717b22-1f89-4cf2-9b7b-d00d77804879 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:26.093417 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-b7717b22-1f89-4cf2-9b7b-d00d77804879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:26.109392 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7717b22-1f89-4cf2-9b7b-d00d77804879 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:26.114489 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9a03b-3248-4fea-8235-59f9e393fdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:26.115438 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9a03b-3248-4fea-8235-59f9e393fdeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:26.115731 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9a03b-3248-4fea-8235-59f9e393fdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:26.116010 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9a03b-3248-4fea-8235-59f9e393fdeb admin admin] PATH_INFO: `/v3/projects/b1821358d003489598030771b9561f58` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:26.117464 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9a03b-3248-4fea-8235-59f9e393fdeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1821358d003489598030771b9561f58)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:26.119569 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9a03b-3248-4fea-8235-59f9e393fdeb admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:26.218278 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e7f9a03b-3248-4fea-8235-59f9e393fdeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1821358d003489598030771b9561f58', 'request_id': 'req-e7f9a03b-3248-4fea-8235-59f9e393fdeb'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:26.231900 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e7f9a03b-3248-4fea-8235-59f9e393fdeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1821358d003489598030771b9561f58', 'request_id': 'req-e7f9a03b-3248-4fea-8235-59f9e393fdeb'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:26.251466 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e7f9a03b-3248-4fea-8235-59f9e393fdeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1821358d003489598030771b9561f58', 'request_id': 'req-e7f9a03b-3248-4fea-8235-59f9e393fdeb'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:26.262936 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e7f9a03b-3248-4fea-8235-59f9e393fdeb admin admin] The token cache is being invalidate because project b1821358d003489598030771b9561f58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:45:26.263225 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e7f9a03b-3248-4fea-8235-59f9e393fdeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:26.263897 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-e7f9a03b-3248-4fea-8235-59f9e393fdeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:26.265754 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1364/2732] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:45:26 2021] DELETE /identity/v3/projects/b1821358d003489598030771b9561f58 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:45:26.269594 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb441b17-53f3-4b03-a008-1a8282dae4bd service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:26.281930 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb441b17-53f3-4b03-a008-1a8282dae4bd service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:26.395422 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061abe70-c169-46b5-bad7-36d1e13ebd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:26.396549 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061abe70-c169-46b5-bad7-36d1e13ebd9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:26.396947 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061abe70-c169-46b5-bad7-36d1e13ebd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:26.397594 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061abe70-c169-46b5-bad7-36d1e13ebd9b admin admin] PATH_INFO: `/v3/users/332e6ab89d69474d83fdb89624fba689` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:26.400043 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061abe70-c169-46b5-bad7-36d1e13ebd9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=332e6ab89d69474d83fdb89624fba689)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:26.403423 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061abe70-c169-46b5-bad7-36d1e13ebd9b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:26.496978 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-061abe70-c169-46b5-bad7-36d1e13ebd9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '332e6ab89d69474d83fdb89624fba689'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:26.508091 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-061abe70-c169-46b5-bad7-36d1e13ebd9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '332e6ab89d69474d83fdb89624fba689'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:26.509175 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-061abe70-c169-46b5-bad7-36d1e13ebd9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '332e6ab89d69474d83fdb89624fba689'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:26.535239 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-061abe70-c169-46b5-bad7-36d1e13ebd9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '332e6ab89d69474d83fdb89624fba689'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:26.553806 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-061abe70-c169-46b5-bad7-36d1e13ebd9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '332e6ab89d69474d83fdb89624fba689'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:26.562910 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1369/2733] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:45:26 2021] DELETE /identity/v3/users/332e6ab89d69474d83fdb89624fba689 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:45:27.054445 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9a03b-3248-4fea-8235-59f9e393fdeb admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:27.055929 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e7f9a03b-3248-4fea-8235-59f9e393fdeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:27.079892 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9a03b-3248-4fea-8235-59f9e393fdeb admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:27.161992 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c34f0-7903-42c4-bdcd-8533c3bc8720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:27.163389 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c34f0-7903-42c4-bdcd-8533c3bc8720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:27.163834 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c34f0-7903-42c4-bdcd-8533c3bc8720 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:27.164271 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c34f0-7903-42c4-bdcd-8533c3bc8720 admin admin] PATH_INFO: `/v3/projects/248c190f94b346c4b9c41fcbe4398f6d` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:27.165888 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c34f0-7903-42c4-bdcd-8533c3bc8720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=248c190f94b346c4b9c41fcbe4398f6d)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:27.168079 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c34f0-7903-42c4-bdcd-8533c3bc8720 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:27.235057 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-5f7c34f0-7903-42c4-bdcd-8533c3bc8720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '248c190f94b346c4b9c41fcbe4398f6d', 'request_id': 'req-5f7c34f0-7903-42c4-bdcd-8533c3bc8720'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:27.242405 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-5f7c34f0-7903-42c4-bdcd-8533c3bc8720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '248c190f94b346c4b9c41fcbe4398f6d', 'request_id': 'req-5f7c34f0-7903-42c4-bdcd-8533c3bc8720'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:27.255160 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-5f7c34f0-7903-42c4-bdcd-8533c3bc8720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '248c190f94b346c4b9c41fcbe4398f6d', 'request_id': 'req-5f7c34f0-7903-42c4-bdcd-8533c3bc8720'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:27.268477 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-5f7c34f0-7903-42c4-bdcd-8533c3bc8720 admin admin] The token cache is being invalidate because project 248c190f94b346c4b9c41fcbe4398f6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:45:27.268477 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-5f7c34f0-7903-42c4-bdcd-8533c3bc8720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:27.271567 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-5f7c34f0-7903-42c4-bdcd-8533c3bc8720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:45:27.273919 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1365/2734] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:45:27 2021] DELETE /identity/v3/projects/248c190f94b346c4b9c41fcbe4398f6d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:45:27.281501 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088807f-cdd0-48a3-8ac9-eb3589e830c2 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:27.281990 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088807f-cdd0-48a3-8ac9-eb3589e830c2 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:27.282269 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088807f-cdd0-48a3-8ac9-eb3589e830c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:27.305106 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-2088807f-cdd0-48a3-8ac9-eb3589e830c2 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:27.306358 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-2088807f-cdd0-48a3-8ac9-eb3589e830c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:27.385281 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1370/2735] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:45:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:45:27.392785 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c64f0-da9d-4382-9721-35e4fb1808bd None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:27.393086 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c64f0-da9d-4382-9721-35e4fb1808bd None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:27.393365 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c64f0-da9d-4382-9721-35e4fb1808bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:27.422311 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-fb7c64f0-da9d-4382-9721-35e4fb1808bd None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:27.423551 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-fb7c64f0-da9d-4382-9721-35e4fb1808bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:27.433994 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1366/2736] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:45:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:45:27.438389 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088807f-cdd0-48a3-8ac9-eb3589e830c2 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:27.450031 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088807f-cdd0-48a3-8ac9-eb3589e830c2 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:27.455755 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92c8f3-ddb0-4d57-b6b4-0cbbebca96af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:27.456436 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92c8f3-ddb0-4d57-b6b4-0cbbebca96af admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:27.456712 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92c8f3-ddb0-4d57-b6b4-0cbbebca96af admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:27.456976 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92c8f3-ddb0-4d57-b6b4-0cbbebca96af admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:27.458050 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92c8f3-ddb0-4d57-b6b4-0cbbebca96af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:45:27.458355 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92c8f3-ddb0-4d57-b6b4-0cbbebca96af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:27.460005 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92c8f3-ddb0-4d57-b6b4-0cbbebca96af admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:27.475721 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1371/2737] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:45:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:45:27.480139 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c64f0-da9d-4382-9721-35e4fb1808bd None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:27.492035 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c64f0-da9d-4382-9721-35e4fb1808bd None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:27.496874 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3951e-a255-49cc-baf2-bffe4c03ecc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:27.497555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3951e-a255-49cc-baf2-bffe4c03ecc9 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:27.497832 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3951e-a255-49cc-baf2-bffe4c03ecc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:27.498101 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3951e-a255-49cc-baf2-bffe4c03ecc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:27.498892 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3951e-a255-49cc-baf2-bffe4c03ecc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:27.501008 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3951e-a255-49cc-baf2-bffe4c03ecc9 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:27.531164 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1367/2738] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:45:27 2021] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:45:27.535590 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92c8f3-ddb0-4d57-b6b4-0cbbebca96af admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:27.549333 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92c8f3-ddb0-4d57-b6b4-0cbbebca96af admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:27.614899 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9548ce-2410-4570-b975-1f948f4aa740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:27.615780 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9548ce-2410-4570-b975-1f948f4aa740 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:27.615974 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9548ce-2410-4570-b975-1f948f4aa740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:27.616244 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9548ce-2410-4570-b975-1f948f4aa740 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:27.617169 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9548ce-2410-4570-b975-1f948f4aa740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:27.619244 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9548ce-2410-4570-b975-1f948f4aa740 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:27.642721 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1372/2739] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:45:27 2021] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:45:27.646175 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3951e-a255-49cc-baf2-bffe4c03ecc9 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:27.659324 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3951e-a255-49cc-baf2-bffe4c03ecc9 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:27.664455 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e09e6-510e-42d9-a2d8-965274c8cf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:27.665165 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e09e6-510e-42d9-a2d8-965274c8cf33 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:27.665446 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e09e6-510e-42d9-a2d8-965274c8cf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:27.665715 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e09e6-510e-42d9-a2d8-965274c8cf33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:27.666523 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e09e6-510e-42d9-a2d8-965274c8cf33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:27.668173 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e09e6-510e-42d9-a2d8-965274c8cf33 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:27.680758 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1368/2740] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:45:27 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:45:27.684643 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9548ce-2410-4570-b975-1f948f4aa740 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:27.696527 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9548ce-2410-4570-b975-1f948f4aa740 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:27.703118 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7951037-9c34-484e-8f55-cb07853c3c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:27.703798 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7951037-9c34-484e-8f55-cb07853c3c9f admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:27.704077 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7951037-9c34-484e-8f55-cb07853c3c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:27.704349 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7951037-9c34-484e-8f55-cb07853c3c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:27.705093 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7951037-9c34-484e-8f55-cb07853c3c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:27.706717 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7951037-9c34-484e-8f55-cb07853c3c9f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:27.717865 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1373/2741] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:45:27 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:45:27.721873 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e09e6-510e-42d9-a2d8-965274c8cf33 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:27.735056 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e09e6-510e-42d9-a2d8-965274c8cf33 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:27.741615 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80094511-4e6f-4101-b156-5d72ef0e6bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:27.742519 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80094511-4e6f-4101-b156-5d72ef0e6bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:27.742830 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80094511-4e6f-4101-b156-5d72ef0e6bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:27.743100 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80094511-4e6f-4101-b156-5d72ef0e6bc0 admin admin] PATH_INFO: `/v3/projects/d4ab3d1f73894c17a95606553c20d706/users/b982788f632945fb9d95405a69be7845/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:27.760099 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80094511-4e6f-4101-b156-5d72ef0e6bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ab3d1f73894c17a95606553c20d706, user_id=b982788f632945fb9d95405a69be7845, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:27.764292 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80094511-4e6f-4101-b156-5d72ef0e6bc0 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:27.782731 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1369/2742] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:45:27 2021] PUT /identity/v3/projects/d4ab3d1f73894c17a95606553c20d706/users/b982788f632945fb9d95405a69be7845/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:45:27.790957 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4a75f-db53-4f00-91db-f917d9b99285 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:27.791501 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4a75f-db53-4f00-91db-f917d9b99285 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:27.792028 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4a75f-db53-4f00-91db-f917d9b99285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:27.825469 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-dab4a75f-db53-4f00-91db-f917d9b99285 None None] MFA Rules not processed for user `b982788f632945fb9d95405a69be7845`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:27.826725 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-dab4a75f-db53-4f00-91db-f917d9b99285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:27.914715 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1374/2743] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:45:27 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:45:27.923789 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80094511-4e6f-4101-b156-5d72ef0e6bc0 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:27.927706 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-80094511-4e6f-4101-b156-5d72ef0e6bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:27.991497 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80094511-4e6f-4101-b156-5d72ef0e6bc0 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:27.996874 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55eb769-6823-49e9-ba2c-0c4257d83890 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a98d6cf23e4710bfbf71b960f81a9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:27.997539 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55eb769-6823-49e9-ba2c-0c4257d83890 service glance] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:27.997818 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55eb769-6823-49e9-ba2c-0c4257d83890 service glance] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:27.998087 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55eb769-6823-49e9-ba2c-0c4257d83890 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:28.007908 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55eb769-6823-49e9-ba2c-0c4257d83890 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:28.010595 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55eb769-6823-49e9-ba2c-0c4257d83890 service glance] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:28.020725 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1370/2744] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:45:27 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:45:32.130154 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612c5c2-4b0a-4d2d-9b03-c2d8196ecd27 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:32.130727 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612c5c2-4b0a-4d2d-9b03-c2d8196ecd27 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:32.130727 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612c5c2-4b0a-4d2d-9b03-c2d8196ecd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:32.148872 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-0612c5c2-4b0a-4d2d-9b03-c2d8196ecd27 None None] MFA Rules not processed for user `efb3930f2a614e66944c99814a426a75`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:32.150080 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-0612c5c2-4b0a-4d2d-9b03-c2d8196ecd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:32.210698 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1375/2745] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:45:32 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:45:34.014351 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a536b7-bfaa-4139-a5bc-44180b2884b0 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:34.014905 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a536b7-bfaa-4139-a5bc-44180b2884b0 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:34.015004 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a536b7-bfaa-4139-a5bc-44180b2884b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:34.032940 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-54a536b7-bfaa-4139-a5bc-44180b2884b0 None None] MFA Rules not processed for user `62cc0165aee14b449c8a49233001f631`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:45:34.034251 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-54a536b7-bfaa-4139-a5bc-44180b2884b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:34.091730 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1371/2746] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Oct 28 14:45:34 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:45:34.106093 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612c5c2-4b0a-4d2d-9b03-c2d8196ecd27 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:45:34.107894 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-0612c5c2-4b0a-4d2d-9b03-c2d8196ecd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:45:34.186955 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612c5c2-4b0a-4d2d-9b03-c2d8196ecd27 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:45:34.192067 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3edf44-43ec-4b9e-9971-2a119edaa021 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889e7be1dcaf47f599af9c9b7ad33042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:45:34.192753 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3edf44-43ec-4b9e-9971-2a119edaa021 service swift] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:45:34.193030 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3edf44-43ec-4b9e-9971-2a119edaa021 service swift] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:45:34.193299 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3edf44-43ec-4b9e-9971-2a119edaa021 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:45:34.202386 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3edf44-43ec-4b9e-9971-2a119edaa021 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:45:34.204053 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3edf44-43ec-4b9e-9971-2a119edaa021 service swift] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:45:34.212714 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1376/2747] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Oct 28 14:45:34 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 14:46:01.450657 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a536b7-bfaa-4139-a5bc-44180b2884b0 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:01.518876 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a536b7-bfaa-4139-a5bc-44180b2884b0 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:01.523805 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e766844-b546-44b7-9f20-db1e1ca92954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:01.524672 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e766844-b546-44b7-9f20-db1e1ca92954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:01.524952 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e766844-b546-44b7-9f20-db1e1ca92954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:01.525219 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e766844-b546-44b7-9f20-db1e1ca92954 admin admin] PATH_INFO: `/v3/users/b982788f632945fb9d95405a69be7845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:01.526462 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e766844-b546-44b7-9f20-db1e1ca92954 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b982788f632945fb9d95405a69be7845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:01.528438 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e766844-b546-44b7-9f20-db1e1ca92954 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:01.581810 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1e766844-b546-44b7-9f20-db1e1ca92954 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b982788f632945fb9d95405a69be7845'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:01.582597 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1e766844-b546-44b7-9f20-db1e1ca92954 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b982788f632945fb9d95405a69be7845'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:01.591022 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1e766844-b546-44b7-9f20-db1e1ca92954 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b982788f632945fb9d95405a69be7845'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:01.597841 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1e766844-b546-44b7-9f20-db1e1ca92954 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b982788f632945fb9d95405a69be7845'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:01.610116 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1e766844-b546-44b7-9f20-db1e1ca92954 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b982788f632945fb9d95405a69be7845'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:01.616129 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1372/2748] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:46:01 2021] DELETE /identity/v3/users/b982788f632945fb9d95405a69be7845 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:46:01.621121 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b80bf-100d-4133-b62c-27229f6335fe None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:01.621696 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b80bf-100d-4133-b62c-27229f6335fe None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:01.621696 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b80bf-100d-4133-b62c-27229f6335fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:01.641145 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-8f1b80bf-100d-4133-b62c-27229f6335fe None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:46:01.642374 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-8f1b80bf-100d-4133-b62c-27229f6335fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:01.703616 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1377/2749] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:46:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:46:01.713768 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e766844-b546-44b7-9f20-db1e1ca92954 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:01.715448 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-1e766844-b546-44b7-9f20-db1e1ca92954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:01.781187 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e766844-b546-44b7-9f20-db1e1ca92954 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:01.787199 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeac245-f32b-43a8-969e-d52f97446f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:01.787938 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeac245-f32b-43a8-969e-d52f97446f4d service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:01.788394 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeac245-f32b-43a8-969e-d52f97446f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:01.788874 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeac245-f32b-43a8-969e-d52f97446f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:01.801933 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeac245-f32b-43a8-969e-d52f97446f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:01.803612 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeac245-f32b-43a8-969e-d52f97446f4d service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:01.813597 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1373/2750] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:46:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:46:02.079219 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b80bf-100d-4133-b62c-27229f6335fe None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:02.080647 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-8f1b80bf-100d-4133-b62c-27229f6335fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:02.094821 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b80bf-100d-4133-b62c-27229f6335fe None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:02.099809 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a27e8-9bfb-463b-8af7-a2bf86400716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:02.100684 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a27e8-9bfb-463b-8af7-a2bf86400716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:02.100961 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a27e8-9bfb-463b-8af7-a2bf86400716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:02.101266 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a27e8-9bfb-463b-8af7-a2bf86400716 admin admin] PATH_INFO: `/v3/projects/d4ab3d1f73894c17a95606553c20d706` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:02.102418 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a27e8-9bfb-463b-8af7-a2bf86400716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4ab3d1f73894c17a95606553c20d706)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:02.104358 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a27e8-9bfb-463b-8af7-a2bf86400716 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:02.151823 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4b5a27e8-9bfb-463b-8af7-a2bf86400716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4ab3d1f73894c17a95606553c20d706', 'request_id': 'req-4b5a27e8-9bfb-463b-8af7-a2bf86400716'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:02.158284 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4b5a27e8-9bfb-463b-8af7-a2bf86400716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4ab3d1f73894c17a95606553c20d706', 'request_id': 'req-4b5a27e8-9bfb-463b-8af7-a2bf86400716'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:02.168406 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4b5a27e8-9bfb-463b-8af7-a2bf86400716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4ab3d1f73894c17a95606553c20d706', 'request_id': 'req-4b5a27e8-9bfb-463b-8af7-a2bf86400716'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:02.181319 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4b5a27e8-9bfb-463b-8af7-a2bf86400716 admin admin] The token cache is being invalidate because project d4ab3d1f73894c17a95606553c20d706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:46:02.181591 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4b5a27e8-9bfb-463b-8af7-a2bf86400716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:02.182317 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4b5a27e8-9bfb-463b-8af7-a2bf86400716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:02.183982 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1378/2751] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:46:02 2021] DELETE /identity/v3/projects/d4ab3d1f73894c17a95606553c20d706 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:46:02.190055 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5db32d-0aa1-4630-aaaa-a2b2a00cf237 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:02.190345 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5db32d-0aa1-4630-aaaa-a2b2a00cf237 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:02.190618 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5db32d-0aa1-4630-aaaa-a2b2a00cf237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:02.208997 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-cb5db32d-0aa1-4630-aaaa-a2b2a00cf237 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:46:02.210210 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-cb5db32d-0aa1-4630-aaaa-a2b2a00cf237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:02.270856 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1374/2752] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:46:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:46:02.283312 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239cb28-1d0c-4427-a440-364e2b907b4a None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:02.283819 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239cb28-1d0c-4427-a440-364e2b907b4a None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:02.284317 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239cb28-1d0c-4427-a440-364e2b907b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:02.309197 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-5239cb28-1d0c-4427-a440-364e2b907b4a None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:46:02.310429 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-5239cb28-1d0c-4427-a440-364e2b907b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:02.320302 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1379/2753] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:46:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:46:02.324189 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5db32d-0aa1-4630-aaaa-a2b2a00cf237 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:02.334333 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5db32d-0aa1-4630-aaaa-a2b2a00cf237 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:02.340224 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe958d-5503-49d4-91f2-692e3b1d4ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:02.340891 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe958d-5503-49d4-91f2-692e3b1d4ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:02.341263 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe958d-5503-49d4-91f2-692e3b1d4ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:02.341536 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe958d-5503-49d4-91f2-692e3b1d4ee0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:02.342280 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe958d-5503-49d4-91f2-692e3b1d4ee0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:46:02.342586 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe958d-5503-49d4-91f2-692e3b1d4ee0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:02.344229 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe958d-5503-49d4-91f2-692e3b1d4ee0 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:02.356375 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1375/2754] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:46:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 14:46:02.360945 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239cb28-1d0c-4427-a440-364e2b907b4a None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:02.370537 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239cb28-1d0c-4427-a440-364e2b907b4a None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:02.376290 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750a1ed-aa9b-4ab8-bf48-afbef28811bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:02.376949 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750a1ed-aa9b-4ab8-bf48-afbef28811bc admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:02.377227 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750a1ed-aa9b-4ab8-bf48-afbef28811bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:02.377497 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750a1ed-aa9b-4ab8-bf48-afbef28811bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:02.378201 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750a1ed-aa9b-4ab8-bf48-afbef28811bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:02.380127 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750a1ed-aa9b-4ab8-bf48-afbef28811bc admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:02.408830 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1380/2755] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:46:02 2021] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:46:02.413413 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe958d-5503-49d4-91f2-692e3b1d4ee0 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:02.423758 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe958d-5503-49d4-91f2-692e3b1d4ee0 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:02.484132 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb1469-519a-4364-81ec-63e681cb5fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:02.484825 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb1469-519a-4364-81ec-63e681cb5fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:02.485150 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb1469-519a-4364-81ec-63e681cb5fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:02.485422 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb1469-519a-4364-81ec-63e681cb5fd5 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:02.486163 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb1469-519a-4364-81ec-63e681cb5fd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:02.488111 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb1469-519a-4364-81ec-63e681cb5fd5 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:02.510296 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1376/2756] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:46:02 2021] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:46:02.514350 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750a1ed-aa9b-4ab8-bf48-afbef28811bc admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:02.526120 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750a1ed-aa9b-4ab8-bf48-afbef28811bc admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:02.531227 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f392d-1d6f-49b9-b21e-4d2d9dea24ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:02.531897 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f392d-1d6f-49b9-b21e-4d2d9dea24ff admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:02.532176 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f392d-1d6f-49b9-b21e-4d2d9dea24ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:02.532450 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f392d-1d6f-49b9-b21e-4d2d9dea24ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:02.533197 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f392d-1d6f-49b9-b21e-4d2d9dea24ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:02.534837 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f392d-1d6f-49b9-b21e-4d2d9dea24ff admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:02.545897 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1381/2757] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:46:02 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:46:02.550071 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb1469-519a-4364-81ec-63e681cb5fd5 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:02.560318 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb1469-519a-4364-81ec-63e681cb5fd5 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:02.565764 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4ca3f-260d-4359-af8f-284ef60a1b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:02.566436 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4ca3f-260d-4359-af8f-284ef60a1b03 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:02.566748 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4ca3f-260d-4359-af8f-284ef60a1b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:02.567023 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4ca3f-260d-4359-af8f-284ef60a1b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:02.567781 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4ca3f-260d-4359-af8f-284ef60a1b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:02.569391 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4ca3f-260d-4359-af8f-284ef60a1b03 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:02.579975 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1377/2758] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:46:02 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:46:02.584215 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f392d-1d6f-49b9-b21e-4d2d9dea24ff admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:02.594316 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f392d-1d6f-49b9-b21e-4d2d9dea24ff admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:02.599435 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59da241-e3df-4ec2-a013-f131724acac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:02.600345 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59da241-e3df-4ec2-a013-f131724acac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:02.600641 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59da241-e3df-4ec2-a013-f131724acac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:02.600921 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59da241-e3df-4ec2-a013-f131724acac9 admin admin] PATH_INFO: `/v3/projects/cbf7366f111544f0bcde02a0896ad31d/users/c6ae17fe0bc744e7b24fd535c162c4fa/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:02.615385 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59da241-e3df-4ec2-a013-f131724acac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf7366f111544f0bcde02a0896ad31d, user_id=c6ae17fe0bc744e7b24fd535c162c4fa, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:02.618030 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59da241-e3df-4ec2-a013-f131724acac9 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:02.632860 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1382/2759] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:46:02 2021] PUT /identity/v3/projects/cbf7366f111544f0bcde02a0896ad31d/users/c6ae17fe0bc744e7b24fd535c162c4fa/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:46:02.644055 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7f1f8-44a4-49f1-a9db-04473a3ecdfb None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:02.644348 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7f1f8-44a4-49f1-a9db-04473a3ecdfb None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:02.644628 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7f1f8-44a4-49f1-a9db-04473a3ecdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:02.672599 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-e6a7f1f8-44a4-49f1-a9db-04473a3ecdfb None None] MFA Rules not processed for user `c6ae17fe0bc744e7b24fd535c162c4fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:46:02.673816 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e6a7f1f8-44a4-49f1-a9db-04473a3ecdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:02.738192 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1378/2760] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:46:02 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:46:02.749246 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59da241-e3df-4ec2-a013-f131724acac9 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:02.751294 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-a59da241-e3df-4ec2-a013-f131724acac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:02.814283 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59da241-e3df-4ec2-a013-f131724acac9 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:02.818498 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aeb448-2918-43e6-b240-31d69a3c9d64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:02.819178 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aeb448-2918-43e6-b240-31d69a3c9d64 service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:02.819455 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aeb448-2918-43e6-b240-31d69a3c9d64 service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:02.819748 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aeb448-2918-43e6-b240-31d69a3c9d64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:02.828791 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aeb448-2918-43e6-b240-31d69a3c9d64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:02.830293 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aeb448-2918-43e6-b240-31d69a3c9d64 service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:02.839319 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1383/2761] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:46:02 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:46:05.399296 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7f1f8-44a4-49f1-a9db-04473a3ecdfb None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:05.463867 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7f1f8-44a4-49f1-a9db-04473a3ecdfb None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:05.469176 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f8b4c-ccaf-439d-bf33-4b6eb5cb8f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:05.470078 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f8b4c-ccaf-439d-bf33-4b6eb5cb8f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:05.470365 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f8b4c-ccaf-439d-bf33-4b6eb5cb8f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:05.470634 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f8b4c-ccaf-439d-bf33-4b6eb5cb8f5b admin admin] PATH_INFO: `/v3/users/c6ae17fe0bc744e7b24fd535c162c4fa` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:05.471949 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f8b4c-ccaf-439d-bf33-4b6eb5cb8f5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6ae17fe0bc744e7b24fd535c162c4fa)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:05.473899 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f8b4c-ccaf-439d-bf33-4b6eb5cb8f5b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:05.528894 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-446f8b4c-ccaf-439d-bf33-4b6eb5cb8f5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6ae17fe0bc744e7b24fd535c162c4fa'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:05.529678 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-446f8b4c-ccaf-439d-bf33-4b6eb5cb8f5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6ae17fe0bc744e7b24fd535c162c4fa'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:05.539217 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-446f8b4c-ccaf-439d-bf33-4b6eb5cb8f5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6ae17fe0bc744e7b24fd535c162c4fa'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:05.547453 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-446f8b4c-ccaf-439d-bf33-4b6eb5cb8f5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6ae17fe0bc744e7b24fd535c162c4fa'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:05.559603 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-446f8b4c-ccaf-439d-bf33-4b6eb5cb8f5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6ae17fe0bc744e7b24fd535c162c4fa'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:05.568909 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1379/2762] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:46:05 2021] DELETE /identity/v3/users/c6ae17fe0bc744e7b24fd535c162c4fa => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 14:46:05.571067 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d687a46-3235-43ca-9ca8-1535128141e3 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:05.571879 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d687a46-3235-43ca-9ca8-1535128141e3 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:05.571879 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d687a46-3235-43ca-9ca8-1535128141e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:05.589614 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-7d687a46-3235-43ca-9ca8-1535128141e3 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:46:05.590880 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-7d687a46-3235-43ca-9ca8-1535128141e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:05.653735 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1384/2763] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:46:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:46:05.664447 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f8b4c-ccaf-439d-bf33-4b6eb5cb8f5b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:05.665930 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-446f8b4c-ccaf-439d-bf33-4b6eb5cb8f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:05.725942 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f8b4c-ccaf-439d-bf33-4b6eb5cb8f5b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:05.729454 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8a492-37cf-4a04-be2e-b676649bc5d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:05.730111 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8a492-37cf-4a04-be2e-b676649bc5d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:05.730392 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8a492-37cf-4a04-be2e-b676649bc5d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:05.730665 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8a492-37cf-4a04-be2e-b676649bc5d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:05.740621 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8a492-37cf-4a04-be2e-b676649bc5d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:05.742108 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8a492-37cf-4a04-be2e-b676649bc5d8 service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:05.752203 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1380/2764] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:46:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:46:06.121162 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d687a46-3235-43ca-9ca8-1535128141e3 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:06.123918 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-7d687a46-3235-43ca-9ca8-1535128141e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:06.144944 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d687a46-3235-43ca-9ca8-1535128141e3 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:06.150308 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956298cc-6d48-4d69-b7e7-1f5839205693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:06.151384 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956298cc-6d48-4d69-b7e7-1f5839205693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:06.151683 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956298cc-6d48-4d69-b7e7-1f5839205693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:06.151949 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956298cc-6d48-4d69-b7e7-1f5839205693 admin admin] PATH_INFO: `/v3/projects/cbf7366f111544f0bcde02a0896ad31d` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:06.153150 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956298cc-6d48-4d69-b7e7-1f5839205693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf7366f111544f0bcde02a0896ad31d)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:06.155103 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956298cc-6d48-4d69-b7e7-1f5839205693 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:06.201584 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-956298cc-6d48-4d69-b7e7-1f5839205693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf7366f111544f0bcde02a0896ad31d', 'request_id': 'req-956298cc-6d48-4d69-b7e7-1f5839205693'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:06.208041 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-956298cc-6d48-4d69-b7e7-1f5839205693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf7366f111544f0bcde02a0896ad31d', 'request_id': 'req-956298cc-6d48-4d69-b7e7-1f5839205693'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:06.216947 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-956298cc-6d48-4d69-b7e7-1f5839205693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf7366f111544f0bcde02a0896ad31d', 'request_id': 'req-956298cc-6d48-4d69-b7e7-1f5839205693'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:06.228352 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-956298cc-6d48-4d69-b7e7-1f5839205693 admin admin] The token cache is being invalidate because project cbf7366f111544f0bcde02a0896ad31d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:46:06.228626 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-956298cc-6d48-4d69-b7e7-1f5839205693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:06.229352 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-956298cc-6d48-4d69-b7e7-1f5839205693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:06.231029 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1385/2765] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:46:06 2021] DELETE /identity/v3/projects/cbf7366f111544f0bcde02a0896ad31d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:46:06.237480 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaeafd7-119e-48f7-8069-73725ebaf911 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:06.237814 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaeafd7-119e-48f7-8069-73725ebaf911 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:06.238104 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaeafd7-119e-48f7-8069-73725ebaf911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:06.257620 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-dfaeafd7-119e-48f7-8069-73725ebaf911 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:46:06.258894 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-dfaeafd7-119e-48f7-8069-73725ebaf911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:06.317580 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1381/2766] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:46:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:46:06.328290 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc94327-69a0-4bb5-ba72-6c4a0a21fe6b None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:06.328560 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc94327-69a0-4bb5-ba72-6c4a0a21fe6b None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:06.328835 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc94327-69a0-4bb5-ba72-6c4a0a21fe6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:06.348046 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-8bc94327-69a0-4bb5-ba72-6c4a0a21fe6b None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:46:06.350217 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-8bc94327-69a0-4bb5-ba72-6c4a0a21fe6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:06.358331 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1386/2767] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:46:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 14:46:06.362419 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaeafd7-119e-48f7-8069-73725ebaf911 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:06.372065 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaeafd7-119e-48f7-8069-73725ebaf911 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:06.377245 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df912b16-8304-4131-b7f9-281ce918e77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:06.377895 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df912b16-8304-4131-b7f9-281ce918e77b admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:06.378180 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df912b16-8304-4131-b7f9-281ce918e77b admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:06.378450 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df912b16-8304-4131-b7f9-281ce918e77b admin admin] PATH_INFO: `/v3/domains` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:06.379236 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df912b16-8304-4131-b7f9-281ce918e77b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:46:06.379547 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df912b16-8304-4131-b7f9-281ce918e77b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:06.381154 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df912b16-8304-4131-b7f9-281ce918e77b admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:06.393069 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1382/2768] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:46:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:46:06.397639 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc94327-69a0-4bb5-ba72-6c4a0a21fe6b None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:06.408129 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc94327-69a0-4bb5-ba72-6c4a0a21fe6b None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:06.414061 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e108b-2d20-495d-b114-0691ea291723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:06.414720 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e108b-2d20-495d-b114-0691ea291723 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:06.415031 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e108b-2d20-495d-b114-0691ea291723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:06.415308 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e108b-2d20-495d-b114-0691ea291723 admin admin] PATH_INFO: `/v3/projects` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:06.416047 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e108b-2d20-495d-b114-0691ea291723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:06.417946 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e108b-2d20-495d-b114-0691ea291723 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:06.452016 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1387/2769] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:46:06 2021] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:46:06.456201 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df912b16-8304-4131-b7f9-281ce918e77b admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:06.468798 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df912b16-8304-4131-b7f9-281ce918e77b admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:06.536944 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257f45b-9ece-409b-a5c1-60641a663ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:06.537625 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257f45b-9ece-409b-a5c1-60641a663ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:06.537907 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257f45b-9ece-409b-a5c1-60641a663ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:06.538183 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257f45b-9ece-409b-a5c1-60641a663ca4 admin admin] PATH_INFO: `/v3/users` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:06.538926 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257f45b-9ece-409b-a5c1-60641a663ca4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:06.540863 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257f45b-9ece-409b-a5c1-60641a663ca4 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:06.562749 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1383/2770] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:46:06 2021] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:46:06.567078 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e108b-2d20-495d-b114-0691ea291723 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:06.577457 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e108b-2d20-495d-b114-0691ea291723 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:06.582458 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9835e33-c3cd-44a5-bf46-15c98e8b2d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:06.583164 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9835e33-c3cd-44a5-bf46-15c98e8b2d2f admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:06.583441 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9835e33-c3cd-44a5-bf46-15c98e8b2d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:06.583708 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9835e33-c3cd-44a5-bf46-15c98e8b2d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:06.584444 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9835e33-c3cd-44a5-bf46-15c98e8b2d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:06.586058 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9835e33-c3cd-44a5-bf46-15c98e8b2d2f admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:06.596728 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1388/2771] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:46:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:46:06.600691 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257f45b-9ece-409b-a5c1-60641a663ca4 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:06.611039 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257f45b-9ece-409b-a5c1-60641a663ca4 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:06.616448 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd0cbf-bccf-4e77-b7f2-a4b23b4acfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:06.617104 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd0cbf-bccf-4e77-b7f2-a4b23b4acfe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:06.617387 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd0cbf-bccf-4e77-b7f2-a4b23b4acfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:06.617646 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd0cbf-bccf-4e77-b7f2-a4b23b4acfe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:06.618386 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd0cbf-bccf-4e77-b7f2-a4b23b4acfe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:06.620027 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd0cbf-bccf-4e77-b7f2-a4b23b4acfe8 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:06.630364 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1384/2772] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:46:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 14:46:06.634582 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9835e33-c3cd-44a5-bf46-15c98e8b2d2f admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:06.644756 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9835e33-c3cd-44a5-bf46-15c98e8b2d2f admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:06.650417 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc561ac-35a5-4e69-819c-8d9c82d4fe24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:06.651349 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc561ac-35a5-4e69-819c-8d9c82d4fe24 admin admin] REQUEST_METHOD: `PUT` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:06.651629 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc561ac-35a5-4e69-819c-8d9c82d4fe24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:06.651896 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc561ac-35a5-4e69-819c-8d9c82d4fe24 admin admin] PATH_INFO: `/v3/projects/9f444e8fd1694dc68720d71e974e685c/users/5011f4a904b9457ba628b23e0ca6a8f6/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:06.672270 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc561ac-35a5-4e69-819c-8d9c82d4fe24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f444e8fd1694dc68720d71e974e685c, user_id=5011f4a904b9457ba628b23e0ca6a8f6, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:06.676225 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc561ac-35a5-4e69-819c-8d9c82d4fe24 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:06.698582 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1389/2773] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:46:06 2021] PUT /identity/v3/projects/9f444e8fd1694dc68720d71e974e685c/users/5011f4a904b9457ba628b23e0ca6a8f6/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:46:06.709690 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf70aa9-13d5-4767-906e-e5af01bd1f41 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:06.709975 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf70aa9-13d5-4767-906e-e5af01bd1f41 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:06.710248 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf70aa9-13d5-4767-906e-e5af01bd1f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:06.746315 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-9cf70aa9-13d5-4767-906e-e5af01bd1f41 None None] MFA Rules not processed for user `5011f4a904b9457ba628b23e0ca6a8f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:46:06.747604 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-9cf70aa9-13d5-4767-906e-e5af01bd1f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:06.815942 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1385/2774] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:46:06 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:46:06.826741 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc561ac-35a5-4e69-819c-8d9c82d4fe24 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:06.828946 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-2cc561ac-35a5-4e69-819c-8d9c82d4fe24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:06.889929 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc561ac-35a5-4e69-819c-8d9c82d4fe24 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:06.894081 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f62dac-034a-451c-b723-753c90f694f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:06.894808 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f62dac-034a-451c-b723-753c90f694f1 service cinder] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:06.895061 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f62dac-034a-451c-b723-753c90f694f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:06.895349 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f62dac-034a-451c-b723-753c90f694f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:06.904207 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f62dac-034a-451c-b723-753c90f694f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:06.905677 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f62dac-034a-451c-b723-753c90f694f1 service cinder] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:06.915670 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1390/2775] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:46:06 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:46:06.940444 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf70aa9-13d5-4767-906e-e5af01bd1f41 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:07.015863 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf70aa9-13d5-4767-906e-e5af01bd1f41 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:07.022064 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608b583-edca-4cc1-aeae-28055bb9f925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:07.023098 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608b583-edca-4cc1-aeae-28055bb9f925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:07.023410 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608b583-edca-4cc1-aeae-28055bb9f925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:07.023726 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608b583-edca-4cc1-aeae-28055bb9f925 admin admin] PATH_INFO: `/v3/users/5011f4a904b9457ba628b23e0ca6a8f6` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:07.025018 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608b583-edca-4cc1-aeae-28055bb9f925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5011f4a904b9457ba628b23e0ca6a8f6)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:07.027134 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608b583-edca-4cc1-aeae-28055bb9f925 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:07.080184 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9608b583-edca-4cc1-aeae-28055bb9f925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5011f4a904b9457ba628b23e0ca6a8f6'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:07.080882 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9608b583-edca-4cc1-aeae-28055bb9f925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5011f4a904b9457ba628b23e0ca6a8f6'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:07.089828 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9608b583-edca-4cc1-aeae-28055bb9f925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5011f4a904b9457ba628b23e0ca6a8f6'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:07.097139 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9608b583-edca-4cc1-aeae-28055bb9f925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5011f4a904b9457ba628b23e0ca6a8f6'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:07.109084 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9608b583-edca-4cc1-aeae-28055bb9f925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5011f4a904b9457ba628b23e0ca6a8f6'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:07.115430 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1386/2776] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:46:06 2021] DELETE /identity/v3/users/5011f4a904b9457ba628b23e0ca6a8f6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:46:07.120168 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24c528-fd27-4ecb-ad7c-089f0d55b3dd None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:07.120450 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24c528-fd27-4ecb-ad7c-089f0d55b3dd None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:07.120722 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24c528-fd27-4ecb-ad7c-089f0d55b3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:07.139359 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-4b24c528-fd27-4ecb-ad7c-089f0d55b3dd None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:46:07.140594 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-4b24c528-fd27-4ecb-ad7c-089f0d55b3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:07.210739 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1391/2777] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:46:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:46:07.220707 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608b583-edca-4cc1-aeae-28055bb9f925 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:07.222135 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-9608b583-edca-4cc1-aeae-28055bb9f925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:07.278003 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608b583-edca-4cc1-aeae-28055bb9f925 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:07.281746 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09683da9-e53b-47db-97f3-b31569a30bdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:07.282412 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09683da9-e53b-47db-97f3-b31569a30bdc service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:07.282741 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09683da9-e53b-47db-97f3-b31569a30bdc service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:07.282997 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09683da9-e53b-47db-97f3-b31569a30bdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:07.292603 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09683da9-e53b-47db-97f3-b31569a30bdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:07.294050 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09683da9-e53b-47db-97f3-b31569a30bdc service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:07.303609 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1387/2778] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:46:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:46:07.469252 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24c528-fd27-4ecb-ad7c-089f0d55b3dd None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:07.470833 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-4b24c528-fd27-4ecb-ad7c-089f0d55b3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:07.483078 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24c528-fd27-4ecb-ad7c-089f0d55b3dd None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:07.486698 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c3378-c5a9-402d-a43c-a38d84080716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:07.487362 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c3378-c5a9-402d-a43c-a38d84080716 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:07.487637 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c3378-c5a9-402d-a43c-a38d84080716 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:07.487907 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c3378-c5a9-402d-a43c-a38d84080716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:07.489730 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-0f7c3378-c5a9-402d-a43c-a38d84080716 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:07.555467 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c3378-c5a9-402d-a43c-a38d84080716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:07.556984 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c3378-c5a9-402d-a43c-a38d84080716 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:07.570103 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1392/2779] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:46:07 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:46:07.571589 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09683da9-e53b-47db-97f3-b31569a30bdc service neutron] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:07.573245 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-09683da9-e53b-47db-97f3-b31569a30bdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:07.587057 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09683da9-e53b-47db-97f3-b31569a30bdc service neutron] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:07.591920 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc341ef-2515-4aae-93e1-8358902b7127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:07.592786 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc341ef-2515-4aae-93e1-8358902b7127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:07.593065 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc341ef-2515-4aae-93e1-8358902b7127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:07.593336 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc341ef-2515-4aae-93e1-8358902b7127 admin admin] PATH_INFO: `/v3/projects/9f444e8fd1694dc68720d71e974e685c` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:07.594553 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc341ef-2515-4aae-93e1-8358902b7127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f444e8fd1694dc68720d71e974e685c)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:07.596497 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc341ef-2515-4aae-93e1-8358902b7127 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:07.654300 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-afc341ef-2515-4aae-93e1-8358902b7127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f444e8fd1694dc68720d71e974e685c', 'request_id': 'req-afc341ef-2515-4aae-93e1-8358902b7127'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:07.662488 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-afc341ef-2515-4aae-93e1-8358902b7127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f444e8fd1694dc68720d71e974e685c', 'request_id': 'req-afc341ef-2515-4aae-93e1-8358902b7127'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:07.672480 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-afc341ef-2515-4aae-93e1-8358902b7127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f444e8fd1694dc68720d71e974e685c', 'request_id': 'req-afc341ef-2515-4aae-93e1-8358902b7127'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:07.683077 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-afc341ef-2515-4aae-93e1-8358902b7127 admin admin] The token cache is being invalidate because project 9f444e8fd1694dc68720d71e974e685c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:46:07.683364 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-afc341ef-2515-4aae-93e1-8358902b7127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:07.684025 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-afc341ef-2515-4aae-93e1-8358902b7127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:07.685709 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1388/2780] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:46:07 2021] DELETE /identity/v3/projects/9f444e8fd1694dc68720d71e974e685c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:46:07.691666 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183876a-ca6a-4764-b366-38e7df71abd4 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:07.692145 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183876a-ca6a-4764-b366-38e7df71abd4 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:07.692384 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183876a-ca6a-4764-b366-38e7df71abd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:07.710496 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-3183876a-ca6a-4764-b366-38e7df71abd4 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:46:07.711873 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-3183876a-ca6a-4764-b366-38e7df71abd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:07.769749 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1393/2781] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:46:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:46:07.778985 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545e99a-43d4-41a6-9c8b-84a25ecfe493 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:07.779279 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545e99a-43d4-41a6-9c8b-84a25ecfe493 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:07.779555 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545e99a-43d4-41a6-9c8b-84a25ecfe493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:07.800161 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-1545e99a-43d4-41a6-9c8b-84a25ecfe493 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:46:07.801421 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-1545e99a-43d4-41a6-9c8b-84a25ecfe493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:07.811271 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1389/2782] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:46:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:46:07.815769 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183876a-ca6a-4764-b366-38e7df71abd4 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:07.825488 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183876a-ca6a-4764-b366-38e7df71abd4 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:07.831683 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b582b-97a6-4aa3-9b50-89d91e75ccb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:07.832352 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b582b-97a6-4aa3-9b50-89d91e75ccb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:07.832629 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b582b-97a6-4aa3-9b50-89d91e75ccb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:07.832899 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b582b-97a6-4aa3-9b50-89d91e75ccb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:07.833622 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b582b-97a6-4aa3-9b50-89d91e75ccb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 14:46:07.833920 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b582b-97a6-4aa3-9b50-89d91e75ccb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:07.835551 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b582b-97a6-4aa3-9b50-89d91e75ccb8 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:07.847277 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1394/2783] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Oct 28 14:46:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 14:46:07.851815 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545e99a-43d4-41a6-9c8b-84a25ecfe493 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:07.861325 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545e99a-43d4-41a6-9c8b-84a25ecfe493 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:07.866722 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad481f0-47f2-4bcb-8b32-e4d24f0c783a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:07.867397 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad481f0-47f2-4bcb-8b32-e4d24f0c783a admin admin] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:07.867677 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad481f0-47f2-4bcb-8b32-e4d24f0c783a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:07.867959 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad481f0-47f2-4bcb-8b32-e4d24f0c783a admin admin] PATH_INFO: `/v3/projects` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:07.868661 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad481f0-47f2-4bcb-8b32-e4d24f0c783a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:07.870953 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad481f0-47f2-4bcb-8b32-e4d24f0c783a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:07.901816 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1390/2784] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Oct 28 14:46:07 2021] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 14:46:07.903262 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b582b-97a6-4aa3-9b50-89d91e75ccb8 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:07.914434 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b582b-97a6-4aa3-9b50-89d91e75ccb8 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:07.971682 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fea5b1-4b37-44a4-b1ef-0a3049c30d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:07.972451 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fea5b1-4b37-44a4-b1ef-0a3049c30d71 admin admin] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:07.972739 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fea5b1-4b37-44a4-b1ef-0a3049c30d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:07.973000 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fea5b1-4b37-44a4-b1ef-0a3049c30d71 admin admin] PATH_INFO: `/v3/users` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:07.973731 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fea5b1-4b37-44a4-b1ef-0a3049c30d71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:07.975684 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fea5b1-4b37-44a4-b1ef-0a3049c30d71 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:07.999884 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1395/2785] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Oct 28 14:46:07 2021] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 14:46:08.001188 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad481f0-47f2-4bcb-8b32-e4d24f0c783a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:08.011520 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad481f0-47f2-4bcb-8b32-e4d24f0c783a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:08.016361 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42df640-3509-48fd-8ff9-f48f9c97f4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:08.017125 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42df640-3509-48fd-8ff9-f48f9c97f4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:08.017459 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42df640-3509-48fd-8ff9-f48f9c97f4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:08.017803 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42df640-3509-48fd-8ff9-f48f9c97f4e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:08.018628 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42df640-3509-48fd-8ff9-f48f9c97f4e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:08.020327 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42df640-3509-48fd-8ff9-f48f9c97f4e1 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:08.031010 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1391/2786] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:46:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:46:08.035601 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fea5b1-4b37-44a4-b1ef-0a3049c30d71 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:08.045862 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fea5b1-4b37-44a4-b1ef-0a3049c30d71 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:08.051107 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733f63b-ceb5-4536-8246-a63853bceeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:08.052459 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733f63b-ceb5-4536-8246-a63853bceeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:08.052828 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733f63b-ceb5-4536-8246-a63853bceeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:08.053173 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733f63b-ceb5-4536-8246-a63853bceeb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:08.054999 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733f63b-ceb5-4536-8246-a63853bceeb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:08.056882 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733f63b-ceb5-4536-8246-a63853bceeb8 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:08.068028 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1396/2787] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Oct 28 14:46:08 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 14:46:08.072344 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42df640-3509-48fd-8ff9-f48f9c97f4e1 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:08.083054 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42df640-3509-48fd-8ff9-f48f9c97f4e1 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:08.088084 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f36b8-1d1e-4fb9-83f3-71738b442ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:08.088977 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f36b8-1d1e-4fb9-83f3-71738b442ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:08.089252 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f36b8-1d1e-4fb9-83f3-71738b442ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:08.089523 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f36b8-1d1e-4fb9-83f3-71738b442ac0 admin admin] PATH_INFO: `/v3/projects/3c1fe73a936043139a797568bf0cac45/users/81cfe8cca72640ff96bce53481c5d60d/roles/60f2c4ef9f6646108916900c5bce5845` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:08.104191 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f36b8-1d1e-4fb9-83f3-71738b442ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c1fe73a936043139a797568bf0cac45, user_id=81cfe8cca72640ff96bce53481c5d60d, role_id=60f2c4ef9f6646108916900c5bce5845)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:08.106880 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f36b8-1d1e-4fb9-83f3-71738b442ac0 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:08.121039 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1392/2788] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Oct 28 14:46:08 2021] PUT /identity/v3/projects/3c1fe73a936043139a797568bf0cac45/users/81cfe8cca72640ff96bce53481c5d60d/roles/60f2c4ef9f6646108916900c5bce5845 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:46:08.131344 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5afb8-eb7b-4b22-9e4b-a2759631b8c5 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:08.131623 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5afb8-eb7b-4b22-9e4b-a2759631b8c5 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:08.131905 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5afb8-eb7b-4b22-9e4b-a2759631b8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:08.159743 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-6dd5afb8-eb7b-4b22-9e4b-a2759631b8c5 None None] MFA Rules not processed for user `81cfe8cca72640ff96bce53481c5d60d`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:46:08.161237 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-6dd5afb8-eb7b-4b22-9e4b-a2759631b8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:08.225534 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1397/2789] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:46:08 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:46:08.235359 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f36b8-1d1e-4fb9-83f3-71738b442ac0 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:08.237608 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-fc5f36b8-1d1e-4fb9-83f3-71738b442ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:08.293858 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f36b8-1d1e-4fb9-83f3-71738b442ac0 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:08.297688 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1d5ee-a752-40a5-bbbc-bc7e34bc4d74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:08.298339 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1d5ee-a752-40a5-bbbc-bc7e34bc4d74 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:08.298619 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1d5ee-a752-40a5-bbbc-bc7e34bc4d74 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:08.298927 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1d5ee-a752-40a5-bbbc-bc7e34bc4d74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:08.307289 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1d5ee-a752-40a5-bbbc-bc7e34bc4d74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:08.308764 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1d5ee-a752-40a5-bbbc-bc7e34bc4d74 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:08.317578 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1393/2790] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:46:08 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:46:18.403438 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5afb8-eb7b-4b22-9e4b-a2759631b8c5 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:18.473647 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5afb8-eb7b-4b22-9e4b-a2759631b8c5 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:18.479358 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7e12a-2ef9-44a5-bfa6-5f70de0d1292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:18.480231 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7e12a-2ef9-44a5-bfa6-5f70de0d1292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:18.480507 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7e12a-2ef9-44a5-bfa6-5f70de0d1292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:18.480779 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7e12a-2ef9-44a5-bfa6-5f70de0d1292 admin admin] PATH_INFO: `/v3/users/81cfe8cca72640ff96bce53481c5d60d` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:18.482049 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7e12a-2ef9-44a5-bfa6-5f70de0d1292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81cfe8cca72640ff96bce53481c5d60d)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:18.484027 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7e12a-2ef9-44a5-bfa6-5f70de0d1292 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:18.532397 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-62c7e12a-2ef9-44a5-bfa6-5f70de0d1292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81cfe8cca72640ff96bce53481c5d60d'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:18.540976 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-62c7e12a-2ef9-44a5-bfa6-5f70de0d1292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81cfe8cca72640ff96bce53481c5d60d'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:18.541589 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-62c7e12a-2ef9-44a5-bfa6-5f70de0d1292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81cfe8cca72640ff96bce53481c5d60d'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:18.553363 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-62c7e12a-2ef9-44a5-bfa6-5f70de0d1292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81cfe8cca72640ff96bce53481c5d60d'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:18.560191 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-62c7e12a-2ef9-44a5-bfa6-5f70de0d1292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81cfe8cca72640ff96bce53481c5d60d'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:18.566453 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1398/2791] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:46:18 2021] DELETE /identity/v3/users/81cfe8cca72640ff96bce53481c5d60d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:46:18.571425 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d8ebf-37cb-45d2-a529-b68a327e29d3 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:18.571902 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d8ebf-37cb-45d2-a529-b68a327e29d3 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:18.572021 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d8ebf-37cb-45d2-a529-b68a327e29d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:18.590143 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-d28d8ebf-37cb-45d2-a529-b68a327e29d3 None None] MFA Rules not processed for user `04a56319092f4998a9d4cfc7569eb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:46:18.591394 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-d28d8ebf-37cb-45d2-a529-b68a327e29d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:18.660284 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1394/2792] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:46:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:46:18.670601 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7e12a-2ef9-44a5-bfa6-5f70de0d1292 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:18.672103 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-62c7e12a-2ef9-44a5-bfa6-5f70de0d1292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:18.729793 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7e12a-2ef9-44a5-bfa6-5f70de0d1292 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:18.733932 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef465293-9a2e-4800-9629-97a7f2e76e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:18.734558 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef465293-9a2e-4800-9629-97a7f2e76e71 service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:18.734877 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef465293-9a2e-4800-9629-97a7f2e76e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:18.735124 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef465293-9a2e-4800-9629-97a7f2e76e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:18.745757 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef465293-9a2e-4800-9629-97a7f2e76e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:18.747234 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef465293-9a2e-4800-9629-97a7f2e76e71 service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:18.756754 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1399/2793] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:46:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:46:19.026244 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d8ebf-37cb-45d2-a529-b68a327e29d3 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:46:19.027712 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-d28d8ebf-37cb-45d2-a529-b68a327e29d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:19.040183 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d8ebf-37cb-45d2-a529-b68a327e29d3 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:46:19.045793 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d0148-09c3-44b3-b0e9-dbf8eb82fdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:46:19.046658 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d0148-09c3-44b3-b0e9-dbf8eb82fdd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:19.046975 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d0148-09c3-44b3-b0e9-dbf8eb82fdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:19.047245 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d0148-09c3-44b3-b0e9-dbf8eb82fdd1 admin admin] PATH_INFO: `/v3/projects/3c1fe73a936043139a797568bf0cac45` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:19.053534 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d0148-09c3-44b3-b0e9-dbf8eb82fdd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c1fe73a936043139a797568bf0cac45)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:46:19.055540 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d0148-09c3-44b3-b0e9-dbf8eb82fdd1 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:46:19.106191 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d11d0148-09c3-44b3-b0e9-dbf8eb82fdd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c1fe73a936043139a797568bf0cac45', 'request_id': 'req-d11d0148-09c3-44b3-b0e9-dbf8eb82fdd1'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:19.112435 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d11d0148-09c3-44b3-b0e9-dbf8eb82fdd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c1fe73a936043139a797568bf0cac45', 'request_id': 'req-d11d0148-09c3-44b3-b0e9-dbf8eb82fdd1'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:19.121250 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d11d0148-09c3-44b3-b0e9-dbf8eb82fdd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c1fe73a936043139a797568bf0cac45', 'request_id': 'req-d11d0148-09c3-44b3-b0e9-dbf8eb82fdd1'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:19.132492 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d11d0148-09c3-44b3-b0e9-dbf8eb82fdd1 admin admin] The token cache is being invalidate because project 3c1fe73a936043139a797568bf0cac45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:46:19.132779 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d11d0148-09c3-44b3-b0e9-dbf8eb82fdd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:19.133432 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-d11d0148-09c3-44b3-b0e9-dbf8eb82fdd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:46:19.135397 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1395/2794] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:46:19 2021] DELETE /identity/v3/projects/3c1fe73a936043139a797568bf0cac45 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:46:21.316278 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19589ea-26d2-4137-afb8-e6fec737059b None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:46:21.316915 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19589ea-26d2-4137-afb8-e6fec737059b None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:46:21.316915 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19589ea-26d2-4137-afb8-e6fec737059b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:46:21.335893 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-b19589ea-26d2-4137-afb8-e6fec737059b None None] MFA Rules not processed for user `dc0e283e89e34c2f8d20c60695f94f63`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:46:21.337311 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-b19589ea-26d2-4137-afb8-e6fec737059b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:46:21.395158 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1400/2795] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:46:21 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:47:23.645926 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d0148-09c3-44b3-b0e9-dbf8eb82fdd1 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:47:23.647472 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-d11d0148-09c3-44b3-b0e9-dbf8eb82fdd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:47:23.712836 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d0148-09c3-44b3-b0e9-dbf8eb82fdd1 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:47:23.717374 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d7673-7085-417a-becd-e42b351e9105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:47:23.718036 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d7673-7085-417a-becd-e42b351e9105 service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:47:23.718317 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d7673-7085-417a-becd-e42b351e9105 service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:47:23.718591 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d7673-7085-417a-becd-e42b351e9105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:47:23.720795 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-829d7673-7085-417a-becd-e42b351e9105 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:47:23.795400 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d7673-7085-417a-becd-e42b351e9105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:47:23.796850 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d7673-7085-417a-becd-e42b351e9105 service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:47:23.807741 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1396/2796] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:47:23 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:47:24.375013 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19589ea-26d2-4137-afb8-e6fec737059b None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:47:24.376538 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-b19589ea-26d2-4137-afb8-e6fec737059b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:47:24.392414 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19589ea-26d2-4137-afb8-e6fec737059b None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:47:24.397519 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16964252-794e-49eb-9b3d-c69858b998da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:47:24.398583 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16964252-794e-49eb-9b3d-c69858b998da service neutron] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:47:24.399100 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16964252-794e-49eb-9b3d-c69858b998da service neutron] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:47:24.399969 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16964252-794e-49eb-9b3d-c69858b998da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:47:24.402255 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-16964252-794e-49eb-9b3d-c69858b998da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:47:24.419847 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16964252-794e-49eb-9b3d-c69858b998da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:47:24.422944 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16964252-794e-49eb-9b3d-c69858b998da service neutron] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:47:24.434342 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1401/2797] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:47:24 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:47:29.270777 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d7673-7085-417a-becd-e42b351e9105 service neutron] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:47:29.280543 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d7673-7085-417a-becd-e42b351e9105 service neutron] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:47:29.285727 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a5f5a-dca7-47a1-9029-75ba514d9a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:47:29.286391 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a5f5a-dca7-47a1-9029-75ba514d9a9d service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:47:29.286671 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a5f5a-dca7-47a1-9029-75ba514d9a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:47:29.287089 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a5f5a-dca7-47a1-9029-75ba514d9a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:47:29.289075 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-0f8a5f5a-dca7-47a1-9029-75ba514d9a9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:47:29.303318 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a5f5a-dca7-47a1-9029-75ba514d9a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:47:29.304748 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a5f5a-dca7-47a1-9029-75ba514d9a9d service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:47:29.315589 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1397/2798] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:47:29 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:47:30.417262 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16964252-794e-49eb-9b3d-c69858b998da service neutron] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:47:30.418850 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-16964252-794e-49eb-9b3d-c69858b998da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:47:30.435450 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16964252-794e-49eb-9b3d-c69858b998da service neutron] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:47:30.442447 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e1f5d-35a2-4c95-ac74-af5990473b47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:47:30.443220 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e1f5d-35a2-4c95-ac74-af5990473b47 service nova] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:47:30.443496 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e1f5d-35a2-4c95-ac74-af5990473b47 service nova] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:47:30.443764 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e1f5d-35a2-4c95-ac74-af5990473b47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:47:30.445883 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-df6e1f5d-35a2-4c95-ac74-af5990473b47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:47:30.459458 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e1f5d-35a2-4c95-ac74-af5990473b47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:47:30.461052 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e1f5d-35a2-4c95-ac74-af5990473b47 service nova] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:47:30.475879 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1402/2799] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:47:30 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:47:31.645886 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c3150-971e-4632-9e40-9376633048b8 None None] REQUEST_METHOD: `POST` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:47:31.646714 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c3150-971e-4632-9e40-9376633048b8 None None] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:47:31.646714 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c3150-971e-4632-9e40-9376633048b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:47:31.665879 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.auth.core [None req-184c3150-971e-4632-9e40-9376633048b8 None None] MFA Rules not processed for user `62cc0165aee14b449c8a49233001f631`. Rule list: `[]` (Enabled: `True`). {{(pid=79414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:47:31.667110 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-184c3150-971e-4632-9e40-9376633048b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:47:31.722925 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1398/2800] 10.222.0.79 () {58 vars in 967 bytes} [Thu Oct 28 14:47:31 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:47:31.763447 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e1f5d-35a2-4c95-ac74-af5990473b47 service nova] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:47:31.764976 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-df6e1f5d-35a2-4c95-ac74-af5990473b47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:47:31.838589 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e1f5d-35a2-4c95-ac74-af5990473b47 service nova] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:47:31.844244 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e55a3b-d041-49e6-a5f8-f29611c84d72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889e7be1dcaf47f599af9c9b7ad33042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:47:31.844903 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e55a3b-d041-49e6-a5f8-f29611c84d72 service swift] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:47:31.845182 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e55a3b-d041-49e6-a5f8-f29611c84d72 service swift] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:47:31.845442 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e55a3b-d041-49e6-a5f8-f29611c84d72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:47:31.854082 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e55a3b-d041-49e6-a5f8-f29611c84d72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:47:31.855695 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e55a3b-d041-49e6-a5f8-f29611c84d72 service swift] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:47:31.863958 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1403/2801] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Oct 28 14:47:31 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 14:47:38.730584 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c3150-971e-4632-9e40-9376633048b8 None None] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:47:38.732715 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-184c3150-971e-4632-9e40-9376633048b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:47:38.803928 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c3150-971e-4632-9e40-9376633048b8 None None] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:47:38.808449 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff599471-57a3-438e-9fd4-3d65a8428340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:47:38.809320 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff599471-57a3-438e-9fd4-3d65a8428340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:47:38.809594 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff599471-57a3-438e-9fd4-3d65a8428340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:47:38.809862 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff599471-57a3-438e-9fd4-3d65a8428340 admin admin] PATH_INFO: `/v3/users/efb3930f2a614e66944c99814a426a75` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:47:38.811103 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff599471-57a3-438e-9fd4-3d65a8428340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efb3930f2a614e66944c99814a426a75)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:47:38.813012 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff599471-57a3-438e-9fd4-3d65a8428340 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:47:38.861363 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ff599471-57a3-438e-9fd4-3d65a8428340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efb3930f2a614e66944c99814a426a75'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:47:38.862035 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ff599471-57a3-438e-9fd4-3d65a8428340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efb3930f2a614e66944c99814a426a75'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:47:38.870641 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ff599471-57a3-438e-9fd4-3d65a8428340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efb3930f2a614e66944c99814a426a75'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:47:38.877816 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ff599471-57a3-438e-9fd4-3d65a8428340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efb3930f2a614e66944c99814a426a75'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:47:38.889444 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-ff599471-57a3-438e-9fd4-3d65a8428340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efb3930f2a614e66944c99814a426a75'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:47:38.895574 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1399/2802] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:47:38 2021] DELETE /identity/v3/users/efb3930f2a614e66944c99814a426a75 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:47:39.081419 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e55a3b-d041-49e6-a5f8-f29611c84d72 service swift] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:47:39.094497 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e55a3b-d041-49e6-a5f8-f29611c84d72 service swift] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:47:39.158388 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96041015-ec78-45ea-a390-6503cb914164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:47:39.159706 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96041015-ec78-45ea-a390-6503cb914164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:47:39.160109 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96041015-ec78-45ea-a390-6503cb914164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:47:39.160482 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96041015-ec78-45ea-a390-6503cb914164 admin admin] PATH_INFO: `/v3/projects/5ed02b182e3f46e99a390b62c69040b0` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:47:39.162223 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96041015-ec78-45ea-a390-6503cb914164 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ed02b182e3f46e99a390b62c69040b0)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:47:39.165291 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96041015-ec78-45ea-a390-6503cb914164 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:47:39.221299 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-96041015-ec78-45ea-a390-6503cb914164 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ed02b182e3f46e99a390b62c69040b0', 'request_id': 'req-96041015-ec78-45ea-a390-6503cb914164'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:47:39.227288 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-96041015-ec78-45ea-a390-6503cb914164 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ed02b182e3f46e99a390b62c69040b0', 'request_id': 'req-96041015-ec78-45ea-a390-6503cb914164'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:47:39.237601 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-96041015-ec78-45ea-a390-6503cb914164 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ed02b182e3f46e99a390b62c69040b0', 'request_id': 'req-96041015-ec78-45ea-a390-6503cb914164'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:47:39.248984 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-96041015-ec78-45ea-a390-6503cb914164 admin admin] The token cache is being invalidate because project 5ed02b182e3f46e99a390b62c69040b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:47:39.249273 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-96041015-ec78-45ea-a390-6503cb914164 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:47:39.249992 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-96041015-ec78-45ea-a390-6503cb914164 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:47:39.251666 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1404/2803] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:47:39 2021] DELETE /identity/v3/projects/5ed02b182e3f46e99a390b62c69040b0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:47:39.256035 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff599471-57a3-438e-9fd4-3d65a8428340 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:47:39.257518 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-ff599471-57a3-438e-9fd4-3d65a8428340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:47:39.271883 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff599471-57a3-438e-9fd4-3d65a8428340 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:47:39.329769 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74256e-0b43-4f34-8203-cc966d100b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:47:39.330630 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74256e-0b43-4f34-8203-cc966d100b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:47:39.330941 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74256e-0b43-4f34-8203-cc966d100b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:47:39.331217 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74256e-0b43-4f34-8203-cc966d100b91 admin admin] PATH_INFO: `/v3/users/e44b7f1a1e50499997cd7a4182d2d6c5` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:47:39.332467 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74256e-0b43-4f34-8203-cc966d100b91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e44b7f1a1e50499997cd7a4182d2d6c5)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:47:39.334396 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74256e-0b43-4f34-8203-cc966d100b91 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:47:39.384755 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9b74256e-0b43-4f34-8203-cc966d100b91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e44b7f1a1e50499997cd7a4182d2d6c5'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:47:39.385418 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9b74256e-0b43-4f34-8203-cc966d100b91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e44b7f1a1e50499997cd7a4182d2d6c5'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:47:39.393616 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9b74256e-0b43-4f34-8203-cc966d100b91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e44b7f1a1e50499997cd7a4182d2d6c5'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:47:39.400475 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9b74256e-0b43-4f34-8203-cc966d100b91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e44b7f1a1e50499997cd7a4182d2d6c5'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:47:39.413483 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-9b74256e-0b43-4f34-8203-cc966d100b91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e44b7f1a1e50499997cd7a4182d2d6c5'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:47:39.421429 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1400/2804] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:47:39 2021] DELETE /identity/v3/users/e44b7f1a1e50499997cd7a4182d2d6c5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:47:39.605683 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96041015-ec78-45ea-a390-6503cb914164 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:47:39.607476 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-96041015-ec78-45ea-a390-6503cb914164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:47:39.621265 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96041015-ec78-45ea-a390-6503cb914164 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:47:39.676667 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fdfc5-c468-40c8-88bc-dfc3d649b75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:47:39.677462 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fdfc5-c468-40c8-88bc-dfc3d649b75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:47:39.677743 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fdfc5-c468-40c8-88bc-dfc3d649b75e admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:47:39.678014 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fdfc5-c468-40c8-88bc-dfc3d649b75e admin admin] PATH_INFO: `/v3/projects/f409a869e2344604b5ac3ae7f026e3fd` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:47:39.679261 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fdfc5-c468-40c8-88bc-dfc3d649b75e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f409a869e2344604b5ac3ae7f026e3fd)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:47:39.681215 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fdfc5-c468-40c8-88bc-dfc3d649b75e admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:47:39.727879 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-bb1fdfc5-c468-40c8-88bc-dfc3d649b75e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f409a869e2344604b5ac3ae7f026e3fd', 'request_id': 'req-bb1fdfc5-c468-40c8-88bc-dfc3d649b75e'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:47:39.733698 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-bb1fdfc5-c468-40c8-88bc-dfc3d649b75e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f409a869e2344604b5ac3ae7f026e3fd', 'request_id': 'req-bb1fdfc5-c468-40c8-88bc-dfc3d649b75e'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:47:39.741570 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-bb1fdfc5-c468-40c8-88bc-dfc3d649b75e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f409a869e2344604b5ac3ae7f026e3fd', 'request_id': 'req-bb1fdfc5-c468-40c8-88bc-dfc3d649b75e'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:47:39.751743 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-bb1fdfc5-c468-40c8-88bc-dfc3d649b75e admin admin] The token cache is being invalidate because project f409a869e2344604b5ac3ae7f026e3fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:47:39.752029 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-bb1fdfc5-c468-40c8-88bc-dfc3d649b75e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:47:39.752642 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-bb1fdfc5-c468-40c8-88bc-dfc3d649b75e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:47:39.754184 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1405/2805] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:47:39 2021] DELETE /identity/v3/projects/f409a869e2344604b5ac3ae7f026e3fd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:48:19.832590 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74256e-0b43-4f34-8203-cc966d100b91 admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:48:19.836110 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-9b74256e-0b43-4f34-8203-cc966d100b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:48:19.906377 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74256e-0b43-4f34-8203-cc966d100b91 admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:48:19.955070 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97e377-c177-4286-86ab-00552ea8c838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218708788ed447499b00de12cff0f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:48:19.955753 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97e377-c177-4286-86ab-00552ea8c838 service cinder] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:48:19.956048 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97e377-c177-4286-86ab-00552ea8c838 service cinder] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:48:19.956320 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97e377-c177-4286-86ab-00552ea8c838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:48:19.958203 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-6e97e377-c177-4286-86ab-00552ea8c838 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:48:20.023462 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97e377-c177-4286-86ab-00552ea8c838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:48:20.024918 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97e377-c177-4286-86ab-00552ea8c838 service cinder] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:48:20.035592 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1401/2806] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:48:19 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:48:22.242473 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0333658-9791-47e9-a50b-68d88add3b75 None None] REQUEST_METHOD: `POST` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:48:22.243092 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0333658-9791-47e9-a50b-68d88add3b75 None None] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:48:22.243092 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0333658-9791-47e9-a50b-68d88add3b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:48:22.262588 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.auth.core [None req-e0333658-9791-47e9-a50b-68d88add3b75 None None] MFA Rules not processed for user `dc0e283e89e34c2f8d20c60695f94f63`. Rule list: `[]` (Enabled: `True`). {{(pid=79413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 14:48:22.263873 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-e0333658-9791-47e9-a50b-68d88add3b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:48:22.272435 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1406/2807] 10.222.0.79 () {58 vars in 957 bytes} [Thu Oct 28 14:48:22 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 14:48:22.594663 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97e377-c177-4286-86ab-00552ea8c838 service cinder] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:48:22.596195 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-6e97e377-c177-4286-86ab-00552ea8c838 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:48:22.653934 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97e377-c177-4286-86ab-00552ea8c838 service cinder] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:48:22.658981 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d0937-f5bc-4097-82ab-489197349188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:48:22.659728 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d0937-f5bc-4097-82ab-489197349188 service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:48:22.660000 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d0937-f5bc-4097-82ab-489197349188 service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:48:22.660268 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d0937-f5bc-4097-82ab-489197349188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:48:22.662486 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-cf8d0937-f5bc-4097-82ab-489197349188 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:48:22.674305 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d0937-f5bc-4097-82ab-489197349188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:48:22.676639 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d0937-f5bc-4097-82ab-489197349188 service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:48:22.689646 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1402/2808] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:48:22 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:48:24.177403 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0333658-9791-47e9-a50b-68d88add3b75 None None] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:48:24.179044 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-e0333658-9791-47e9-a50b-68d88add3b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:48:24.255835 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0333658-9791-47e9-a50b-68d88add3b75 None None] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:48:24.261928 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a31b0-cb50-45d4-991c-2e21d5460ce5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bf32a6fafb7458788a47e4774cb7bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:48:24.262590 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a31b0-cb50-45d4-991c-2e21d5460ce5 service placement] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:48:24.262968 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a31b0-cb50-45d4-991c-2e21d5460ce5 service placement] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:48:24.263244 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a31b0-cb50-45d4-991c-2e21d5460ce5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:48:24.265297 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-138a31b0-cb50-45d4-991c-2e21d5460ce5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:48:24.277512 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a31b0-cb50-45d4-991c-2e21d5460ce5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:48:24.279141 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a31b0-cb50-45d4-991c-2e21d5460ce5 service placement] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:48:24.289966 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1407/2809] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:48:24 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:48:40.943078 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d0937-f5bc-4097-82ab-489197349188 service neutron] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:48:40.944567 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-cf8d0937-f5bc-4097-82ab-489197349188 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:48:41.017568 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d0937-f5bc-4097-82ab-489197349188 service neutron] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:48:41.023946 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313a73e-6caa-4b09-9045-57a83f414122 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cd6636ae7847c78be910824410d295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:48:41.024719 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313a73e-6caa-4b09-9045-57a83f414122 service nova] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:48:41.025001 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313a73e-6caa-4b09-9045-57a83f414122 service nova] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:48:41.025277 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313a73e-6caa-4b09-9045-57a83f414122 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:48:41.027153 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-e313a73e-6caa-4b09-9045-57a83f414122 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:48:41.039575 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313a73e-6caa-4b09-9045-57a83f414122 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:48:41.041225 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313a73e-6caa-4b09-9045-57a83f414122 service nova] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:48:41.052056 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1403/2810] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:48:40 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:50:16.427344 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a31b0-cb50-45d4-991c-2e21d5460ce5 service placement] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:50:16.428779 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-138a31b0-cb50-45d4-991c-2e21d5460ce5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:50:16.522600 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a31b0-cb50-45d4-991c-2e21d5460ce5 service placement] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:50:16.529053 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876fc53-b92f-4a04-a710-741b2cdab9d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bf32a6fafb7458788a47e4774cb7bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:50:16.529707 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876fc53-b92f-4a04-a710-741b2cdab9d6 service placement] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:50:16.529983 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876fc53-b92f-4a04-a710-741b2cdab9d6 service placement] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:50:16.530252 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876fc53-b92f-4a04-a710-741b2cdab9d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:50:16.532209 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-1876fc53-b92f-4a04-a710-741b2cdab9d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:50:16.544821 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876fc53-b92f-4a04-a710-741b2cdab9d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:50:16.546410 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876fc53-b92f-4a04-a710-741b2cdab9d6 service placement] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:50:16.557064 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1408/2811] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:50:16 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 14:50:27.349332 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313a73e-6caa-4b09-9045-57a83f414122 service nova] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:50:27.390700 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313a73e-6caa-4b09-9045-57a83f414122 service nova] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:50:27.395757 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f946c-6507-491c-834d-64301ab7ab8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a689fc75b37b4557a682f6cad357df6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:50:27.396419 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f946c-6507-491c-834d-64301ab7ab8a service neutron] REQUEST_METHOD: `GET` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:50:27.396699 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f946c-6507-491c-834d-64301ab7ab8a service neutron] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:50:27.397042 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f946c-6507-491c-834d-64301ab7ab8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:50:27.399479 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-6b5f946c-6507-491c-834d-64301ab7ab8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:50:27.492790 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f946c-6507-491c-834d-64301ab7ab8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:50:27.494140 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f946c-6507-491c-834d-64301ab7ab8a service neutron] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:50:27.513874 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1404/2812] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:50:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 14:50:33.896705 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876fc53-b92f-4a04-a710-741b2cdab9d6 service placement] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:50:33.903214 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-1876fc53-b92f-4a04-a710-741b2cdab9d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:50:33.918916 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876fc53-b92f-4a04-a710-741b2cdab9d6 service placement] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:50:33.923391 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d2454-c958-440b-a873-0333c0378b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:50:33.924264 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d2454-c958-440b-a873-0333c0378b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:50:33.924537 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d2454-c958-440b-a873-0333c0378b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:50:33.924826 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d2454-c958-440b-a873-0333c0378b73 admin admin] PATH_INFO: `/v3/users/dc0e283e89e34c2f8d20c60695f94f63` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:50:33.926012 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d2454-c958-440b-a873-0333c0378b73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc0e283e89e34c2f8d20c60695f94f63)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:50:33.927977 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d2454-c958-440b-a873-0333c0378b73 admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:50:33.974170 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4d5d2454-c958-440b-a873-0333c0378b73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc0e283e89e34c2f8d20c60695f94f63'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:50:33.982611 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4d5d2454-c958-440b-a873-0333c0378b73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc0e283e89e34c2f8d20c60695f94f63'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:50:33.983255 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4d5d2454-c958-440b-a873-0333c0378b73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc0e283e89e34c2f8d20c60695f94f63'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:50:33.995126 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4d5d2454-c958-440b-a873-0333c0378b73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc0e283e89e34c2f8d20c60695f94f63'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:50:34.002838 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-4d5d2454-c958-440b-a873-0333c0378b73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc0e283e89e34c2f8d20c60695f94f63'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:50:34.008991 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1409/2813] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:50:33 2021] DELETE /identity/v3/users/dc0e283e89e34c2f8d20c60695f94f63 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:50:34.187697 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f946c-6507-491c-834d-64301ab7ab8a service neutron] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:50:34.197882 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f946c-6507-491c-834d-64301ab7ab8a service neutron] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:50:34.258984 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cd49a-b77c-4651-9af5-7264ea3d329a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:50:34.259765 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cd49a-b77c-4651-9af5-7264ea3d329a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:50:34.260038 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cd49a-b77c-4651-9af5-7264ea3d329a admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:50:34.260308 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cd49a-b77c-4651-9af5-7264ea3d329a admin admin] PATH_INFO: `/v3/projects/3c7c19b77a1a4fac81de8244c2a70247` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:50:34.261518 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cd49a-b77c-4651-9af5-7264ea3d329a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c7c19b77a1a4fac81de8244c2a70247)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:50:34.263465 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cd49a-b77c-4651-9af5-7264ea3d329a admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:50:34.316012 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1a4cd49a-b77c-4651-9af5-7264ea3d329a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c7c19b77a1a4fac81de8244c2a70247', 'request_id': 'req-1a4cd49a-b77c-4651-9af5-7264ea3d329a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:50:34.322637 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1a4cd49a-b77c-4651-9af5-7264ea3d329a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c7c19b77a1a4fac81de8244c2a70247', 'request_id': 'req-1a4cd49a-b77c-4651-9af5-7264ea3d329a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:50:34.331907 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1a4cd49a-b77c-4651-9af5-7264ea3d329a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c7c19b77a1a4fac81de8244c2a70247', 'request_id': 'req-1a4cd49a-b77c-4651-9af5-7264ea3d329a'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:50:34.342417 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1a4cd49a-b77c-4651-9af5-7264ea3d329a admin admin] The token cache is being invalidate because project 3c7c19b77a1a4fac81de8244c2a70247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:50:34.342723 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1a4cd49a-b77c-4651-9af5-7264ea3d329a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:50:34.343331 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-1a4cd49a-b77c-4651-9af5-7264ea3d329a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:50:34.344887 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1405/2814] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:50:34 2021] DELETE /identity/v3/projects/3c7c19b77a1a4fac81de8244c2a70247 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:50:34.348989 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d2454-c958-440b-a873-0333c0378b73 admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:50:34.350670 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-4d5d2454-c958-440b-a873-0333c0378b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:50:34.363908 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d2454-c958-440b-a873-0333c0378b73 admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:50:34.420952 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4eda1-2d4b-4013-b205-8b316ba1971b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:50:34.421823 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4eda1-2d4b-4013-b205-8b316ba1971b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:50:34.422094 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4eda1-2d4b-4013-b205-8b316ba1971b admin admin] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:50:34.422360 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4eda1-2d4b-4013-b205-8b316ba1971b admin admin] PATH_INFO: `/v3/users/fd7c258bf79e4974abb03695fef3b317` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:50:34.423631 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4eda1-2d4b-4013-b205-8b316ba1971b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd7c258bf79e4974abb03695fef3b317)` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:50:34.425520 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4eda1-2d4b-4013-b205-8b316ba1971b admin admin] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:50:34.473200 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-95b4eda1-2d4b-4013-b205-8b316ba1971b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd7c258bf79e4974abb03695fef3b317'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:50:34.482223 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-95b4eda1-2d4b-4013-b205-8b316ba1971b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd7c258bf79e4974abb03695fef3b317'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:50:34.483029 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-95b4eda1-2d4b-4013-b205-8b316ba1971b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd7c258bf79e4974abb03695fef3b317'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:50:34.495451 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-95b4eda1-2d4b-4013-b205-8b316ba1971b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd7c258bf79e4974abb03695fef3b317'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:50:34.502098 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.notifications [None req-95b4eda1-2d4b-4013-b205-8b316ba1971b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd7c258bf79e4974abb03695fef3b317'} {{(pid=79413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:50:34.508018 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1410/2815] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Oct 28 14:50:34 2021] DELETE /identity/v3/users/fd7c258bf79e4974abb03695fef3b317 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:50:34.704742 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cd49a-b77c-4651-9af5-7264ea3d329a admin admin] Authenticating user token {{(pid=79414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:50:34.706252 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.fernet_utils [None req-1a4cd49a-b77c-4651-9af5-7264ea3d329a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:50:34.719778 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cd49a-b77c-4651-9af5-7264ea3d329a admin admin] Validating token access rules against request {{(pid=79414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:50:34.785188 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66aa38-bcc6-4d33-8288-2c14927e8e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a56319092f4998a9d4cfc7569eb00c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7760de20f300416cbabf0f95c42b2e83', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:50:34.786344 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66aa38-bcc6-4d33-8288-2c14927e8e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:50:34.786635 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66aa38-bcc6-4d33-8288-2c14927e8e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:50:34.786931 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66aa38-bcc6-4d33-8288-2c14927e8e70 admin admin] PATH_INFO: `/v3/projects/ce16b7567cea474c9b91b57964095f17` {{(pid=79414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:50:34.788276 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66aa38-bcc6-4d33-8288-2c14927e8e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce16b7567cea474c9b91b57964095f17)` {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:50:34.790212 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66aa38-bcc6-4d33-8288-2c14927e8e70 admin admin] RBAC: Authorization granted {{(pid=79414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:50:34.840908 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-8e66aa38-bcc6-4d33-8288-2c14927e8e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce16b7567cea474c9b91b57964095f17', 'request_id': 'req-8e66aa38-bcc6-4d33-8288-2c14927e8e70'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:50:34.847392 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-8e66aa38-bcc6-4d33-8288-2c14927e8e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce16b7567cea474c9b91b57964095f17', 'request_id': 'req-8e66aa38-bcc6-4d33-8288-2c14927e8e70'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:50:34.855318 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-8e66aa38-bcc6-4d33-8288-2c14927e8e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce16b7567cea474c9b91b57964095f17', 'request_id': 'req-8e66aa38-bcc6-4d33-8288-2c14927e8e70'} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:50:34.866237 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-8e66aa38-bcc6-4d33-8288-2c14927e8e70 admin admin] The token cache is being invalidate because project ce16b7567cea474c9b91b57964095f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 14:50:34.866520 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-8e66aa38-bcc6-4d33-8288-2c14927e8e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:50:34.867715 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: DEBUG keystone.notifications [None req-8e66aa38-bcc6-4d33-8288-2c14927e8e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 14:50:34.869189 dv-cinder-815848-1-iscsi devstack@keystone.service[79414]: [pid: 79414|app: 0|req: 1406/2816] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Oct 28 14:50:34 2021] DELETE /identity/v3/projects/ce16b7567cea474c9b91b57964095f17 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 14:55:20.443042 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4eda1-2d4b-4013-b205-8b316ba1971b admin admin] Authenticating user token {{(pid=79413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 14:55:20.444708 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-95b4eda1-2d4b-4013-b205-8b316ba1971b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:55:20.525082 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4eda1-2d4b-4013-b205-8b316ba1971b admin admin] Validating token access rules against request {{(pid=79413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 14:55:20.591128 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0ce65-6b60-4528-abac-b8f9851c88f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bf32a6fafb7458788a47e4774cb7bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b433200db4784bfeadca48d24212e823', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 14:55:20.591786 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0ce65-6b60-4528-abac-b8f9851c88f0 service placement] REQUEST_METHOD: `GET` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 14:55:20.592067 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0ce65-6b60-4528-abac-b8f9851c88f0 service placement] SCRIPT_NAME: `/identity` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 14:55:20.592344 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0ce65-6b60-4528-abac-b8f9851c88f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 14:55:20.594536 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.fernet_utils [None req-80a0ce65-6b60-4528-abac-b8f9851c88f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 14:55:20.607070 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0ce65-6b60-4528-abac-b8f9851c88f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 14:55:20.608664 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0ce65-6b60-4528-abac-b8f9851c88f0 service placement] RBAC: Authorization granted {{(pid=79413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 14:55:20.618824 dv-cinder-815848-1-iscsi devstack@keystone.service[79413]: [pid: 79413|app: 0|req: 1411/2817] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Oct 28 14:55:20 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)